Multiple Thread Data Laoding

C

casorohi

Member
Hi guys need help in binary Dump and Load.
The progress version is 102B02 on Linux 32 Bit.
While doing dump multithread (-thread 1 -threadnum 10) works fine and I am able to see the multiple threads dumping the data, but in data loading only one thread is working.. is this correct or I am missing something
Load Log shows:
starting with record 1, section 1. (6204)
20000 records loaded
40000 records loaded
60000 records loaded
80000 records loaded
100000 records loaded
120000 records loaded
140000 records loaded
…..

I am using following cmd
$DLC/bin/proutil <dbname> -C load <tablename> -thread 1 -threadnum 10 -dumplist <dumplist.txt>
Is above is correct ?

Thanks
 
Binary load is single threaded. You can, however, run multiple instances -- like 1 per table.

Why are you running a 32 bit executable? That's silly.
 
Thanks Tom for clearing the things
One doubt, I read somewhere that it’s good to run one load per storage area to avoid record scattered is that true or we can start load multiple process for same storage area ?
Thanks
 
That depends on your storage area design.

For type I storage areas that's still ( always was ) true. That is because one data block of such an storage area can contain records from different tables and therefore you would increase the scatter already during the load when loading multiple tables simultaneously into the same storage area.

For type II storage areas ( which have been introduced with OE 10 ) that is not entirely true anymore. That is because one data block of such an storage area will always contain records from 1 distinct table. Plus these blocks are clustered ( minimum 8 database blocks ). Therefore you would have at least always minimum 8 consecutive database blocks per table. Still, if you have many small tables in one storage area, there might be a slight impact - YMMV ...


Heavy Regards, RealHeavyDude.
 
You must log in or register to reply here.
Back
Top