M
martinz
Guest
So we doubled the amount of memory, and I used a lot of parameters suggested by James and George. It halved the time needed for the idx build. In fact, the time needed for the data scan fase stayed about the same(about 2.5 hours), and the time needed for the actual sorting and merging went from about 5.5h to just over 1.5h. We tested about 8 different scenarios, varying the -TMB, -mergethreads, -datascanthreads and -pfactor parameters. For us, this worked best: ${DLC}/bin/proutil ${DBDIR}/${DB} -C idxbuild area Index_960 -TB 64 -TM 32 -TMB 4096 -SG 64 -TF 80 -T ${DUMPDIR} -threadnum 4 -mergethreads 2 -datascanthreads 8 -pfactor 80 -i -rusage -z
Continue reading...
Continue reading...