[progress Communities] [progress Openedge Abl] Forum Post: Bulk-copy Process Performance

Status
Not open for further replies.
V

Valeriy Bashkatov

Guest
Pro2Oracle v.5.0 On windows machine works only Pro2 Admin panel. Repl process, Bulk-Copy process and Schema Holder works on separate Unix server. Source database works on separate Unix server. Oracle works on separate Unix server. Between them, a 10 Gigabit network. When the Customer start the Bulk-Copy process (Primary sync with Oracle) only for one table, which size to small, something like 1.2 GB and 5 000 00 records, this take 2 minutes 45 second in average for each 100 000 records, even to load one table and no matter how many threads there are. It is too long. The Customer have more large tables, which size more that 500 Gb up to 2 TB. It will take many months to sync.... even if we load table divided by years. They Oracle DBA says, that he see that in Oracle for each records makes one commit when Bulk-Copy process work. And it is a problem. He say, that this behavior in Pro2 application is wrong and it is needed to use more large transaction for improve performance. I don't know how to do this in the Pro2. So, my questions is: 1. How long time needed for load 100 000 records into your Oracle database? 2. If there is some special parameters for connect to Progress Data Server Schema Holder to improve performance (-DSRV)? Which parameters did you use? If ther is a parameter for transaction size? 3. If there is some special parameters in the Properies of Pro2 to make commit not for each records but, for examles, for each 1000 records? 4. Why Pro2 make comit for each records int the Bulk-Copy Process? And last question about security. Why for Data Server for Oracle needs select permission for this system tables? sys.argument$ sys.col$ sys.com$ sys.con$ sys.dual sys.icol$ sys.ind$ sys.link$ sys.obj$ sys.procedure$ sys.seq$ sys.syn$ sys.tab$ sys.user$ sys.view$ sys.ts$ sys.ccol$ sys.cdef$ I had a very hard battle with their Oracle DBA to get these permissions. For what purposes need each of these tables for Data Server? Or maybe Pro2 is not designed for such Big Data? How do you solve this problem? My client is ready to consider alternative solutions. Or what explanation should I give them so that they stay with us (Pro2)? Regards, Valeriy

Continue reading...
 
Status
Not open for further replies.
Top