CMOD Load Threshold Metrics - MP 9.5 on AIX with DB2 and PDF Indexer

Previous topic - Next topic

tjspencer2

Has anyone ever seen when loading PDF files with many contiguous statements where you can cross loading thresholds such that you have to keep file sizes below a certain size to get them to load in a reasonable amount of time?

I have an example where a 200 MB PDF file loads in 4.4 hours but when I try to load one that is 340+MB it takes 11.5 hours to load?  Scratching my head  :-\ 

I originally thought the dropping unnecessary indexes from the AG was the issue, but the problem is clearly larger than just indexes. 

Note: I have other AGs that can load PDF files that are 500MB in minutes and not hours.

Justin Derrick

Yeah, those load times are insane.  Most CMOD PDF Indexing is done on Windows -- simply because the libraries for PDF on the Windows platforms are the most heavily used, so get the most development time/effort.

There are other tricks, like disabling PDF's internal compression to let CMOD work its own magic under the covers.

You can test it out by running the loads manually from a PC with the CMOD server software installed locally.  If the performance is way better, then consider adding that into your architecture. 

-JD.
Call:  +1-866-533-7742  or  eMail:  jd@justinderrick.com
IBM CMOD Wiki:  https://CMOD.wiki/
FREE IBM CMOD Webinars:  https://CMOD.Training/
IBM CMOD Professional Services: https://CMOD.cloud

Interests: #AIX #Linux #Multiplatforms #DB2 #TSM #SP #Performance #Security #Audits #Customizing #Availability #HA #DR