Justin,

You bring up a good point that if the filename created by the concatenation of the index values is not unique then the output files can potentially overwrite each other making the total number of output files less than the number of retrievals (message 66 or 67).

However, in this case the value of the MANIFESTID for each document should be unique (forcing the creation of a unique filename). I verified this by using the same Named Query in the OnDemand Client, sorting the list by MANIFESTID, and analyzing a list of hits for duplicates and finding them to all be unique.

I have opened a support ticket with IBM and provided them with their requested information and am waiting for a response.  I will post again if this is resolved.

The PDF indexer is multi-threaded. Each thread produces an output file.  The load process combines them into the objects that are actually archived.  If the load is successful all of those intermediate files should be deleted.  Is it possible that you have files that are failing and leaving these intermediate files on the system?
As an example, a small PDF file (184k), when running index only, produced these files:
MH_MartForms_176pg.pdf.ind   
MH_MartForms_176pg.pdf.out.003
MH_MartForms_176pg.pdf.out.004

We don't have enough information on your system design to answer the question.  That's not a standard folder name (as per the Installation Guide) so we don't know what's being stored in there.

-JD.

Just guessing, but there's probably more than one record pointing to the same document.  I've seen this at banks where more than one customer is listed on a mortgage -- two records in the database table will point to the same document for a mortgage statement.  You should try using the options -agcNv to export them with the Generic Index File, then look for two records with the same offset & length.

I am using a current CMOD Linux v.10.5 server.  I use the OnDemand Client to query the list of documents that I want to retrieve. I then create a Public Saved Named Query "DE2024"  It shows me 220 documents in the hit list in the Client.

I then run the ARSDOC GET API to extract the 220 PDF files from to a directory on the server.  The API messages show 220 documents retrieved.  The System Log shows 220 message 66 and 67 messages. BUT, I only get 219 PDF files in the directory. 

Why would I get fewer files in the directory?  How do I debug the missing file? 

I try running the same command for named queries for larger sets of files and find that again I am missing files from what I see in the System Log. 

Here is my command:
arsdoc get -v -h PROD -f "MERCH" -G "MERCH" -d /backup -o "(RUNDATE)(INVOICE)(LOC)(CONTAINER)(MANIFESTID)(NAME)" -q "DE2024"

Hi,

The CMOD instance is back up every night using the db2 backup command (offline). Is it safe to remove the content of the arsdbarc folder after the backup is taken? 

Thanks for your help,

     As part of regular maintenance, I am planning an upgrade to the latest fixpacks for an RHEL 8 system with CMOD 10.5.0.6 and DB2 11.5.8.   IBM DB2 support confirmed DB2 11.5.9 released November, 2023 was the last DB2 11.5 patch and suggested I go to DB2 12.1.   IBM CMOD support said they support DB2 12.x, but CMOD hasn't been certified with DB2 12.x which means IBM Passport Advantage doesn't give me the option to download DB2 12.1 with my CMOD license.  IBM CMOD support confirmed CMOD 10.5.0.9 will be released in April, 2025 and IBM Passport Advantage support passed this along: "In discussion with the CMOD Chief Architect yesterday, the plan is for CMOD 10.5.0.9 to officially support Db2 12 by the end of 1Q-2025.".    In April, it looks like we should have access to download CMOD 10.5.0.9 and DB2 12.x from IBM Passport Advantage.

Thanks Ed!

I inquired informally and got the following answer:

>>> There is no specific doc for this but that load balancer should have session affinity.

Ed

Note:   the salesinvoice.ind and salesinvoice.out files are to be copied to a temporary directory to prevent inadvertent deletion.

Then the .ind will need to be updated to point to the location of the .out file.

Ed