Hello Justin,

Thanks for your help.  The arsdbarc folder is stored under the ARS_DB2_ARCHIVE_LOGPATH registry key in Windows. This folder contains hundreds of LOG files which seems to be related to Archived Transaction logs of the db.

I'd like to know if I can delete this folder files.

Olivier BALTUS

Upon closer examination we found that there were files in OnDemand that had the exact same set of indexing information.  It appears that the business application sent the same file more that once.  So when using the ONDDOC Get API it probably created the first PDF file then overlayed it with the second file that had the exact same filename.  Hence the file count mismatch compared to the number of indexing records.  In this case, this is an acceptable (and even desirable) outcome because it effectively eliminated the duplicate files for us.

We are closing the support case with IBM as it was 'User error'. 

Thanks Justin for prompting the reexamination of the data.

Justin,

You bring up a good point that if the filename created by the concatenation of the index values is not unique then the output files can potentially overwrite each other making the total number of output files less than the number of retrievals (message 66 or 67).

However, in this case the value of the MANIFESTID for each document should be unique (forcing the creation of a unique filename). I verified this by using the same Named Query in the OnDemand Client, sorting the list by MANIFESTID, and analyzing a list of hits for duplicates and finding them to all be unique.

I have opened a support ticket with IBM and provided them with their requested information and am waiting for a response.  I will post again if this is resolved.

The PDF indexer is multi-threaded. Each thread produces an output file.  The load process combines them into the objects that are actually archived.  If the load is successful all of those intermediate files should be deleted.  Is it possible that you have files that are failing and leaving these intermediate files on the system?
As an example, a small PDF file (184k), when running index only, produced these files:
MH_MartForms_176pg.pdf.ind   
MH_MartForms_176pg.pdf.out.003
MH_MartForms_176pg.pdf.out.004

We don't have enough information on your system design to answer the question.  That's not a standard folder name (as per the Installation Guide) so we don't know what's being stored in there.

-JD.

Just guessing, but there's probably more than one record pointing to the same document.  I've seen this at banks where more than one customer is listed on a mortgage -- two records in the database table will point to the same document for a mortgage statement.  You should try using the options -agcNv to export them with the Generic Index File, then look for two records with the same offset & length.

I am using a current CMOD Linux v.10.5 server.  I use the OnDemand Client to query the list of documents that I want to retrieve. I then create a Public Saved Named Query "DE2024"  It shows me 220 documents in the hit list in the Client.

I then run the ARSDOC GET API to extract the 220 PDF files from to a directory on the server.  The API messages show 220 documents retrieved.  The System Log shows 220 message 66 and 67 messages. BUT, I only get 219 PDF files in the directory. 

Why would I get fewer files in the directory?  How do I debug the missing file? 

I try running the same command for named queries for larger sets of files and find that again I am missing files from what I see in the System Log. 

Here is my command:
arsdoc get -v -h PROD -f "MERCH" -G "MERCH" -d /backup -o "(RUNDATE)(INVOICE)(LOC)(CONTAINER)(MANIFESTID)(NAME)" -q "DE2024"

Hi,

The CMOD instance is back up every night using the db2 backup command (offline). Is it safe to remove the content of the arsdbarc folder after the backup is taken? 

Thanks for your help,

     As part of regular maintenance, I am planning an upgrade to the latest fixpacks for an RHEL 8 system with CMOD 10.5.0.6 and DB2 11.5.8.   IBM DB2 support confirmed DB2 11.5.9 released November, 2023 was the last DB2 11.5 patch and suggested I go to DB2 12.1.   IBM CMOD support said they support DB2 12.x, but CMOD hasn't been certified with DB2 12.x which means IBM Passport Advantage doesn't give me the option to download DB2 12.1 with my CMOD license.  IBM CMOD support confirmed CMOD 10.5.0.9 will be released in April, 2025 and IBM Passport Advantage support passed this along: "In discussion with the CMOD Chief Architect yesterday, the plan is for CMOD 10.5.0.9 to officially support Db2 12 by the end of 1Q-2025.".    In April, it looks like we should have access to download CMOD 10.5.0.9 and DB2 12.x from IBM Passport Advantage.

Thanks Ed!