OnDemand Users Group

Support Forums => CMOD for Multiplatforms => Topic started by: Jaydeep Mehta on January 12, 2018, 06:33:42 AM

Title: Maximum input Line Data file and document size CMOD Load
Post by: Jaydeep Mehta on January 12, 2018, 06:33:42 AM
Hello All,

As I know CMOD "A single group (including large objects) cannot be larger than 2 GB. This is the limit of the size of the index group (document) that will be stored on the storage media, not a limit on the size of the input source."

http://www-01.ibm.com/support/docview.wss?uid=swg21170676

But we have Bigger Single document  file of 15 GB and it contain only common Report_Date as a index , So even we can't break based on index value .

So how we can load the this kind of bigger Line file into CMOD system .
Is anyone having any idea.

Please suggest the solution .

our OS:- Linux
CMOD Version : -10.1.0.0

Regards
Jaydeep




Title: Re: Maximum input Line Data file and document size CMOD Load
Post by: azkhan on January 12, 2018, 10:12:49 AM
Hi Jaydeep,

I had used OS/390 indexer in the past to load huge size files(line data feed on mainframe system). But definitely not tried for a file as big as 15gb.

When archiving a big dumb try to lower the limit of index field definitions.

https://www.ibm.com/support/knowledgecenter/SSEPCD_10.1.0/com.ibm.ondemand.ir.doc/dodiz058.htm

Regards,
azkhan


Title: Re: Maximum input Line Data file and document size CMOD Load
Post by: Justin Derrick on January 12, 2018, 02:00:48 PM
You'll also want to tune IBM CMOD object sizes to ensure loads are successful, and improve performance & compression ratios -- here's an article from the wiki:

https://cmod.wiki/index.php?title=ARS0141E

Title: Re: Maximum input Line Data file and document size CMOD Load
Post by: Jaydeep Mehta on January 16, 2018, 06:04:02 AM

HI

Thanks for the suggestion , I have tried all the way mention in the link but we not able to load "Single Logical Document" File in CMOD which size is more then 2 GB.

If any other solution ,it will be helpful.

Thanks

Regards
JD