Hi, I've hit a problem with data that's being sent from our mainframe guys.
We're importing some TLE indexed AFP into CMOD (V9.0) and although the arsload runs cleanly, no documents are indexed.
ARS4335I Server Version <9.0.0.3> Operating System <AIX> <7.1> Database <DB2> <10.01.0000>
ARS4302I 05/04/16 13:31:31 -- Indexing started, 1703180 bytes to process
APK415I CC=YES
APK415I CCTYPE=A
APK415I CONVERT=YES
APK415I DCFPAGENAMES=YES
APK415I UNIQUEBNGS=YES
APK415I IMAGEOUT=ASIS
APK415I INDEXOBJ=ALL
APK415I FORMDEF=BRS00001
APK415I FDEFLIB=/download/AFPResources/fdef
APK415I PDEFLIB=/download/AFPResources/pdef
APK415I PSEGLIB=/download/AFPResources
APK415I FONTLIB=/download/AFPResources
APK415I RESTYPE=FDEF,PSEG,FONT,IOCA,BCOCA,GOCA
APK415I inputdd=/download/inbound/PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP
APK415I outputdd=./PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP.out
APK415I indexdd=./PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP.ind
APK415I resobjdd=./PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP.res
APK440I ACIF AT IM43P11 HAS COMPLETED NORMALLY WITH RETURN CODE 0.
ARS4308I 05/04/16 13:31:31 Indexing completed
ARS4312I 05/04/16 13:31:31 -- Loading started, 91517 bytes to process
ARS1142I Resource ./PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP.res will be added as resource >2-1-0<. Compression Type(None) Original Size(1622865) Compressed Size(1622865)
ARS1146I Loaded 0 rows into the database
ARS1175I Document compression type used - None. Bytes Stored = >95< Rows = >0<
ARS4310I 05/04/16 13:31:31 Loading completed
ARS4317I Processing successful for file >/download/inbound/PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP
When I run arsafpd I get this message:
$ /opt/IBM/ondemand/V9.0/bin/arsafpd -s -i /download/inbound/PROD.LPV1EF03.LLSDD.VAN1.AFPOUT.ENGLISH.SP3.L.G8105V00.AFP
ARS7104I Document type: AFP
ARS7106W Warning: No group TLE structured fields were encountered
Here is the AFP structure as generated from DOC1
1071 BDT Begin Document 0008 D3A8A8
1072 BPG Begin Page 0008 D3A8AF
1073 NOP No Operation 003A D3EEEE
1074 BAG Begin Active Environment Group 0008 D3A8C9
1075 MCF2 Map Coded Font2 0134 D3AB8A
1076 PGD Page Descriptor 0017 D3A6AF
1077 CTC Composed-Text Control 0012 D3A79B
1078 PTD1 Presentation Text Desc1 0014 D3A69B
1079 EAG End Active Environment Group 0008 D3A9C9
1080 TLE Tag Logical Element 002A D3A090
1081 TLE Tag Logical Element 0023 D3A090
1082 TLE Tag Logical Element 0052 D3A090
1083 TLE Tag Logical Element 0050 D3A090
1084 TLE Tag Logical Element 0052 D3A090
1085 TLE Tag Logical Element 0050 D3A090
1086 TLE Tag Logical Element 0031 D3A090
1087 TLE Tag Logical Element 002F D3A090
1088 TLE Tag Logical Element 0030 D3A090
1089 TLE Tag Logical Element 0029 D3A090
1090 TLE Tag Logical Element 0027 D3A090
1091 TLE Tag Logical Element 0026 D3A090
1092 TLE Tag Logical Element 0087 D3A090
1093 TLE Tag Logical Element 0088 D3A090
1094 TLE Tag Logical Element 0087 D3A090
1095 BCT Begin Composed-Text Block 0008 D3A89B
1096 PTX Presentation Text Data 0081 D3EE9B
1097 ECT End Composed-Text Block 0008 D3A99B
1098 BGR Begin Graphics Object 0008 D3A8BB
1099 BOG Begin Object Environment Group 0008 D3A8C7
1100 OBD Object Area Descriptor 001C D3A66B
1101 OBP Object Area Position 0020 D3AC6B
1102 MGO Map Graphics Object 000D D3ABBB
1103 GDD Graphics Data Descriptor 0025 D3A6BB
1104 EOG End Object Environment Group 0008 D3A9C7
1105 GAD Graphics Data 01E8 D3EEBB
1106 EGR End Graphics Object 0008 D3A9BB
1107 BCT Begin Composed-Text Block 0008 D3A89B
1108 PTX Presentation Text Data 09AA D3EE9B
1109 ECT End Composed-Text Block 0008 D3A99B
1110 EPG End Page 0008 D3A9AF
1111 BPG Begin Page 0008 D3A8AF
IBM�s example looks like this:
1 BDT Begin Document 0070 D3A8A8
2 BNG Begin Named Page Group 00000001 002A D3A8AD
3 TLE Tag Logical Element 0026 D3A090
4 TLE Tag Logical Element 002B D3A090
5 TLE Tag Logical Element 0029 D3A090
6 TLE Tag Logical Element 0039 D3A090
7 TLE Tag Logical Element 002C D3A090
8 TLE Tag Logical Element 002C D3A090
9 TLE Tag Logical Element 0043 D3A090
10 BPG Begin Page 00000001 0029 D3A8AF
11 BAG Begin Active Environment Group 0008 D3A8C9
12 MCF2 Map Coded Font2 0033 D3AB8A
13 NOP No Operation 0008 D3EEEE
14 PGD Page Descriptor 0016 D3A6AF
15 PTD2 Presentation Text Desc2 0016 D3B19B
16 EAG End Active Environment Group 0008 D3A9C9
17 BCT Begin Composed-Text Block 0008 D3A89B
18 PTX Presentation Text Data 12F7 D3EE9B
19 ECT End Composed-Text Block 0008 D3A99B
20 EPG End Page 0010 D3A9AF
21 ENG End Named Group 0010 D3A9AD
There are different tags as well as being structured differently. Is it simply a matter of asking them to define a TLE index as group, or are there more fundamental problems with the AFP stream?
Thanks, I haven't worked with TLE data before.
Hello,
Your problem is that the TLEs are not in a group page:
071 BDT Begin Document 0008 D3A8A8
1072 BPG Begin Page 0008 D3A8AF
...
1080 TLE Tag Logical Element 002A D3A090
1081 TLE Tag Logical Element 0023 D3A090
...
As you can see in the IBM documentation the TLEs are in these group pages (in
red)
Quote
1 BDT Begin Document 0070 D3A8A8
2 BNG Begin Named Page Group 00000001 002A D3A8AD
3 TLE Tag Logical Element 0026 D3A090
...
10 BPG Begin Page 00000001 0029 D3A8AF
11 BAG Begin Active Environment Group 0008 D3A8C9
...
21 ENG End Named Group 0010 D3A9AD
[/code]
If this is not like that, then CMOD will never be able to find the TLEs.
Each group of documents in your AFP should look like the IBM sample:
1 BDT Begin Document 0070 D3A8A8
2 BNG Begin Named Page Group 00000001 002A D3A8AD
3 TLE Tag Logical Element 0026 D3A090
...
10 BPG Begin Page 00000001 0029 D3A8AF
...
20 EPG End Page 0010 D3A9AF
21 BPG Begin Page 00000002 0029 D3A8AF
...
40 EPG End Page 0010 D3A9AF
41 ENG End Named Group 0010 D3A9AD
42 BNG Begin Named Page Group 00000001 002A D3A8AD
43 TLE Tag Logical Element 0026 D3A090
...
50 BPG Begin Page 00000003 0029 D3A8AF
...
80 EPG End Page 0010 D3A9AF
81 BPG Begin Page 00000004 0029 D3A8AF
...
170 EPG End Page 0010 D3A9AF
171 ENG End Named Group 0010 D3A9AD
...
1920 EDT End Document