Too many resources?

Justin Derrick · September 25, 2016, 09:45:34 AM

Hey everyone.

I've run into a really strange issue for only the second time in the 20 years I've been using CMOD. A customer has almost half a million AFP resources associated with a SINGLE Application Group!

I'm wondering how common the problem is, and considering releasing a utility to help resolve the issue, but I'd like to know how common this issue really is.

If you have the time or inclination, I'm wondering if you could run the following SQL query and post the results:

Code Select


db2 => connect to archive

   Database Connection Information

 Database server        = DB2/AIX64 10.1.4
 SQL authorization ID   = ARCHIVE
 Local database alias   = ARCHIVE

db2 => select agid,count(*) as resources from arsres group by agid

AGID        RESOURCES  
----------- -----------
       5114           5
       5134        1212
       5136           9
       5138           1
       5140           9
       5142        3482
       5144         917
       5148      457677
       5154           4
       5164           1
       5182           3
       5188          52

So the SQL I'd like you to run on your own system and report back is:

Code Select

select agid,count(*) as resources from arsres group by agid

Essentially, the problem is that there are a couple hundred different types of forms, but CMOD only does 50 resource comparisons at a time. So if 50 files are loaded, all with unique resources, then CMOD starts storing duplicates. So, instead of 200 resources, we end up with almost 2500x more resources than what we actually need!

If this turns out to be a widely-experienced problem, I'll publish some code that tries to fix it.

-JD.

Michel de Kraker · October 10, 2016, 12:07:43 PM

Hi JD,

Here is my output.

AGID RESOURCES
----------- -----------
586 7
630 1
682 1
685 266
692 43
694 3
696 3
698 3
710 3
712 3
714 3
718 3
740 2649
771 12
774 42
794 6
797 1
800 11
810 1
813 1
816 1
820 25
822 3
824 1
826 3
829 1
830 1
835 3
837 3
839 3
841 3
845 3
847 16
850 3
869 2
877 3
897 2
900 3
902 5
908 1
949 208
1009 6
1187 1
1195 35
1201 2
1203 8
1205 8
1208 606
1335 1
1393 3
1395 3
1398 1
1404 3
1406 3
1414 3
1417 23
1418 1
1446 299
1447 1
1455 47
1508 2
2339 4
2340 4
2343 4
2344 4
2347 4
2348 4
2352 4
2359 4
2360 4
2376 3
2386 3
2387 3
2498 3
2518 1
2520 2
2522 2
2546 3
2547 3
2560 3
2564 3
2568 3
2612 16
2614 15
2618 1
2620 50
2624 1
2630 1
2633 3
2643 43
2648 328
2653 3
2658 2454
2661 3
2914 2
3009 1
3076 3
3082 1
3085 1
3114 11
3116 3
3198 1404
3211 6
3213 3
3215 55
3224 70
3228 44
3235 64
3317 315
3319 470
3325 3
3326 3
3470 16
3472 3
3496 3
3497 3
3498 4
3499 3
3513 4
3514 3
3523 3
3524 3
3537 9
3543 1
3568 1
3605 5
3608 3
3611 3
3614 3
3617 2
3620 2
3627 1
3636 2
3637 8
3638 3
3639 3
3647 48
3652 1363
3660 5
3685 1
3741 2
3779 1
3782 5
3784 7
3805 14
3812 13085
3821 375
3827 50
3869 2
3872 3
3936 1
4013 3
4030 1
4037 3
4038 3
4039 3
4041 3
4044 3
4045 3
4058 3
4108 3
4123 4
4124 21
4127 1
4130 2
4135 3
4163 17
4166 1
4178 1
4181 1
4184 3
4241 7
4242 8
4253 3
4286 7
4320 3
4321 3
4336 3
4352 3
4390 2
4442 1
4444 1
4446 1
4448 1
4450 1
4452 1
4464 83
4465 12
4486 4
4501 3
4502 3
4503 3
4504 3
4505 3
4506 3
4562 3
4592 4
4618 2
4711 2
4714 3
4716 3
4718 3
4720 3
4733 10
4736 1
4909 1
4910 1
4911 1
4912 1
4913 1
4914 1
4915 1
4916 1
4917 1
4918 1
4919 1
4920 1
4977 1
4978 1
4979 1
4980 1
4981 1
4982 1
4984 1
4986 1
5054 3
5101 1
5145 3
5146 2
5148 2
5149 1
5150 2
5151 2
5152 2
5153 3
5154 1
5155 2
5156 1
5157 4
5158 2
5159 2
5160 3
5161 1
5163 1
5164 2
5167 1
5187 1
5210 1
5216 3
5247 3
5249 3
5267 2449
5279 3
5288 3
5291 3
5297 2
5299 2
5301 1
5303 3
5305 2
5310 3
5311 3
5312 3
5333 3
5335 1
5344 3
5385 3
5386 3
5387 3
5388 3
5389 3
5390 3
5419 2
5439 6
5442 1
5445 1
5448 1
5450 3
5495 6
5498 3
5503 2
5512 3
5523 1
5524 1
5537 3
5538 3
5558 159
5593 2
5597 2
5606 1
5608 5
5610 20
5611 74
5612 18
5613 32
5672 1
5680 2
5705 2
5707 2
5709 2
5711 2
5713 2
5758 4
5761 1
5763 8
5771 2
5805 45
5806 542
5808 32
5853 1
5858 1
5859 1
5886 2
5891 1
5894 1
5895 1
5896 1
5897 1
5898 1
5899 1
5914 2
5915 2
5916 2
5917 2
5918 2
5926 1
5928 2
5931 5
5932 4
5935 2
5938 6
6051 12
6053 2
6113 5026
6115 1
6117 217
6118 1466
6119 251
6120 261
6180 396
6182 59
6203 1
6205 1
6221 14
6334 2
6336 1
6341 1
6343 1
6344 1
6345 1
6346 1
6353 1
6360 2699
6364 22
6398 5

355 record(s) selected.

Justin Derrick · October 10, 2016, 12:41:31 PM

Thanks Michel!

It doesn't look like you're as badly affected by this issue, although I imagine more than 1000 resources is an issue.

You can bump up the resource comparisons in the Application definition to 9999 to prevent the problem from getting any worse though. :)

-JD.

Too many resources?

Justin Derrick

Michel de Kraker

Justin Derrick