IBM Mainframe Forum

I am sorting a large file of about 2 million records using DFSORT . The problem I am having is as follows:


1. For an internal COBOL sort we assign 12 large external SORTWK areas and it still runs out of space.
2. The same sort done externally, takes up one small SORTWK file.

How can we explain this difference. Are there any parameters to specify for the internal sort to fix this problem?

Here is a section of the JCL

Internal DFSORT abends B37
---------------------------------
12 sortwk01 areas of identical size

//SORTWK01 DD DSN=DBP2.TEMP1,UNIT=3390,SPACE=(CYL,(1500,100),RLSE),
//DISP=(,PASS),VOL=SER=PRDB03,STORCLAS=GSPACE
.....
//SORTWK12 DD .....


here are the LOG messages:

IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK06,1A7C,PRDB10,0427041D,DBP2.TEMP6
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK02,1A76,PRDB04,0427041D,DBP2.TEMP2
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK11,1A81,PRDB15,0427041D,DBP2.TEMP11
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK04,1A78,PRDB06,0427041D,DBP2.TEMP4
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK05,1A7B,PRDB09,0427041D,DBP2.TEMP5
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK08,1A7E,PRDB12,0427041D,DBP2.TEMP8
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK03,1A77,PRDB05,0427041D,DBP2.TEMP3
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK01,1A75,PRDB03,0427041D,DBP2.TEMP1
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK07,1A7D,PRDB11,DBP2.TEMP7
IEC030I B37-04,IFG0554A,DDJDFSOR,SFAF105P,SORTWK09,1A7F,PRDB13,DBP2.TEMP9


SORT Messages

ICE046A 6 SORT CAPACITY EXCEEDED - RECORD COUNT 1850354
ICE751I 1 D8-K24705 D4-K24705 EA-K24705 E1-K24705 DF-K24705 E8-K90013
ICE052I 0 END OF DFSORT

1ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R5 - 08:09 ON MON FEB 23, 2009 -
0 SORT FIELDS=(0083,0002,CH,A,0011,0042,CH,A)
RECORD TYPE=V,LENGTH=(007006,,,000005,)
ICE201I F RECORD TYPE IS V - DATA STARTS IN POSITION 5
ICE118I 0 UNKNOWN FILE SIZE - FILSZ=EN MAY IMPROVE RESOURCE USAGE AND PERFORMANCE
ICE751I 0 C5-K90013 C6-K90013 C7-K90000 C8-K90013 E4-K90007 C9-BASE E5-K24705 E7-K24705
ICE193I 0 ICEAM2 ENVIRONMENT IN EFFECT - ICEAM2 INSTALLATION MODULE SELECTED
ICE089I 0 DDJDFSOR.SFAF105P. , INPUT LRECL = 7006, TYPE = V
ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6039074,6039074)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=NONE,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=N ,ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,STIMER=Y,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE750I 0 DC 0 TC 0 CS DSVXX KSZ 48 VSZ 48
ICE752I 0 FSZ=0 RE IGN=0 C AVG=3503 0 WSP=0 E DYN=0 0


EXTERNAL SORT works fine
--------------------------------

1 Sortwk file

/SORTWK01 DD DSN=DBP2.TEMP1,UNIT=3390,SPACE=(CYL,(2500,100),RLSE),
// DISP=(,PASS),VOL=SER=PRDB15,STORCLAS=GSPACE

SORT messages

1ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R5 - 08:01 ON MON FEB 23, 2009 -
0 SORT FIELDS=(0083,0002,CH,A,0011,0042,CH,A)
RECORD TYPE=V,LENGTH=(007006,,,000005,)
ICE201I F RECORD TYPE IS V - DATA STARTS IN POSITION 5
ICE751I 0 C5-K90013 C6-K90013 C7-K90000 C8-K90013 E4-K90007 C9-BASE E5-K24705 E7-K24705
ICE074I 0 RECORD LENGTH L1 OR L3 OVERRIDDEN
ICE193I 0 ICEAM1 ENVIRONMENT IN EFFECT - ICEAM1 INSTALLATION MODULE SELECTED
ICE088I 0 DDJSYEDX.STEP1 . , INPUT LRECL = 7004, BLKSIZE = 32760, TYPE = VB
ICE093I 0 MAIN STORAGE = (MAX,6994648,6985526)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6887096,6887096)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6994648,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=NONE,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=N ,ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,STIMER=Y,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=64
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTOUT
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTIN
ICE750I 0 DC 337275202 TC 0 CS DSVHH KSZ 48 VSZ 48
ICE752I 0 FSZ=337275202 BC IGN=0 E AVG=3502 0 WSP=438062 C DYN=0 0
ICE751I 1 D8-K24705 D4-K24705 EA-K24705 F1-K24705 E8-K90013
ICE090I 0 OUTPUT LRECL = 7004, BLKSIZE = 32760, TYPE = VB
ICE055I 0 INSERT 0, DELETE 0
ICE054I 0 RECORDS - IN: 1850357, OUT: 1850357
ICE134I 0 NUMBER OF BYTES SORTED: 337172958
ICE098I 0 AVERAGE RECORD LENGTH = 182 BYTES
ICE191I 0 DFSORT SVC NOT AVAILABLE - PERFORMANCE MAY BE DEGRADED
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 37500 , TRACKS USED: 0
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 335980K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT

For the COBOL run, COBOL is passing the records to DFSORT through an internal E15 exit, so DFSORT does NOT know the number of records to be sorted as indicated by this message:

ICE118I 0 UNKNOWN FILE SIZE - FILSZ=EN MAY IMPROVE RESOURCE USAGE AND PERFORMANCE

You can specify:



where n is a good estimate of the number of records to be sorted.

You can see the details of the ICE118I message at:

http://publibz.boulder.ibm.com/cgi-bin/ ... 0811&CASE=