Hi,
My requirement is to split a file into three files based on the totals. Please find the example below
INPUT FILE:
RECORD 1
RECORD 1
RECORD 1
.
.
RECORD 1
TOTAL-1 XXX
RECORD 2
RECORD 2
.
.
RECORD 2
TOTAL-2 XXX
RECORD 3
RECORD 3
.
.
RECORD 3
TOTAL-3 XXX
RECORD 4
RECORD 4
.
.
RECORD 4
TOTAL-4 XXX
OUTPUT FILEs:
FILE1:
RECORD 1
RECORD 1
RECORD 1
.
.
RECORD 1
TOTAL-1 XXX
FILE2:
RECORD 2
RECORD 2
RECORD 2
.
.
RECORD 2
TOTAL-2 XXX
RECORD 3
RECORD 3
.
.
RECORD 3
TOTAL-3 XXX
FILE3:
RECORD 4
RECORD 4
.
.
RECORD 4
TOTAL-4 XXX
Input and output files should have same record length of 133 and same format as FB. I am familier with splitting the files using number of records, But the record count is not constant in this case.
Please help me in solving the above problem.
Thanks in Advance,
Amar
SPLIT file using SORT based on totals
SPLIT file using SORT based on totals
by kkamarnath » Wed Apr 17, 2013 6:20 pm
- kkamarnath
- Posts: 10
- Joined: Wed Apr 17, 2013 6:08 pm
- Has thanked: 0 time
- Been thanked: 0 time
Re: SPLIT file using SORT based on totals
by BillyBoyo » Wed Apr 17, 2013 6:41 pm
Why is RECORD 3 in file 2?
Is there nothing to distinguish the records apart from the TOTAL record?
Can you post the sysout from this step, to determine your DFSORT level?
Is there nothing to distinguish the records apart from the TOTAL record?
Can you post the sysout from this step, to determine your DFSORT level?
//S1 EXEC PGM=SORT
//SYSOUT DD SYSOUT=*
//SORTIN DD *
JUST SOME ARBITRARY TEXT
/*
//SORTOUT DD DUMMY
//SYSIN DD *
OPTION COPY
/*
//SYSOUT DD SYSOUT=*
//SORTIN DD *
JUST SOME ARBITRARY TEXT
/*
//SORTOUT DD DUMMY
//SYSIN DD *
OPTION COPY
/*
- BillyBoyo
- Global moderator
- Posts: 3804
- Joined: Tue Jan 25, 2011 12:02 am
- Has thanked: 22 times
- Been thanked: 265 times
Re: SPLIT file using SORT based on totals
by kkamarnath » Wed Apr 17, 2013 7:02 pm
Hi BillyBoyo,
Only totals are available to distinguish. and I need RECORD2 and RECORD3 in file2 only. That is the requirement for me.
From the code, I understood that you are trying to copy the "RECORD" from input to output. Since SORTOUT is dummy we cannot verify the output anywhere.
Let me know if you still need anything from me.
Thanks,
Amar
Only totals are available to distinguish. and I need RECORD2 and RECORD3 in file2 only. That is the requirement for me.
From the code, I understood that you are trying to copy the "RECORD" from input to output. Since SORTOUT is dummy we cannot verify the output anywhere.
Let me know if you still need anything from me.
Thanks,
Amar
- kkamarnath
- Posts: 10
- Joined: Wed Apr 17, 2013 6:08 pm
- Has thanked: 0 time
- Been thanked: 0 time
Re: SPLIT file using SORT based on totals
by enrico-sorichetti » Wed Apr 17, 2013 7:14 pm
Let me know if you still need anything from me.
that You run the job as is and post the result.
what we want to know is the <level> of You sort product so that
we will able to suggest a solution compatible with Your <sort> features
and running that snippet is the simplest way to find out
cheers
enrico
When I tell somebody to RTFM or STFW I usually have the page open in another tab/window of my browser,
so that I am sure that the information requested can be reached with a very small effort
enrico
When I tell somebody to RTFM or STFW I usually have the page open in another tab/window of my browser,
so that I am sure that the information requested can be reached with a very small effort
- enrico-sorichetti
- Global moderator
- Posts: 3006
- Joined: Fri Apr 18, 2008 11:25 pm
- Has thanked: 0 time
- Been thanked: 165 times
Re: SPLIT file using SORT based on totals
by BillyBoyo » Wed Apr 17, 2013 7:29 pm
I see the confusion. The code I copied had the text RECORD, which unfortunately clashes with your data.
Just run it, as enrico has suggested, and post the full sysout here.
Just run it, as enrico has suggested, and post the full sysout here.
- BillyBoyo
- Global moderator
- Posts: 3804
- Joined: Tue Jan 25, 2011 12:02 am
- Has thanked: 22 times
- Been thanked: 265 times
Re: SPLIT file using SORT based on totals
by kkamarnath » Wed Apr 17, 2013 7:49 pm
1ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE751I 0 C5-K76982 C6-K90026 C7-K82419 C8-K67572 E9-K60824 C9-BASE E
ICE143I 0 BLOCKSET COPY TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EX
ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 09:23
0 OPTION COPY
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE751I 0 C5-K76982 C6-K90026 C7-K82419 C8-K67572 E9-K60824 C9-BASE E
ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
ICE252I 1 PARMLIB OPTIONS WERE MERGED WITH INSTALLATION MODULE DEFAULTS
ICE088I 0 TESTSORT.S1 . , INPUT LRECL = 80, BLKSIZE = 80, T
ICE093I 0 MAIN STORAGE = (MAX,6291456,6278238)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6200798,6200798)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=N,L
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTRE
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CI
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLON
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTOUT
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTIN
ICE751I 1 EF-BASE F0-K66717 E8-K79990
ICE090I 0 OUTPUT LRECL = 80, BLKSIZE = 80, TYPE = FB
ICE055I 0 INSERT 0, DELETE 0
ICE054I 0 RECORDS - IN: 1, OUT: 1
ICE052I 0 END OF DFSORT
ICE751I 0 C5-K76982 C6-K90026 C7-K82419 C8-K67572 E9-K60824 C9-BASE E
ICE143I 0 BLOCKSET COPY TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EX
ICE000I 1 - CONTROL STATEMENTS FOR 5694-A01, Z/OS DFSORT V1R12 - 09:23
0 OPTION COPY
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE751I 0 C5-K76982 C6-K90026 C7-K82419 C8-K67572 E9-K60824 C9-BASE E
ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT
ICE252I 1 PARMLIB OPTIONS WERE MERGED WITH INSTALLATION MODULE DEFAULTS
ICE088I 0 TESTSORT.S1 . , INPUT LRECL = 80, BLKSIZE = 80, T
ICE093I 0 MAIN STORAGE = (MAX,6291456,6278238)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6200798,6200798)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=N,L
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=FULL ,WRKSEC=Y,OUTSEC=Y,VERIFY
ICE130I 0 OPTIONS: RESALL=4096,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTRE
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CI
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLON
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE236I 0 OPTIONS: DYNAPCT=10 ,MOWRK=Y
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTOUT
ICE084I 0 BSAM ACCESS METHOD USED FOR SORTIN
ICE751I 1 EF-BASE F0-K66717 E8-K79990
ICE090I 0 OUTPUT LRECL = 80, BLKSIZE = 80, TYPE = FB
ICE055I 0 INSERT 0, DELETE 0
ICE054I 0 RECORDS - IN: 1, OUT: 1
ICE052I 0 END OF DFSORT
Code'd
- kkamarnath
- Posts: 10
- Joined: Wed Apr 17, 2013 6:08 pm
- Has thanked: 0 time
- Been thanked: 0 time
Re: SPLIT file using SORT based on totals
by kkamarnath » Wed Apr 17, 2013 7:51 pm
Hi,
Hope above details will help you... Looking forward for your cooperation.
Thanks,
Amar
Hope above details will help you... Looking forward for your cooperation.
Thanks,
Amar
- kkamarnath
- Posts: 10
- Joined: Wed Apr 17, 2013 6:08 pm
- Has thanked: 0 time
- Been thanked: 0 time
Re: SPLIT file using SORT based on totals
by BillyBoyo » Wed Apr 17, 2013 8:36 pm
Thanks, the ICE201I has H, which is good.
You'll need three OUTFILs, each with INCLUDE.
You'll need an "extra" byte on your record, to tell where to include. What is your RECFM and LRECL?
You can use IFTHEN=(WHEN=INIT to set the extra byte to 0, which the first INCLUDE will use.
Have a WHEN=GROUP which identifies the TOTAL record and PUSHes the indicator (1,2, whatever) into a second new field.
WHEN=GROUP on the second field for the indicator which has been PUSHed and not TOTAL, to PUSH the value to the selection marker.
Then the other OUTFILs will INCLUDE on 1 and 2, for the second, and 3 for the third.
You'll need three OUTFILs, each with INCLUDE.
You'll need an "extra" byte on your record, to tell where to include. What is your RECFM and LRECL?
You can use IFTHEN=(WHEN=INIT to set the extra byte to 0, which the first INCLUDE will use.
Have a WHEN=GROUP which identifies the TOTAL record and PUSHes the indicator (1,2, whatever) into a second new field.
WHEN=GROUP on the second field for the indicator which has been PUSHed and not TOTAL, to PUSH the value to the selection marker.
Then the other OUTFILs will INCLUDE on 1 and 2, for the second, and 3 for the third.
- BillyBoyo
- Global moderator
- Posts: 3804
- Joined: Tue Jan 25, 2011 12:02 am
- Has thanked: 22 times
- Been thanked: 265 times
Re: SPLIT file using SORT based on totals
by enrico-sorichetti » Wed Apr 17, 2013 10:20 pm
given the foggy description of the requirement this the most You might get...
modify the the 80/81 according to Your LRECL
modify the the 80/81 according to Your LRECL
//ENRICO1 JOB NOTIFY=&SYSUID,
// MSGLEVEL=(1,1),CLASS=A,MSGCLASS=H
//*
//S1 EXEC PGM=SORT
//SYSPRINT DD SYSOUT=*
//SYSOUT DD SYSOUT=*
//SORTIN DD *
RECORD 1 1
RECORD 1 2
RECORD 1 3
RECORD 1 4
RECORD 1 5
TOTAL-1
RECORD 2 1
RECORD 2 2
RECORD 2 3
RECORD 2 4
RECORD 2 5
TOTAL-2
RECORD 3 1
RECORD 3 2
RECORD 3 3
RECORD 3 4
RECORD 3 5
TOTAL-3
RECORD 4 1
RECORD 4 2
RECORD 4 3
RECORD 4 4
RECORD 4 5
TOTAL-4
RECORD 5 1
RECORD 5 2
RECORD 5 3
RECORD 5 4
RECORD 5 5
TOTAL-5
//OUT1 DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//OUT2 DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//OUT3 DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//OTHR DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//SYSIN DD *
SORT FIELDS=COPY
INREC IFTHEN=(WHEN=GROUP,END=(1,5,CH,EQ,C'TOTAL'),
PUSH=(81:ID=4))
OUTFIL FNAMES=OUT1,
INCLUDE=(81,4,ZD,EQ,1),BUILD=(1,80)
OUTFIL FNAMES=OUT2,
INCLUDE=(81,4,ZD,EQ,2),BUILD=(1,80)
OUTFIL FNAMES=OUT3,
INCLUDE=(81,4,ZD,EQ,3),BUILD=(1,80)
OUTFIL FNAMES=OTHR,
INCLUDE=(81,4,ZD,GT,3),BUILD=(1,80)
//*
// MSGLEVEL=(1,1),CLASS=A,MSGCLASS=H
//*
//S1 EXEC PGM=SORT
//SYSPRINT DD SYSOUT=*
//SYSOUT DD SYSOUT=*
//SORTIN DD *
RECORD 1 1
RECORD 1 2
RECORD 1 3
RECORD 1 4
RECORD 1 5
TOTAL-1
RECORD 2 1
RECORD 2 2
RECORD 2 3
RECORD 2 4
RECORD 2 5
TOTAL-2
RECORD 3 1
RECORD 3 2
RECORD 3 3
RECORD 3 4
RECORD 3 5
TOTAL-3
RECORD 4 1
RECORD 4 2
RECORD 4 3
RECORD 4 4
RECORD 4 5
TOTAL-4
RECORD 5 1
RECORD 5 2
RECORD 5 3
RECORD 5 4
RECORD 5 5
TOTAL-5
//OUT1 DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//OUT2 DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//OUT3 DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//OTHR DD SYSOUT=*,
// DCB=(RECFM=FB,LRECL=80)
//SYSIN DD *
SORT FIELDS=COPY
INREC IFTHEN=(WHEN=GROUP,END=(1,5,CH,EQ,C'TOTAL'),
PUSH=(81:ID=4))
OUTFIL FNAMES=OUT1,
INCLUDE=(81,4,ZD,EQ,1),BUILD=(1,80)
OUTFIL FNAMES=OUT2,
INCLUDE=(81,4,ZD,EQ,2),BUILD=(1,80)
OUTFIL FNAMES=OUT3,
INCLUDE=(81,4,ZD,EQ,3),BUILD=(1,80)
OUTFIL FNAMES=OTHR,
INCLUDE=(81,4,ZD,GT,3),BUILD=(1,80)
//*
cheers
enrico
When I tell somebody to RTFM or STFW I usually have the page open in another tab/window of my browser,
so that I am sure that the information requested can be reached with a very small effort
enrico
When I tell somebody to RTFM or STFW I usually have the page open in another tab/window of my browser,
so that I am sure that the information requested can be reached with a very small effort
- enrico-sorichetti
- Global moderator
- Posts: 3006
- Joined: Fri Apr 18, 2008 11:25 pm
- Has thanked: 0 time
- Been thanked: 165 times
Re: SPLIT file using SORT based on totals
by kkamarnath » Thu Apr 18, 2013 11:57 am
Thank you soo much for the replies.
Enrico
Your code is lot helpful to understand Billy's suggestion.
I believe that, I didn't provide the requirement clearly. Please find the details below.
Input file:
REC-1
REC-1
..
TOTAL-1
REC-2
REC-2
..
TOTAL-2
REC-2
REC-2
..
TOTAL-2
...
REC-3
REC-3
..
TOTAL-3
Here REC-2 and Total-2 occurrences may vary every time the input file is generated. But REC-1 & TOtal-1 AND REC-3 & TOTAL-3 will always occurs 1 time.
Output file:
file1:
REC-1
REC-1
..
TOTAL-1
file2:
REC-2
REC-2
..
TOTAL-2
REC-2
REC-2
..
TOTAL-2
..
file3:
REC-3
REC-3
..
TOTAL-3
Your code will help me if the REC-2 & TOTAL-2 occurrences are constant. But in my requirement they always vary evey time input file is generated.
Please suggest how can I achieve the above requirement.
Let me know if my requirement is still confusing.
Thanks in Advance.
Amar
Enrico
Your code is lot helpful to understand Billy's suggestion.
I believe that, I didn't provide the requirement clearly. Please find the details below.
Input file:
REC-1
REC-1
..
TOTAL-1
REC-2
REC-2
..
TOTAL-2
REC-2
REC-2
..
TOTAL-2
...
REC-3
REC-3
..
TOTAL-3
Here REC-2 and Total-2 occurrences may vary every time the input file is generated. But REC-1 & TOtal-1 AND REC-3 & TOTAL-3 will always occurs 1 time.
Output file:
file1:
REC-1
REC-1
..
TOTAL-1
file2:
REC-2
REC-2
..
TOTAL-2
REC-2
REC-2
..
TOTAL-2
..
file3:
REC-3
REC-3
..
TOTAL-3
Your code will help me if the REC-2 & TOTAL-2 occurrences are constant. But in my requirement they always vary evey time input file is generated.
Please suggest how can I achieve the above requirement.
Let me know if my requirement is still confusing.
Thanks in Advance.
Amar
- kkamarnath
- Posts: 10
- Joined: Wed Apr 17, 2013 6:08 pm
- Has thanked: 0 time
- Been thanked: 0 time
Return to DFSORT/ICETOOL/ICEGENER
-
- Related topics
- Replies
- Views
- Last post
-
- Split a file based on size
by msnirmal1487 » Tue Dec 20, 2011 7:14 pm - 6 Replies
- 4781 Views
- Last post by Frank Yaeger
Tue Dec 20, 2011 11:09 pm
- Split a file based on size
-
- split a single file into 2, based on date field
1, 2by JeffJones » Fri Apr 06, 2012 8:07 pm - 10 Replies
- 7243 Views
- Last post by BillyBoyo
Fri Apr 13, 2012 11:34 pm
- split a single file into 2, based on date field
-
- Split a file using SORT--Help
by jomythomas » Sat Aug 07, 2010 12:16 pm - 1 Replies
- 3710 Views
- Last post by skolusu
Mon Aug 09, 2010 9:10 pm
- Split a file using SORT--Help
-
- Split file, SORT then append records.
1, 2by Esmayeelhusen » Fri Aug 04, 2023 6:37 pm - 10 Replies
- 3181 Views
- Last post by Esmayeelhusen
Wed Aug 09, 2023 7:39 am
- Split file, SORT then append records.
-
- SPLIT input records based on the given delimiter
by gopal_NKP » Fri May 03, 2013 7:45 am - 8 Replies
- 5407 Views
- Last post by BillyBoyo
Tue May 07, 2013 8:03 pm
- SPLIT input records based on the given delimiter