Dropped records when FTP from mainframe to server



Post anything related to mainframes (IBM & UNISYS) if not fit in any of the above categories

Dropped records when FTP from mainframe to server

Postby MLK2348 » Tue Mar 19, 2024 9:19 pm

Every month, we FTP over 200 files from the mainframe to a Windows server and it can take from 8-12 hours. Many of the files are very large and have to be split for the FTP. We are able to compare record counts (expected and received) and a few of the files have incorrect record counts and must be re-FTP'd. It's usually less than 50 records per file and happens to a random 2-10 files.

We tried limiting the number of FTP stream from 5 to 3 but that had no effect.

Where would be the first places to research to identify the cause? Reftp is a time consuming process because of the numerous large files.

MK
MLK2348
 
Posts: 7
Joined: Tue Oct 24, 2023 1:06 am
Has thanked: 0 time
Been thanked: 0 time

Re: Dropped records when FTP from mainframe to server

Postby MrSpock » Tue Apr 02, 2024 4:05 am

Is using PKZIP/GZIP or something similar to greatly reduce the filesizes not an option?
User avatar
MrSpock
Global moderator
 
Posts: 809
Joined: Wed Jun 06, 2007 9:37 pm
Location: Raleigh NC USA
Has thanked: 0 time
Been thanked: 4 times

Re: Dropped records when FTP from mainframe to server

Postby sergeyken » Tue Apr 02, 2024 9:32 pm

Is it possible to verify the result of FTP for each particular file?
Either on the fly, just after every FTP command, or after the fact - by the FTP log analyzis?

It should show the files in error, to repeat this FTP, either manually, or automatically.
Even for thousands of FTP...
Javas and Pythons come and go, but JCL and SORT stay forever.
User avatar
sergeyken
 
Posts: 436
Joined: Wed Jul 24, 2019 10:12 pm
Has thanked: 7 times
Been thanked: 40 times


Return to All other Mainframe Topics

 


  • Related topics
    Replies
    Views
    Last post