Discuss (FTP) and (SFTP, FTPS and SCP), our Java file transfer clients.

put() hangs

no avatar
User

c0d3phr3ak

Posts

3

Joined

Thu Nov 04, 2004 1:36 pm

put() hangs

by c0d3phr3ak » Thu Nov 04, 2004 1:52 pm

no avatar
User

support2

Posts

3987

Joined

Tue May 18, 2004 8:30 am

Re: put() hangs

by support2 » Thu Nov 04, 2004 5:42 pm

no avatar
User

c0d3phr3ak

Posts

3

Joined

Thu Nov 04, 2004 1:36 pm

by c0d3phr3ak » Fri Nov 05, 2004 12:56 am

no avatar
User

support2

Posts

3987

Joined

Tue May 18, 2004 8:30 am

by support2 » Fri Nov 05, 2004 1:12 am

no avatar
User

stevegpan

Posts

10

Joined

Fri Jun 27, 2008 11:43 pm

by stevegpan » Sat Jun 28, 2008 12:22 am

no avatar
User

cfougere_GE

Posts

2

Joined

Sat Jun 28, 2008 3:09 am

We are having the same issue.

by cfougere_GE » Sat Jun 28, 2008 3:16 am

The file (typically) is being put successfully but the client is crashing trying to run the verify portion after the put.

14:04:40.683 COL D 5192 (java_extensions.cxx:1442): Uploading file: \\electra\pms\download\adv-c\advft-g\remit-us11-adv-advft-062408-1008.rcv
14:04:40.683 COL D 5192 (java_extensions.cxx:1442): DEBUG [SocketUtils] 27 Jun 2008 14:04:40.683 : Could not use Socket.isConnected (java.lang.NoSuchMethodException)
14:04:40.699 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPControlSocket] 27 Jun 2008 14:04:40.699 : ---> PORT 204,165,247,14,16,128
14:04:40.746 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPControlSocket] 27 Jun 2008 14:04:40.746 : 200 PORT command successful.
14:04:40.746 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPControlSocket] 27 Jun 2008 14:04:40.746 : ---> STOR remit-us11-adv-advft-062408-1008.rcv
14:04:40.871 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPControlSocket] 27 Jun 2008 14:04:40.871 : 150 Opening data connection for $1$DGA10:[ECOMREMIT]remit-us11-adv-advft-062408-1008.rcv; (XXX.16X.24X.1X,4224)
14:04:40.871 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPActiveDataSocket] 27 Jun 2008 14:04:40.871 : Calling accept()
14:04:40.871 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPActiveDataSocket] 27 Jun 2008 14:04:40.871 : accept() succeeded
14:04:41.652 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPActiveDataSocket] 27 Jun 2008 14:04:41.652 : closeChild() succeeded
14:04:41.652 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPActiveDataSocket] 27 Jun 2008 14:04:41.652 : close() succeeded
14:04:41.652 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPClient] 27 Jun 2008 14:04:41.652 : Transferred 219926 bytes to remote host
14:04:41.668 COL D 5192 (java_extensions.cxx:1442): DEBUG [SocketUtils] 27 Jun 2008 14:04:41.668 : Could not use Socket.isConnected (java.lang.NoSuchMethodException)
14:14:41.668 COL D 5192 (java_extensions.cxx:1442): DEBUG [FTPClient] 27 Jun 2008 14:14:41.668 : Validate transfer on error after exception : Read timed out
14:14:41.683 COL D 5192 (java_extensions.cxx:1442): java.io.InterruptedIOException: Read timed out [THROWING]: java.io.InterruptedIOException: Read timed out
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.InputStreamReader.fill(Unknown Source)
at java.io.InputStreamReader.read(Unknown Source)
at java.io.BufferedReader.fill(Unknown Source)
at java.io.BufferedReader.readLine(Unknown Source)
at java.io.BufferedReader.readLine(Unknown Source)
at com.enterprisedt.net.ftp.FTPControlSocket.D(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.validateTransfer(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.put(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.put(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.put(Unknown Source)
at com.idx.ec.caft.filetransfer.EDTFTPBase.uploadFile(EDTFTPBase.java:94)
at com.idx.ec.caft.ConnectionManager.uploadFile(ConnectionManager.java:273)
at com.idx.ec.caft.logic.ByAllOut.processState(ByAllOut.java:47)
at com.idx.ec.caft.logic.ByAllBase.processStates(ByAllBase.java:105)
at com.idx.ec.caft.CAFTBase.runCAFT(CAFTBase.java:131)
at crRTECAFT.processMessage(crRTECAFT.java:92)
at com.idx.ec.egate.file.ECBaseCollaboration2.executeBusinessRules(ECBaseCollaboration2.java:255)
at com.stc.jcsre.JCollaboration.translate(JCollaboration.java:148)
at com.stc.common.collabService.JCCollabControllerImpl.translate(JCCollabControllerImpl.java:568)

14:14:41.683 COL D 5192 (java_extensions.cxx:1442): DEBUG [SocketUtils] 27 Jun 2008 14:14:41.683 : Could not use Socket.isConnected (java.lang.NoSuchMethodException)
14:14:41.683 COL D 5192 (java_extensions.cxx:1442): DEBUG [SocketUtils] 27 Jun 2008 14:14:41.683 : Could not use Socket.isConnected (java.lang.NoSuchMethodException)
14:14:42.183 COL D 5192 (java_extensions.cxx:1442): WARN [FTPClient] 27 Jun 2008 14:14:42.183 : Validate transfer on error failed : Read timed out
14:14:42.183 COL D 5192 (java_extensions.cxx:1442): java.io.InterruptedIOException: Read timed out [THROWING]: java.io.InterruptedIOException: Read timed out
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at java.io.InputStreamReader.fill(Unknown Source)
at java.io.InputStreamReader.read(Unknown Source)
at java.io.BufferedReader.fill(Unknown Source)
at java.io.BufferedReader.readLine(Unknown Source)
at java.io.BufferedReader.readLine(Unknown Source)
at com.enterprisedt.net.ftp.FTPControlSocket.D(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.validateTransfer(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.validateTransferOnError(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.put(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.put(Unknown Source)
at com.enterprisedt.net.ftp.FTPClient.put(Unknown Source)
at com.idx.ec.caft.filetransfer.EDTFTPBase.uploadFile(EDTFTPBase.java:94)
at com.idx.ec.caft.ConnectionManager.uploadFile(ConnectionManager.java:273)
at com.idx.ec.caft.logic.ByAllOut.processState(ByAllOut.java:47)
at com.idx.ec.caft.logic.ByAllBase.processStates(ByAllBase.java:105)
at com.idx.ec.caft.CAFTBase.runCAFT(CAFTBase.java:131)
at crRTECAFT.processMessage(crRTECAFT.java:92)
at com.idx.ec.egate.file.ECBaseCollaboration2.executeBusinessRules(ECBaseCollaboration2.java:255)
at com.stc.jcsre.JCollaboration.translate(JCollaboration.java:148)
at com.stc.common.collabService.JCCollabControllerImpl.translate(JCCollabControllerImpl.java:568)

We've wrapped this call with our own file management and catch all exceptions and retry, but certain files just will not finish the put() no matter how many times they retry. We send down thousands of files per day, and have only 2 customers with this issue, and with these customers the issue is intermittent. Some files are successfull going to this directory.

Ideas?

Thanks.
no avatar
User

support2

Posts

3987

Joined

Tue May 18, 2004 8:30 am

Re: We are having the same issue.

by support2 » Sat Jun 28, 2008 2:07 pm

This sounds bizarre. So some files cannot be transferred (even trying repeatedly) while others can??

The files don't look large. The timeout looks like 600 sec which should be fine.

Basically, the server isn't sending a reply to the client saying that the file transferred correctly.

Here's a few questions to try answering:

1) Is it only files of a certain name? Does renaming the files help?
2) Are there are clues in the server logs?
3) Are there any quota or disk space issues on the server?
4) Have you tried using passive mode transfers?
5) Do other FTP clients have any trouble transferring the same files?

Also, does your retry mechanism use resume, i.e. only transfers the portion of the file that remains to be transferred?
no avatar
User

cfougere_GE

Posts

2

Joined

Sat Jun 28, 2008 3:09 am

by cfougere_GE » Mon Jun 30, 2008 10:39 pm

Here's a few questions to try answering:

1) Is it only files of a certain name? Does renaming the files help? Does not help
2) Are there are clues in the server logs? I will need to follow up with our customer to see what their FTP Server is saying
3) Are there any quota or disk space issues on the server? No
4) Have you tried using passive mode transfers? Does not help
5) Do other FTP clients have any trouble transferring the same files? Have used win2k client with success

Also, does your retry mechanism use resume, i.e. only transfers the portion of the file that remains to be transferred? retries the entire file
no avatar
User

stevegpan

Posts

10

Joined

Fri Jun 27, 2008 11:43 pm

Re: We are having the same issue.

by stevegpan » Tue Jul 01, 2008 3:15 am

no avatar
User

stevegpan

Posts

10

Joined

Fri Jun 27, 2008 11:43 pm

by stevegpan » Tue Jul 01, 2008 7:40 am

no avatar
User

support2

Posts

3987

Joined

Tue May 18, 2004 8:30 am

by support2 » Tue Jul 01, 2008 1:31 pm

no avatar
User

stevegpan

Posts

10

Joined

Fri Jun 27, 2008 11:43 pm

by stevegpan » Tue Jul 01, 2008 11:57 pm

no avatar
User

support2

Posts

3987

Joined

Tue May 18, 2004 8:30 am

by support2 » Wed Jul 02, 2008 7:14 am

no avatar
User

stevegpan

Posts

10

Joined

Fri Jun 27, 2008 11:43 pm

by stevegpan » Thu Jul 03, 2008 4:18 am

no avatar
User

EDT Support

Posts

905

Joined

Mon Apr 26, 2004 3:03 pm

by EDT Support » Fri Jul 04, 2008 12:55 pm

Next

Who is online

Users browsing this forum: No registered users and 15 guests

Powered by phpBB ® | phpBB3 Style by KomiDesign
cron