Problem with FTP copies

Jan 21, 2011
20
0
Take Command v25.00.20 x64

I have a file that's ~123MB on an FTP server.

If I try to copy it to my local PC using TCC, then it stops the transfer nearly at the end.

1570613219845.png


The transferred size is 0x740e000, which looks like a suspiciously round hex number
 
Jan 21, 2011
20
0
BTW, if I use wget to copy the file, that gets the full file, so it's not an FTP server problem

1570614209945.png
 
Jan 21, 2011
20
0
Does the copy work if you use IFTP (perhaps with the /P1 option)?

Nope. Still doesn't work

1570629221789.png


That does seem to stop at a random point. I tried it again, and then the downloaded file was 121,397,248 bytes, and again, and it was 121,896,960 bytes. (Wget or other FTP client software consistently downloads everything).

Note that 'testserver' is on my local LAN with no firewall between it and my PC (I'm using it for unit testing our own software), so /P1 shouldn't be necessary.
 

Attachments

  • 1570629198465.png
    1570629198465.png
    101.1 KB · Views: 89
Jan 21, 2011
20
0
Without access to your ftp server there's not much I can do to debug this. Try IFTP / V and see is that shows anything useful. And maybe/R if it's timing out.

It's just a standard VSFTPD FTP server running on Ubuntu.

Using IFTP /V shows it seeing the correct size of the file and no errors - but the resulting file is still too small

See screenshot below
1570636227915.png


Oddly, I've just set up a test FTP server at Digital Ocean using an *identical* setup to our internal test server (same Linux version, same vsftpd version, same config, etc). That one seems to work fine. The only significant difference I could think of was that our internal test server is on our internal gigabit network, whereas the connection to Digital Ocean is obviously slower.

So,I tried setting bandwidth throttling on the VM where the local test server is running to 5Mbps - hey presto it worked fine (but obviously a lot slower), downloading the whole file, and the SHA1 checksum matches, so the download is correct.

So, it looks like it may be a timing issue somewhere.
 
May 20, 2008
11,378
98
Syracuse, NY, USA
It's OK here on a gigabit lan. You can try downloading this file if it will help any.

Code:
v:\> timer copy ftp://vefatica.net/120million
Timer 1 on: 12:22:21
ftp://vefatica.net/120million => V:\120million
     1 file copied
Timer 1 off: 12:22:23  Elapsed: 0:00:01.054

v:\> d 12*
2019-10-09  08:19     120,000,000  120million
 
Jan 21, 2011
20
0
It's OK here on a gigabit lan. You can try downloading this file if it will help any.

Odd. Here, I can download at 1Gbps using wget, FTP, Filezilla etc, but if I use TCC, it truncates it randomly unless I put severe bandwidth throttling on, then it works fine.

(FWIW, I've tried changing our unit tests to download the large file use IPWorks ftp::download() and that works fine for us at 1Gbps, so if TCC is using IPWorks for that as well, something odd is going on...)
 
May 20, 2008
11,378
98
Syracuse, NY, USA
I can reproduce the issue.

Code:
v:\> option //passiveftp=no

v:\> copy ftp://vefatica.net/120million
ftp://vefatica.net/120million => V:\120million
     1 file copied

v:\> d 12*
2019-10-09  08:19     119,987,983  120million
 
May 20, 2008
11,378
98
Syracuse, NY, USA
PassiceFtp=No wasn't necessary. It happens sometimes anyway.
Code:
v:\> option PassiveFtp
PassiveFtp=Yes

v:\> do i=1 to 10 ( copy /q ftp://vefatica.net/120million & d 12* )
2019-10-09  08:19     120,000,000  120million
2019-10-09  08:19     120,000,000  120million
2019-10-09  08:19     120,000,000  120million
2019-10-09  08:19     119,994,707  120million
2019-10-09  08:19     119,999,769  120million
2019-10-09  08:19     120,000,000  120million
2019-10-09  08:19     120,000,000  120million
2019-10-09  08:19     120,000,000  120million
2019-10-09  08:19     119,991,310  120million
2019-10-09  08:19     120,000,000  120million
 
Similar threads
Thread starter Title Forum Replies Date
K copy ftp: with /w problem Support 4
R ftp problem Support 2
nikbackm FTP problem with COPY /U Support 0
Dick Johnson Weird Color Problem Support 8
fishman@panix.com Problem with 27.15 Support 2
M Problem with VSDevCmd.bat in VS 16.7.3 Support 0
R Problem with @INT[ value] in V26 Support 9
M Selecting test "off by one" problem in Take command Support 4
Alpengreis UTF-8 problem in TCC related to Python Support 7
K_Meinhard Small problem in german IDE 26 Support 3
B Problem with color in nested shells Support 1
Joe Caverly Problem creating and switching to a DESKTOP Support 9
vefatica Another popup problem Support 10
Alpengreis ffind dialog (/W) problem Support 4
Alpengreis [TCMD v25.00.24] Small space problem with the DE translation in Prefs-GUI Support 1
Alpengreis [TCMD v25.00.24] Problem with copy and paste and the # char via mouse in TCC Support 6
A Problem with functions @int @decimal and identifying Powershell as a shell. Support 12
B IF command problem in tcexit.btm Support 9
fishman@panix.com Problem at Startup of TCC Support 3
P Problem with SFTP copies Support 7
Jay Sage Problem with Context Menu Copy+Paste+Run Key Assignment Support 7
R Problem with %_do_loop in nested do loops Support 2
fishman@panix.com New Problem with later Windows 10 Support 10
Peter Murschall A little problem with LEAVE and COMMENT Support 5
M Handling of %~I problem Support 4
WinLanEm FOR problem Support 18
K Problem With SCRPUT /u Support 3
vefatica What's TCMD's problem with ^e[0m? Support 13
Peter Murschall IDE: RTL with non-English resources-problem is back in Build 28 Support 4
rps Regex problem: \xnn not recognized as a hex character Support 0
rps PRIORITY LOW problem Support 1
old coot Regex problem: \xnn not recognized as a hex character Support 12
vefatica Another problem with build 22. Support 3
Alpengreis [23.x] Download-Problem Support 2
S Problem with " Support 3
C Problem navigating forums Support 11
x13 Problem listing repository files using DIR http(s)://... Support 8
Joe Caverly Problem with TEE in v22 Support 2
Alpengreis Problem with thousands delimiter and colors Support 17
M Take Command 18, migrating to another machine, license problem. Support 1
B TCC 21.01.50 Problem with ALIAS /r and SET /r Support 2
rps How to? @search problem Support 2
WinLanEm @SELECT problem Support 6
T Fixed Problem with use of Batch parameters in the IDE Support 1
Oz Solomon Problem with "list" Support 14
S V21.24 theme problem Support 2
Alpengreis Problem if command prompt is not legacy Support 4
Alpengreis TCMD.INI: The "super hidden" problem ... Support 6
G Odd problem - screen brightness Support 4
rps V20 In-process pipes problem Support 8

Similar threads