Re: sitecopy hangs downloading forever

Joe Orton wrote:

>On Mon, Oct 03, 2005 at 07:06:17PM -0500, Timothee Besset wrote:
>  
>
>>I regularly use sitecopy to synchronize down from an https DAV 
>>repository on a remote site to a local machine. I do a fetch followed by 
>>a synchronize. sitecopy tends to get 'stuck' about once a day. With 
>>iptraf I see that there is still constant traffic with the remote host, 
>>but it just never ends. The files are big ( several Gb ), but I've 
>>waited way long enough to verify that it's not transferring any actual 
>>content / growing the files anymore.
>>
>>Anyone ever got this? Any suggestions on what to investigate?
>>    
>>
>
>Can you run strace on the process when it gets "stuck" like that?
>
> $ strace -p `pidof sitecopy`
>
>or otherwise; always invoke sitecopy with debug logging enabled so that 
>there's a log of what was happening when it's stuck.
>
> $ sitecopy --debug=http --logfile=/tmp/debug.log ...
>
>  
>
Actually, I need to update what I said above: the local file keeps 
growing forever, or at least as long as I left it grow. The remote file 
is 1.1Gb, and after leaving it running overnight, my local file was at 
1.8Gb and still growing.

We are removing the bigger files and gonna transfer them some other way. 
I can't really run the tests above as I need the bandwidth to perform an 
actual transfer that will work for sure today. The strace log would be 
really huge, and I don't think the http one would show anything other 
than the endless 'got 8196 bytes in response body'.

This looks very much like an int overflow. I attached gdb to the process 
once it had gone past the actual size, and couldn't get a sensible 
backtrace. Possibly at SSL level if the whole file is transfered with a 
single call into SSL? ( I had 3-4 frames of SSL stuff, everything above 
was garbled ).

TTimo

>Regards,
>
>joe
>_______________________________________________
>sitecopy maillist  -  [email protected]
>http://dav.lyra.org/mailman/listinfo/sitecopy
>  
>

_______________________________________________
sitecopy maillist  -  [email protected]
http://dav.lyra.org/mailman/listinfo/sitecopy