Re: New ftpsync version 20160306

On Tue, Mar 08, 2016 at 11:33:46AM +0100, Peter Palfrader wrote:
> On Sun, 06 Mar 2016, Joerg Jaspert wrote:
> 
> > - trace files changed format and include more data
> 
> The additional data in trace files now includes
>  - the start and end date of the mirror run in proper RFC822 format,
>  - the "archive version", as taken from the trace/master file,
>  - information about the individual syncing stages (time, traffic), and
>  - whether SSL was used to connect to the upstream rsync service.
> 
> e.g.  https://syncproxy2.eu.debian.org/debian/project/trace/syncproxy2.eu.debian.org
> 
> > - ftpsync tries to store the hierarchy using new _<foo> files
> 
> Here, we have two new (sets of) files in the trace directory.
> 
> The first, _traces, is just an ls of the trace files, sorted by mtime.
> So, if all the mirrors in your chain have the correct system time (not
> always the case) and if they only create a single tracefile after their
> sync, then that should result in the complete path from the master to
> this mirror being correctly reflected in the _traces file.  See, for
> instance, https://syncproxy.au.debian.org/debian/project/trace/_traces
> or http://debian.sil.at/debian/project/trace/_traces .
> 
> The other set is _hierarchy*, which attempts to collect the same
> information even in the presence of clock skew.  However, it requires
> that all mirrors in the path have syncscripts that support collecting
> this information.  The way it works in conforming mirror scripts is that
> _hierarchy is local only, not overwritten or touched by rsync in any
> way.  A mirror run however copies _hierarchy.mirror from the upstream
> server.  After the mirror run, information is appended to
> _hierarchy.mirror and that makes the content of the new local _hierarchy
> and _hierarchy.mirror files.
> 

So both files look like this for me:
syncproxy2.eu.debian.org syncproxy2.eu.debian.org klecker.debian.org ftp-master.debian.org
mirror.as35701.net mirror.as35701.net mirror.as35701.net ftp.nl.debian.org

While _trace shows:
ftp-master.debian.org
syncproxy2.eu.debian.org
ftp.nl.debian.org
mirror.as35701.net

(Which should be correct.)



Kurt