Re: Problems with a large amount of files.

On Tue, Aug 15, 2006 at 11:20:05AM +0200, Jesus Climent wrote:
> Hi.
> 
> In a setup that i got working for replication of a Debian repository offshore,
> I had defined the following actions:

...

> 3rd. sync the repository, using "-u"
> 
> Even if i repeat the process with no time in between the runs, when the list
> of files is long, the syncing starts again, instead of informing that the
> replica is up to date.
> 
> nekta:/sitecopy# grep type gcc3.4-pool | wc -l
> 16901
> 
> However, if the list is short enough (have not tested shorter lists) sytecopy
> spits a "sitecopy: Nothing to do - no changes found."
> 
> Is there a limit in processing the list updated from -f that if it is too long
> resets the list and starts from scratch?
> 
> Otherwise there seems to be a bug in the code..

After i checked with more detail what was happening, I figured out that the
list of files copied is always the same for the same repository. Deeper
digging and some code checks done by Moises, revealed that from a list of 160
directories only were marked as "already done" the 128 first listed, and
changing DIRSTACKSIZE to 256 solved *our* problem.

Moises promised to prepare a patch to have DIRSTACKSIZE dynamicly growing
according to the needs of the stack, being doubled everytime it reaches its
limit (unless someone proposes another more sensible way to do it).

Cheers,
-- 
Jesus Climent                  info:www.pumuki.org dj:triplestereo.com
Unix SysAdm|Linux User #66350|Debian Developer|2.6.17|Helsinki Finland
GPG: 1024D/86946D69 BB64 2339 1CAA 7064 E429  7E18 66FC 1D7F 8694 6D69

If a man cannot choose, he ceases to be a man.
		--Minister (A clockwork orange)
_______________________________________________
sitecopy maillist  -  [email protected]
http://dav.lyra.org/mailman/listinfo/sitecopy