Re: Merging three slightly different directories

Dan Stromberg via rsync <[email protected]>
Newsgroups gmane.network.rsync.general
Message-ID <CAGGBd_q1nHHnqWCrJtU1BFVgVh4Z+xMuC4Jy=GQDVN4KvVW3cA@mail.gmail.com>
I suspect you want a duplicate finder more than a file transfer tool.

EG: https://stromberg.dnsalias.org/~strombrg/equivalence-classes.html


On Tue, Jun 7, 2022 at 5:36 PM hput via rsync <[email protected]> wrote:

> I want to merge 3 slightly different directories of mostly images.
>
> Not just mostly but the vast majority are images files.
>
> Each directory has about 285 GB of files.
>
> At first I thought I would just run a straightish rsync from each directory
> inturn starting with the biggest which is not much bigger ... maybe
> a few MB.
>
> Like:
>
> rsync -vvrptgoD --stats /biggest/ /emptydir/
>
> rsync -vvrptgoD --stats /next-biggest/ /same-dir/
>
> rsync -vvrptgoD --stats /smallest/     /same-dir
>
> But after some thought I'm guessing that might be wrong headed way to go.
>
> All three dir have mostly the same stuff in them and in the same
> places but a close inspection, given the 285 GB would be pretty much a
> non-starter.
>
> There will be thousands that have matching names maybe newer or older
> bigger etc.  And maybe some of the same stuff but in slightly  different
> places.
>
> How can I make rsync do the work for me?  So I don't end up loosing files.
>
>
>
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.