Re: Copying a large file from an USB 3 disk (NTFS or EXT4) to another one (UFS/FreeBSD) is a very slow process....
Mario Marietto via rsync <[email protected]>
| Newsgroups | gmane.network.rsync.general |
|---|---|
| Message-ID | <CA+1FSigywa+R3DZywZRXcsRwzp0zpJ-cGPkh8+A8O_o8v9Mypw@mail.gmail.com> |
oh no. I'm on FreeBSD. Il giorno dom 28 nov 2021 alle ore 21:54 Kevin Korb <[email protected]> ha scritto: > I was assuming gnu cp not bsd. > > On 11/28/21 15:53, Mario Marietto wrote: > > root@marietto:/mnt/da3p2/bhyve/Ubuntu # cp -au > > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . > > cp: illegal option -- u > > > > > > > > Il giorno dom 28 nov 2021 alle ore 21:40 Kevin Korb <[email protected] > > <mailto:[email protected]>> ha scritto: > > > > rsync will not resume a transfer on a local copy. It forces > > --whole-file. > > > > On 11/28/21 15:32, Mario Marietto wrote: > > > ok. I know how to resume a transfer with rsync,but I don't know > > how to > > > do that using cp. Which parameter should I use? 10x. On the next > > file I > > > will use cp and I'm curious to compare both the speeds. > > > > > > Il giorno dom 28 nov 2021 alle ore 21:25 Kevin Korb > > <[email protected] <mailto:[email protected]> > > > <mailto:[email protected] <mailto:[email protected]>>> ha > scritto: > > > > > > rsync will delete the file it is making if you abort it. > > Even if you > > > had told it to not do that cp and rsync would both just start > > over > > > anyway. > > > > > > On 11/28/21 15:22, Mario Marietto wrote: > > > > Hello. What happens now if I stop the transfer ? I imagine > > that I > > > can't > > > > resume it. Do you think that it is a good idea to stop now > > (I've > > > copied > > > > 70 mb over 200) and to restart the transfer using cp -au ? > > > > > > > > Il giorno dom 28 nov 2021 alle ore 21:14 Kevin Korb > > > <[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>> > > > > <mailto:[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>>> ha > scritto: > > > > > > > > cp -au is pretty much the same as rsync -au. I doubt > you > > > need any of > > > > that other stuff you were using. Especially the one > > that is > > > a default. > > > > > > > > On 11/28/21 15:11, Mario Marietto wrote: > > > > > Hello. thanks. Can you tell me the most appropriate > > > parameters to > > > > use > > > > > with cp ? U will save me a lot of time. Thanks very > > much. > > > > > > > > > > Il giorno dom 28 nov 2021 alle ore 20:43 Kevin Korb > > via rsync > > > > > <[email protected] > > <mailto:[email protected]> <mailto:[email protected] > > <mailto:[email protected]>> > > > <mailto:[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>> > > > > <mailto:[email protected] > > <mailto:[email protected]> <mailto:[email protected] > > <mailto:[email protected]>> > > > <mailto:[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>>>> ha > > > > scritto: > > > > > > > > > > rsync is terribly slow at local copies. Also, > it > > > doesn't do > > > > its normal > > > > > optimizing (see --whole-file). Just use cp. > > > > > > > > > > On 11/28/21 13:38, Mario Marietto via rsync > wrote: > > > > > > Hello to everyone. > > > > > > > > > > > > I'm copying a large file from a NTFS > > formatted disk > > > to another > > > > > > one,UFS/FreeBSD disk,both are removable disks > > > attached to > > > > the USB 3 > > > > > > port. The file is 200 GB large and it is > > copied very > > > > slowly. Why > > > > > it is > > > > > > so slow ? I don't know where to store my > virtual > > > machines. I > > > > > tried to > > > > > > save them on the ext4 disk because I wanted > to > > > share them > > > > easily > > > > > between > > > > > > Linux and FreeBSD but I've realized that > when I > > > mount the > > > > disk in > > > > > > FreeBSD after some time it corrupts. I tried > to > > > store it > > > > on the NTFS > > > > > > disk but it happens the same. So,now I'm on > > FreeBSD > > > and I'm > > > > > copying them > > > > > > to a dedicated UFS/FreeBSD style disk,but as > > I said,the > > > > speed is > > > > > very > > > > > > slow. How can I increase the speed ?. > > Actually I'm > > > using this > > > > > > command,because I want to resume the > > uploading if > > > it breaks at > > > > > some point : > > > > > > > > > > > > > > > > > > root@marietto:/mnt/da3p2/bhyve/Ubuntu # > rsync > > > -avAXEWSlHh > > > > > > /mnt/da0p1/Backups/OS/bhyve/Ubuntu/im* . > > --no-compress > > > > > --info=progress2 > > > > > > > > > > > > sending incremental file list > > > > > > impish-cuda-11-4-nvidia-470.img > > > > > > > > > > > > 2.13M 0% 9.49kB/s 6284:55:38 > > > > > > > > > > > > > > > > > > and : where do you save large files ? what's > the > > > procedure > > > > that > > > > > you use > > > > > > to copy large files with a decent speed ? > > > Unfortunately under > > > > > Linux is > > > > > > not safe to use a RW ufs disk access. So,I'm > > out of > > > solutions. > > > > > > > > > > > > - > > > > > > Mario. > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > > > Kevin Korb Phone: > > > (407) 252-6853 > > > > > Systems Administrator > Internet: > > > > > FutureQuest, Inc. > > > > [email protected] (work) > > > > > Orlando, Florida [email protected] > > <mailto:[email protected]> > > > <mailto:[email protected] <mailto:[email protected]>> > > > > <mailto:[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>> > > > > > <mailto:[email protected] > > <mailto:[email protected]> <mailto:[email protected] > > <mailto:[email protected]>> > > > <mailto:[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>>> > > > > (personal) > > > > > Web page: https://sanitarium.net/ > > <https://sanitarium.net/> > > > <https://sanitarium.net/ <https://sanitarium.net/>> > > > > <https://sanitarium.net/ <https://sanitarium.net/> > > <https://sanitarium.net/ <https://sanitarium.net/>>> > > > <https://sanitarium.net/ <https://sanitarium.net/> > > <https://sanitarium.net/ <https://sanitarium.net/>> > > > > <https://sanitarium.net/ <https://sanitarium.net/> > > <https://sanitarium.net/ <https://sanitarium.net/>>>> > > > > > PGP public key available on web site. > > > > > > > > > > > > > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > > > > > > > > -- > > > > > Please use reply-all for most replies to avoid > > > omitting the > > > > mailing > > > > > list. > > > > > To unsubscribe or change options: > > > > > https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync> > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync>> > > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync> > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync>>> > > > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync> > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync>> > > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync> > > > <https://lists.samba.org/mailman/listinfo/rsync > > <https://lists.samba.org/mailman/listinfo/rsync>>>> > > > > > Before posting, read: > > > > > http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html> > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html>> > > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html> > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html>>> > > > > > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html> > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html>> > > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html> > > > <http://www.catb.org/~esr/faqs/smart-questions.html > > <http://www.catb.org/~esr/faqs/smart-questions.html>>>> > > > > > > > > > > > > > > > > > > > > -- > > > > > Mario. > > > > > > > > -- > > > > > > > > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > > Kevin Korb Phone: > > (407) 252-6853 > > > > Systems Administrator Internet: > > > > FutureQuest, Inc. > > > [email protected] (work) > > > > Orlando, Florida [email protected] > > <mailto:[email protected]> > > > <mailto:[email protected] <mailto:[email protected]>> > > > > <mailto:[email protected] <mailto:[email protected]> > > <mailto:[email protected] <mailto:[email protected]>>> > > > (personal) > > > > Web page: https://sanitarium.net/ > > <https://sanitarium.net/> > > > <https://sanitarium.net/ <https://sanitarium.net/>> > > <https://sanitarium.net/ <https://sanitarium.net/> > > > <https://sanitarium.net/ <https://sanitarium.net/>>> > > > > PGP public key available on web site. > > > > > > > > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > > > > > > > > > > > > > > -- > > > > Mario. > > > > > > -- > > > > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > Kevin Korb Phone: (407) > 252-6853 > > > Systems Administrator Internet: > > > FutureQuest, Inc. > > [email protected] (work) > > > Orlando, Florida [email protected] > > <mailto:[email protected]> > > > <mailto:[email protected] <mailto:[email protected]>> > > (personal) > > > Web page: https://sanitarium.net/ > > <https://sanitarium.net/> <https://sanitarium.net/ > > <https://sanitarium.net/>> > > > PGP public key available on web site. > > > > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > > > > > > > > > > -- > > > Mario. > > > > -- > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > Kevin Korb Phone: (407) 252-6853 > > Systems Administrator Internet: > > FutureQuest, Inc. [email protected] > (work) > > Orlando, Florida [email protected] > > <mailto:[email protected]> (personal) > > Web page: https://sanitarium.net/ <https://sanitarium.net/> > > PGP public key available on web site. > > > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > > > > > > > > -- > > Mario. > > -- > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > Kevin Korb Phone: (407) 252-6853 > Systems Administrator Internet: > FutureQuest, Inc. [email protected] (work) > Orlando, Florida [email protected] (personal) > Web page: https://sanitarium.net/ > PGP public key available on web site. > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > -- Mario. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html