Need to copy a 200GB directory

[Tom Buskey]

I typically use rsync instead of cp when I can.  There can be issues (and
there's too much below I know):

lots of small files can slow things down because of the comparision
(checksum, dates, names).  zfs send/receive uses a different method for
remote replication that avoids this.

If you're on cygwin, there are restrictions (I can't recall specifics)
compared to Unixen.

Different file systems may act different.

ACLs are not copied.  Other permissions might not work too (NTFS to FAT and
it'll recopy instead of skip)

MacOSX HFS files have 2 forks, resource (with icons, etc) and data.  On
older versions (panther?), cp would copy both forks.  Rsync would only deal
with the data fork.  NTFS has forks IIRC but I think cygwin can deal.  It's
no fun having the user complain all the icons on the MacOS9 desktop are
wrong because the move/restore used rsync.


On Tue, Jun 27, 2017 at 11:55 AM, Tom Buskey <tom at buskey.name> wrote:

> rsync doesn't encrypt if there's no remote, as in this case.
>
> To be pedantic, rsync to remotes uses ssh by default but it can use rsh
> which has no encryption.  Some older versions of SSH allowed you to specify
> the encryption.  I recall using XOR encryption for faster operation where
> security was not needed.
>
> Encryption typically does some compression.  If you compress 2x, you're
> doubling the bits through the pipe in the same time.  If the
> encryption/compression computation at either end is faster than than the
> uncompressed bandwidth, you'll have faster throughput.  That's very typical
> on newer multicore, high GHz CPUs.
>
> On Mon, Jun 26, 2017 at 4:11 PM, mark <prgrmr at gmail.com> wrote:
>
>> Locally, cp is faster because you cannot make rsync not encrypt, but the
>> restart-from-where-it-stopped feature of rsync makes it worth the wait.
>>
>> Mark
>> On Jun 26, 2017 3:18 PM, "Charles Farinella" <
>> cfarinella at appropriatesolutions.com> wrote:
>>
>>> We need to copy a large (200+GB) directory from one filesystem to
>>> another, both locally mounted.
>>>
>>> I'm unsure as to what I should use to do this, cp, rsync, dd?
>>>
>>> Any suggestions appreciated.
>>>
>>> Thanks.
>>>
>>> --charlie
>>>
>>> Charlie Farinella
>>> Systems Administrator
>>> Appropriate Solutions, Inc.
>>> 1-603-924-6079 <(603)%20924-6079>
>>>
>>> _______________________________________________
>>> gnhlug-discuss mailing list
>>> gnhlug-discuss at mail.gnhlug.org
>>> http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
>>>
>>>
>> _______________________________________________
>> gnhlug-discuss mailing list
>> gnhlug-discuss at mail.gnhlug.org
>> http://mail.gnhlug.org/mailman/listinfo/gnhlug-discuss/
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.gnhlug.org/pipermail/gnhlug-discuss/attachments/20170627/bc9c2194/attachment.html