[nzlug] Large scale replication

[Michael Adams]

On Tue, 28 Aug 2007 22:41:05 +1200
Cliff Pratt wrote:

> What do people use for large scale replication? IE Terabytes/millions
> of files?
> 
> I've been trying to use 'rsync' but I'm less than impressed. It runs
> for 
>   a couple of hours then dies either with no message at all or a 
> 'communications error'. It seems size related as it works if I copy 
> directories of around 30 - 50 GB but barfs at larger ones. Looks like 
> I'll have to code something to use 'cp' and manually compare and
> remove stuff.

If you don't get rsync working remember 'tar' has last modified date
abilities with the -u flag. Tar is for backups.

> 
> Very unimpressed with 'rsync'. It gets such good reviews, too!

One bum out does not a bad program make. Explore the problem first.

-- 
Michael
Linux: The OS people choose without $200,000,000 of persuasion.