Re: ftp mirrors

[Andrew Cagney <ac131313@cygnus.com>]

Jason Molenda wrote:

> We don't have the disk space for that.  (try a df on sourceware and
> imagine what the 3GB of ftp would expand to when uncompressed)
> 
> More importantly, rsync has support for this problem already.
> 
>        dont compress
>               The "dont compress" option  allows  you  to  select
>               filenames  based  on  wildcard patterns that should
>               not be compressed during transfer.  Compression  is
>               expensive  in  terms  of CPU usage so it is usually
>               good to not try to compress files that  won't  com-
>               press well, such as already compressed files.
> 
>               The  "dont compress" option takes a space separated
>               list of  case-insensitive  wildcard  patterns.  Any
>               source  filename  matching one of the patterns will
>               not be compressed during transfer.
> 
>               The default setting is
> 
>               *.gz *.tgz *.zip *.z *.rpm *.deb
> 
> Looks like setting 'dont compress' to include .bz2 would be enough.

That isn't what I'm thinking of.  given a gzip file, rsync has
effectivly random data.  Given the file uncompressed and rsync can
recognize internal sections.  Tar balls, for instance change very
little, however because they are compressed, rsync can't see that.

	Andrew