RE: Pipe to tar or other compressor

> has anyone checked which compression tool might do better than 'the 
> others' when working on the likes of MySQLdump files?
> (and ideally (and diverging from the OP's spec), I'd prefer that it to 
> work on a set of files not just one at a time)

Hi,

In general de-duplication and renormalisation of data at the database layer will make more of a difference then choice of compression tool, but one unappreciated option is exploiting the database's indexing to present data in the most compressible order. 

For example, dumping 'people' records in name order, or in day/month/year of birth will put more similar substrings together, and will a list of sales order items dumping in product code order if the product code is a sizable character string.

The closest thing in mysqldump is "--order-by-primary", which is primarily aimed to make importing the data quicker (as you are only ever going to add to the end of the primary index). If you do try it, I would be interested in hearing what difference (if any) it makes - it will probably suck. :-)

Mike


_______________________________________________
NZLUG mailing list [email protected]
http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug