Re: diff compression
"gulikoza" <[email protected]> Mon, 11 Jan 2016 20:24:34 +0100
| Newsgroups | gmane.comp.sysutils.backup.dar.general |
|---|---|
| Message-ID | <[email protected]> |
Hello, I've been diagnosing why I got differential dar backup almost the same size as full after updating dar from 2.3 to 2.4 (yes I know...). I've come up with some discussion about dar&hard links on cifs share, which was my setup as well (http://sourceforge.net/p/dar/mailman/message/26577785). Now (this is a bit off-topic, but bear with me for a bit more), I figured it out the problem is because cifs share will produce files with hard link count = 0, which was apparently fixed in later kernels (see samba bug report here: https://bugzilla.samba.org/show_bug.cgi?id=9346, which makes me wonder, should there be some way to handle this?). As hard link count changed after I have upgraded entire system from Centos6 to Centos7 (relevant kernel commit: http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/fs/cif s?id=74d290da476f672ad756634d12aa707375d3564d), dar produced a differential backup of almost the same size as full backup and is probably not related to dar version change... Back on topic...suppose a copy of a directory (that's included in daily backup) is made. Old directory probably has files that have already been stored in some previous full backup...A worrying admin might run 'hardlink' over both old&new directories to save both server space and backup size. But - every inode is now changed in the old directory as well because hard link count has increased. Dar will store every file in a new data structure that stores hard links (if a differential backup is made). No backup space is actually saved (1 copy of file data is stored in this new diff backup in either case, even if hardlink was not run)... Will delta compression take this into account? Inode type has changed from normal file to hard linked file, but data is the same - so ideally, it should only store a very small delta? Have you considered in the algorithm how delta is stored if inode changes type? Regards, gulikoza ------------------------------------------------------------------------------ Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end-to-end web transactions and take corrective actions now Troubleshoot faster and improve end-user experience. Signup Now! http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140