Re: Results of CheckDS.py

Ed Leafe <[email protected]> Mon, 5 Mar 2007 15:02:46 -0500
Newsgroups gmane.comp.web.zope.zodb.dirstorage
Message-ID <[email protected]>
On Mar 5, 2007, at 3:45 AM, Toby Dickenson wrote:

> (can we keep replies on list please)

	Sorry, this happens whenever I run into a list that doesn't default  
to replying to the list.

>> 	I still have some bad MD5 checksum files that were created after my
>> last good backup. IOW, there are no backups of these that differ from
>> the current bad file. I tried deleting them, but now if I try to
>> pack, I get an error about the file is missing. If I restore it from
>> the backup and try to pack, I get an error about a bad checksum.
>> Catch-22!
>
> Yes, packing will only delete things after proving that it has a  
> full correct
> copy of everything it needs. If anything is missing or wrong, then  
> it can not
> draw any conclusions about what data is unneeded and can therefore be
> deleted.

	OK, that makes sense.

>> 	Can I replace the file with either an empty file, or a copy of
>> another uncorrupted file to get around this problem? How can I ever
>> pack this bloated system?
>
> If you want to suppress the checksum checks then you have two  
> options. The
> easy (but crude) approach is to turn off the checks using the  
> config/settings
> file. A better solution is to selectively suppress the checksum for  
> each file
> that you know to be affected. The 16 bytes starting at address 40  
> are the md5
> checksum for the remainder of the file. Setting this to all-zeros  
> indicates
> that the md5 has not been calculated, and will not be checked.

	That worked! I wrote a short Python script to replace those bites  
with chr(0), and I was able to pack once again. To give you an idea  
as to what a difference this made, my last full backup created a 13GB  
file. I just ran a full backup, and the file size was 2.7GB!!

	Thanks again for your help.

-- Ed Leafe
-- http://leafe.com
-- http://dabodev.com



-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV