Re: export | import taking a really, really long time

On 8/7/12 10:22 AM, Larry D'Anna wrote:
> I'm trying to migrate a spam probe database over from an old machine.  The
> spamprobe version hasn't changed, (v1.4d is what it reports), but the version of
> the database lib has changed, so I can't directly use the old library.  The
> problem is that spamprobe export is generating what appears to be an unbounded
> amount of output.   It got up to 50G (for a 345M database) before I killed it. 
> Now I'm running "spamprobe_old export | spamprobe_new import" so it doesn't fill
> up my whole disk, but it's been running all night and the new database is only
> 33M.   It doesn't appear to have grown at all since I checked it before going to
> sleep.
>
> Any ideas? 
>
> Thanks.
>
My guess would be that your old database is corrupted so the code that
iterates through all records is looping endlessly.  What database were
you using on the old machine?  If it was berkeley db I suggest
repairing it first.  BDB is prone to corruption and a corrupted index
could easily lead to loops while iterating but don't cause a problem
while searching.

All the best,
++Brian


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/