RE: new spamprobe BerkeleyDB on CygWin

Brian Burton [mailto:[email protected]] 
> On Sep 30, 2005, at 11:46 AM, Herb Martin wrote:
> > Sorry, Brian I should have been more clear (thinking it was obvious 
> > when it is not was my fault) by saying this was a single 
> fairly short 
> > message used MERELY to create the files.
> 
> Hmm.  Well clearly that's not proper behavior of the software 
> :-)  In  
> no way should SP be spinning its wheels on a tiny email message.   
> Some questions that come to mind:
> 
> 1. Is this completely reproducible?

Yes.  

> 2. Does it happen with that same message if you process it 
> once the database already exists?

Yes.

> 3. Does it happen with an empty message?  i.e. spamprobe good 
> /dev/null

I never tried this and truthfully got busy with 
other things skipping over SpamProbe (due to this
problem and no answer) and onto DSpam.
(No complaint, as you are offering FREE software
and free help but I did get DSpam working usefully.)

And there is the fact that I am down to practically
NO SPAM (even in the review "spam catch" accounts") but
I did want to see SpamProbe work.

> I'm to the point now that my general advice to people who use 
> BerkeleyDB is to switch to PBL (if possible) or the hash 
> format.  I'd like to implement a 64 bit hash database in the 
> next release to mitigate the potential hash collision lossage 
> issue for anyone who  
> worries about such things.   I've been using the 32 bit hash 
> database  
> on my own email for months now without any incidents.

Remember that I am on CygWin and so everything that requires
another make/compile is a potential for me to either fail
to build the software or to introduce some weird error (which
might explain the slowness).  But if you haven't experienced
CygWin it does work quite well on most things IF they only
config & make which SpamProbe did easily.

I skipped over PBL to avoid the additional build step.

> > The system is a reasonably fast, not cutting edge, 2 Ghz 
> Celeron with 
> > 1 MB of RAM.
> 
> That's a lot faster than my own mail server and I haven't 
> seen this particular problem.

Yes, this isn't about "your software" per se or the 
hardware.  It some type of bug that is likely only
present on some particular combination of Win2003/CygWin/
SpamProbe/BDB etc.

> > Something is wrong -- it is likely something that I have 
> done (or not 
> > done) and/or the combination of CygWin,
> > Win2003 server, and SpamProbe since you presumably don't have this 
> > problem usually AND CygWin runs most "Linux/GNU"
> > like software flawlessly (Exim, SpamAssassin, CRM114 are among my 
> > production components.)
> 
> I think it's most likely something to do with the BerkeleyDB 
> implementation in cygwin although it's entirely possible that 
> I am mis-using the 6 or so API calls I'm making.

Possible, but I would assume that some others are 
successfully using BDB on other Posix systems (not
CygWin.)

> > Biggest problem for me initially was figuring out how to "create a 
> > database" (that READ only thing drove me nuts until I reviewed the 
> > archives of this list.)
> 
> Yes.  I should add a "create" command or else cause the -c 
> option to force read-write mode.  I also need to write a 
> separate document for new users about importing.  The README 
> is serving too many audiences (it's a changelog, man page, 
> intro, and a desert topping).
> 
> 
> > BTW, today I passed my first 24 hours without a single SPAM with no 
> > FPs.  No spam even in the server 'spam catch'
> > accounts. Nothing, nada, nichts....(30+ hours right now.).
> 
> Excellent!

At this point, I would mostly be working with SpamProbe
to HELP YOU solve this problem -- not due to urgency on
my part.

I am willing to do that IF you really want to see it work
but don't want to press you to solve a problem for something
that I don't currently need.

AND I REALLY DO want to thank you for making free software
available AND free help too.

I do not want this to sound like I am not grateful or
appreciative of your efforts. 

--
Herb Martin




-------------------------------------------------------
This SF.Net email is sponsored by:
Power Architecture Resource Center: Free content, downloads, discussions,
and more. http://solutions.newsforge.com/ibmarch.tmpl