Re: web interface and command line dspam apparently failing to reclassify emails

On Thu, Nov 20, 2014 at 2:56 PM, [email protected] <[email protected]> wrote:
> On Thu, Nov 20, 2014 at 02:14:15PM -0600, Sparr wrote:
>> I've enabled debugging and in my debug log I can see a db error:
>>
>> _ds_get_signature: mysql_fetch_row() failed
>>
>> I've checked the dspam_signature_data table and it has about 14k rows
>> in it, *far* fewer than the number of emails I've ever received. It
>> does not have a row with the signature of the email I tried to
>> reclassify to produce that error.
>>
>
> Hi,
>
> If the signature is not in the DB, you need to figure out why not
> and fix that. Obviously, there was a signature but was it from your
> dspam or did you use a mode that does not save a signature to process
> it initially? Once you find and fix that, it sounds like you will be
> good to go.
>
> Regards,
> Ken

Here's the debug log for the arrival of an email whose signature does
not end up in the dspam_signature_data table (this behavior is not
unique to this email):

5398: [11/20/2014 13:34:09] connection id 35 from 123.45.67.62.
5398: [11/20/2014 13:34:09] checking trusted user list for dspam(108)
5398: [11/20/2014 13:34:09] No QuarantineAgent option found. Using
standard quarantine.
5398: [11/20/2014 13:34:09] using database handle id 5
5398: [11/20/2014 13:34:09] handle locked
5398: [11/20/2014 13:34:09] DSPAM Instance Startup
5398: [11/20/2014 13:34:09] input args: dspam --deliver=innocent
5398: [11/20/2014 13:34:09] pass-thru args:
5398: [11/20/2014 13:34:09] processing user [email protected]
5398: [11/20/2014 13:34:09] uid = 108, euid = 108, gid = 115, egid = 115
5398: [11/20/2014 13:34:09] loading preferences for user [email protected]
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam: successful returning
struct for name: [email protected]
5398: [11/20/2014 13:34:09] Loading preferences for uid 3
5398: [11/20/2014 13:34:09] Loading preferences for uid 0
5398: [11/20/2014 13:34:09] loaded default preferences externally
5398: [11/20/2014 13:34:09] using
/var/spool/dspam/opt-in/domain.com/user.dspam as path
5398: [11/20/2014 13:34:09] using
/var/spool/dspam/opt-out/domain.com/user.nodspam as path
5398: [11/20/2014 13:34:09] sedation level set to: 1
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam: successful returning
struct for name: [email protected]
5398: [11/20/2014 13:34:09] Connecting to 127.0.0.1:3310 for virus check
5398: [11/20/2014 13:34:09] Connecting to 127.0.0.1:1223 for virus
stream transmission
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam returning cached name
[email protected].
5398: [11/20/2014 13:34:09] Loading 52 BNR patterns
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam returning cached name
[email protected].
5398: [11/20/2014 13:34:09] Whitelist threshold: 10
5398: [11/20/2014 13:34:09] [graham] [0.000310]
From*[email protected] (Cron Daemon) (1frq, 0s, 19221i)
5398: [11/20/2014 13:34:09] [burton] [0.000310]
From*[email protected] (Cron Daemon) (1frq, 0s, 19221i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
Subject*RAILS_ENV=production (1frq, 0s, 51i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Subject*RAILS_ENV=production (1frq, 0s, 51i)
5398: [11/20/2014 13:34:09] [graham] [0.010000] your+locale (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] your+locale (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
Received*web01.domain.com+(Postfix (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*web01.domain.com+(Postfix (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000] will+default (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] will+default (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
enforce_available_locales+= (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
enforce_available_locales+= (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
Subject*/var/web/appname/current (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Subject*/var/web/appname/current (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
Received*(web01.domain.com (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*(web01.domain.com (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
X-Cron-Env*<PATH=/home/deploy/.rbenv/shims (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
X-Cron-Env*<PATH=/home/deploy/.rbenv/shims (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
Received*from+web01.domain.com (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*from+web01.domain.com (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
DKIM-Signature*to+subject (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
DKIM-Signature*to+subject (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000] Subject*sync (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] Subject*sync (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000] skip+validation (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] skip+validation (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
X-Cron-Env*/home/deploy/.rbenv/bin (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
X-Cron-Env*/home/deploy/.rbenv/bin (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [graham] [0.010000]
X-Cron-Env*<LOGNAME=deploy> (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
X-Cron-Env*<LOGNAME=deploy> (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*from+mail02.domain.com (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
DKIM-Signature*c=simple (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] Subject*&& (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*web01.domain.com+(web01.domain.com (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] Subject*Cron+<deploy
(1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] From*web01.domain.com
(1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*web01.domain.com (2frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000]
Received*web01.domain.com (2frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] DomainKey-Signature*to
(1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] avoid+this (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] to+skip (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] [burton] [0.010000] set+I18n (1frq, 0s, 50i)
5398: [11/20/2014 13:34:09] Graham-Bayesian Probability: 0.000000 Samples: 15
5398: [11/20/2014 13:34:09] Burton-Bayesian Probability: 0.000000 Samples: 27
5398: [11/20/2014 13:34:09] no factors specified; using default
5398: [11/20/2014 13:34:09] Result Confidence: 0.99
5398: [11/20/2014 13:34:09] auto-whitelisting this message
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam returning cached name
[email protected].
5398: [11/20/2014 13:34:09] Control: [10 10] [10 11] Delta: [0 1]
5398: [11/20/2014 13:34:09] total processing time: 0.03335s
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam returning cached name
[email protected].
5398: [11/20/2014 13:34:09] saving signature as 546e423153989760964788
5398: [11/20/2014 13:34:09] libdspam returned probability of 0.000000
5398: [11/20/2014 13:34:09] message result: NOT SPAM
5398: [11/20/2014 13:34:09] _mysql_drv_getpwnam returning cached name
[email protected].
5398: [11/20/2014 13:34:09] delivering message
5398: [11/20/2014 13:34:09] Establishing connection to 127.0.0.1:10035
5398: [11/20/2014 13:34:09] Connection established
5398: [11/20/2014 13:34:09] DSPAM Instance Shutdown.  Exit Code: 0
5398: [11/20/2014 13:34:09] checking trusted user list for dspam(108)

------------------------------------------------------------------------------
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration & more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk