Re: SQLException: Column 'envelope' cannot be null / self->content is not a message

Am 20.03.2016 um 19:25 schrieb Matt.:
> It's very easy to add a issue @ github, pleasse try to keep issues
> there also as it's a very good repo. I'm an SVN guy also but I love
> their site and it's very clear!

sorry, my primary repo is http://git.dbmail.eu/paul/dbmail as i have in 
the hundrets of hours trying to help debug dbmail built infrastructure 
around it

> Why is there a dovecot proxy in front ? does it also happen when it's
> not in front ?

because dbmail has proven to be very unstable when it comes to TLS in 
the past, as the servers was installed did not support TLS or anything 
but plain login at all and docevot solves all that problems while at the 
sam etime offer a unified SASL-layer for postfix offering the same 
encryption and auth-methods for POP3/IMAP and SMTP

when you look at the errors the question "does it also happen when it's 
not in front?" superfluous becaus ewhat happens here MUST NEVER happen 
at all, store partly messages and not able to cleanup themself with 
dbmail-util is a nogo

please take a look at the start of this thread especially at "in fact 
all this "messages" are in mailbox_idnr 2 / owner_idnr 1 which is 
"__@!internal_delivery_user!@__" and so *why* is that not cleaned up 
when whatever client operation fails?"

> 2016-03-20 19:16 GMT+01:00 Reindl Harald <[email protected]>:
>>
>>
>> Am 20.03.2016 um 19:11 schrieb Matt.:
>>>
>>> Hi Harald,
>>>
>>> I didn't see your issue earlier, sorry for that. Don't you post @
>>> github issues ?
>>
>>
>> no - sorry, i hate github
>>
>>> Did this never happened before and can how high is your logging at the
>>> moment ?
>>
>>
>> not that often as now
>> dbmail-3.1.17-3.fc23.20160319.rh.2874f497fb429ed139e94342ca1c84325b20b3f1.x86_64
>>
>> syslog_logging_levels = 31
>>
>> in other words - dbmail logging is nearly disabled since there is a dovecot
>> proxy in front
>>
>>
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[message]
>> dbmail_message_cache_headers(+1324): self->content is not a message
>> Mar 20 18:27:46 caladan dbmail/imap4d[1194]: Error:[imap]
>> _ic_append_enter(+1316): [0x55cd52aa79a0] error appending msg
>> _________________________
>>
>> one problem is that this errors just don't go away and i don't understand
>> why that broken stuff is inserted for the temp-user and never cleaned up
>>
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853200]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853199]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853197]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853196]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853195]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853194]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853193]
>> Mar 20 19:15:36 caladan dbmail/maintenance[22304]: Warning:[db]
>> db_set_headercache(+1617): error caching headers for physmessage: [853192]
>>
>> Ok. Found [1915] missing envelope values.
>> ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

>   ...
>> ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
>> Repairing DBMAIL for cached header values...
>> Ok. Found [1915] un-cached physmessages.
>> EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE

>   EEE
>> EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
>>
>>
>>
>>> 2016-03-20 15:17 GMT+01:00 Reindl Harald <[email protected]>:
>>>>
>>>> can dbmail at least get a patch to mention the *user* which triggers that
>>>> bug?
>>>>
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[message]
>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>> Mar 20 15:13:39 caladan dbmail/imap4d[1194]: Error:[imap]
>>>> _ic_append_enter(+1316): [0x55cd52bfaf70] error appending msg
>>>>
>>>>
>>>> Am 15.03.2016 um 01:41 schrieb Reindl Harald:
>>>>>
>>>>>
>>>>> that's not funny, grwing and not redueable without handmade scripts
>>>>> thowing away anything owned by user_idnr 2 which should be the job of
>>>>> dbmail-util (and is prone for race-conditions that way) as last ressort
>>>>> (normally it should be cleaned automatically)
>>>>>
>>>>> Found [890] un-cached physmessages.
>>>>>
>>>>>
>>>>> EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEEE
>>>>>
>>>>> Maintenance done. Errors were found and fixed.
>>>>> We suggest running dbmail-util again to confirm that all errors were
>>>>> repaired.
>>>>> Ok. Found [890] missing envelope values.
>>>>>
>>>>> Am 10.03.2016 um 16:37 schrieb Reindl Harald:
>>>>>>
>>>>>>
>>>>>> in fact all this "messages" are in mailbox_idnr 2 / owner_idnr 1 which
>>>>>> is "__@!internal_delivery_user!@__" and so *why* is that not cleaned up
>>>>>> when whatever client operation fails?
>>>>>>
>>>>>> looks like a partial delivery
>>>>>>
>>>>>> Am 10.03.2016 um 16:33 schrieb Reindl Harald:
>>>>>>>
>>>>>>>
>>>>>>> dbmail-3.1.17 with latest fixes
>>>>>>>
>>>>>>> what's that for new stuff below flooding our server?
>>>>>>> looks like some crazy client is trying to save drafts or something
>>>>>>> like
>>>>>>> that, however, the result is that the number of this errors grows day
>>>>>>> for day with each dbmail-util run
>>>>>>> ___________________________________________________________
>>>>>>>
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1844): SQLException: Column 'envelope'
>>>>>>> cannot be null
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1846): insert envelope failed [(null)]
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1844): SQLException: Column 'envelope'
>>>>>>> cannot be null
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1846): insert envelope failed [(null)]
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Warning:[db]
>>>>>>> db_set_headercache(+1617): error caching headers for physmessage:
>>>>>>> [853193]
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:28:13 caladan dbmail/maintenance[14421]: Warning:[db]
>>>>>>> db_set_headercache(+1617): error caching headers for physmessage:
>>>>>>> [853192]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1844): SQLException: Column 'envelope'
>>>>>>> cannot be null
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1846): insert envelope failed [(null)]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1844): SQLException: Column 'envelope'
>>>>>>> cannot be null
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1846): insert envelope failed [(null)]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Warning:[db]
>>>>>>> db_set_headercache(+1617): error caching headers for physmessage:
>>>>>>> [853193]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14423]: Warning:[db]
>>>>>>> db_set_headercache(+1617): error caching headers for physmessage:
>>>>>>> [853192]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1844): SQLException: Column 'envelope'
>>>>>>> cannot be null
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1846): insert envelope failed [(null)]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1844): SQLException: Column 'envelope'
>>>>>>> cannot be null
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Error:[message]
>>>>>>> dbmail_message_cache_envelope(+1846): insert envelope failed [(null)]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Warning:[db]
>>>>>>> db_set_headercache(+1617): error caching headers for physmessage:
>>>>>>> [853193]
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:28:14 caladan dbmail/maintenance[14425]: Warning:[db]
>>>>>>> db_set_headercache(+1617): error caching headers for physmessage:
>>>>>>> [853192]
>>>>>>> ___________________________________________________________
>>>>>>>
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[message]
>>>>>>> dbmail_message_cache_headers(+1324): self->content is not a message
>>>>>>> Mar 10 16:29:20 caladan dbmail/imap4d[1128]: Error:[imap]
>>>>>>> _ic_append_enter(+1316): [0x55dce60f65b0] error appending msg

_______________________________________________
DBmail mailing list
[email protected]
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iEYEARECAAYFAlbu7UgACgkQhmBjz394AnlUVwCfSyOdKvA2ZnQ3VeZMJzEElu2c
zckAoIv5X6D/ZM9IjCFD7FPQqUmwq7L6
=GOnk
-----END PGP SIGNATURE-----