Re: SQLException: Incorrect string value

Curtis Maurand <[email protected]> Fri, 5 Oct 2018 20:41:25 -0400
Newsgroups gmane.mail.imap.dbmail
Message-ID <CAOU0tYAFpwJqOrZ9zU8VgKfkL9Lxw6S0ig8nzgyCkVk2vKBJkA@mail.gmail.com>
--===============2006161685==
Content-Type: multipart/alternative; boundary=0000000000008b7079057784a6ef

--0000000000008b7079057784a6ef
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

I used to use dbmail for my service.  I thought it would be a no-brainer to
set up with some sort of control panel app since, hey, it's SQL.  However,
I had t stop using it because it doesn't look like it's maintained any
longer.  There hasn't been an update since early last year.  I was also
having trouble with database size vs the actual dump size.  After much
time, I decided that the command-line invited too many errors.  IMAP
searches always timed out.  All the solutions I saw used dovecot and
dovecot's  message store.  I had to switch.  such a shame.  It was a good
idea, but I'm not sure SQL is the right technology for the store.  hadoopor
mongo or some such might actually work better.  I know I had an extensive
set of save queries.  It was just too much to manage.  I'm a purist, but
I"m getting too old be working the command-line.

--Curtis Maurand

On Fri, Oct 5, 2018 at 3:32 PM Reindl Harald (mobile) <
[email protected]> wrote:

> MariaDB 10.2.18 but that issue exists virtually forever and predates
> MariaDB
>
> I don't get what is that hard to handle database input properly and no yo=
u
> can't reject non rfc conform messages on postfix side as long the server =
is
> not for personal use
>
> when dbmail-util is not able to cleanup stuff which cannot be handled it
> is a major bug and I am tired of turn on debug logging to get the fucking
> physical ID for delete the record (and so the whole) message by hand afte=
r
> all that years
>
> Am 5. Oktober 2018 21:09:28 MESZ schrieb Maxim <[email protected]>:
> >
> >which DBMS do you use?
> >
> >05.10.18 14:52, Reindl Harald =D0=BF=D0=B8=D1=88=D0=B5=D1=82:
> >> that there is a invalid char in a header is one thing, but that
> >dbmail
> >> produces non-recovery errors in that case sucks
> >>
> >> <147609553.1537264268556.JavaMail.=C3=BDkids2@oekids-server>
> >> "<[email protected]>")]
> >>
> >> Oct 05 13:36:09 mail.thelounge. dbmail-util[200378]: [0x562cfcc0a600]
> >> Error:[message] dbmail_message_cache_envelope(+1844): SQLException:
> >> Incorrect string value: '\xFDkids2...' for column 'envelope' at row 1
> >>
> >> Am 05.10.18 um 11:51 schrieb Reindl Harald:
> >>> this sucks for years
> >>>
> >>> * why does this happen at all
> >>> * why no output of database-id instead a dot
> >>> * why no dbmail-util switch "kill messages you can't handle"
> >>> * why spit lines with breaks into maillog confusing mailgraph
> >>> ------------------------------
> >>>
> >>> Ok. Found [3] missing envelope values.
> >>> ...
> >>> Maintenance done. Errors were found and fixed.
> >>> We suggest running dbmail-util again to confirm that all errors were
> >>> repaired.
> >>> Ok. Found [3] missing envelope values.
> >>> ...
> >>> Maintenance done. Errors were found and fixed.
> >>> We suggest running dbmail-util again to confirm that all errors were
> >>> repaired.
> >>> Ok. Found [3] missing envelope values.
> >>> ...
> >>> Maintenance done. Errors were found and fixed.
> >>> We suggest running dbmail-util again to confirm that all errors were
> >>> repaired.
> >>>
> >>> ------------------------------
> >>>
> >>> Oct  5 11:45:54 mail dbmail/maintenance[190011]: Error:[message]
> >>> dbmail_message_cache_envelope(+1844): SQLException: Incorrect string
> >>> value: '\xFDkids2...' for column 'envelope' at row 1
> >>> Oct  5 11:45:54 mail dbmail/maintenance[190011]: Error:[message]
> >>> dbmail_message_cache_envelope(+1846): insert envelope failed [("Tue,
> >02
> >>> Oct 2018 19:07:51 +0000"
> >"=3D?UTF-8?Q?Fw:_Einladung_Jour_Fixe_am_2._O?=3D
> >>> =3D?UTF-8?Q?ktobe
> >>> Oct  5 11:45:54 mail dbmail/maintenance[190011]: Error:[message]
> >>> dbmail_message_cache_envelope(+1844): SQLException: Incorrect string
> >>> value: '\xFDkids2...' for column 'envelope' at row 1
> >>> Oct  5 11:45:54 mail dbmail/maintenance[190011]: Error:[message]
> >>> dbmail_message_cache_envelope(+1846): insert envelope failed [("Tue,
> >18
> >>> Sep 2018 10:26:26 +0000" {159}
> >>> =3D?UTF-8?Q?Fw:_Einladung_zum_Vortrag_"Focusing_und_kre
> >>> Oct  5 11:45:54 mail dbmail/maintenance[190011]: Error:[message]
> >>> dbmail_message_cache_envelope(+1844): SQLException: Incorrect string
> >>> value: '\xFDkids2...' for column 'envelope' at row 1
> >>> Oct  5 11:45:54 mail dbmail/maintenance[190011]: Error:[message]
> >>> dbmail_message_cache_envelope(+1846): insert envelope failed [("Tue,
> >11
> >>> Sep 2018 12:49:54 +0000" "[SPAM]
> >>> =3D?UTF-8?Q?Fw:_Einladung_zum_Jour_Fixe_am?=3D =3D?UTF-8?Q
> >>> Oct  5 11:45:55 mail dbmail/maintenance[190013]: Error:[message]
> >>> dbmail_message_cache_envelope(+1844): SQLException: Incorrect string
> >>> value: '\xFDkids2...' for column 'envelope' at row 1
> >>> Oct  5 11:45:55 mail dbmail/maintenance[190013]: Error:[message]
> >>> dbmail_message_cache_envelope(+1846): insert envelope failed [("Tue,
> >02
> >>> Oct 2018 19:07:51 +0000"
> >"=3D?UTF-8?Q?Fw:_Einladung_Jour_Fixe_am_2._O?=3D
> >>> =3D?UTF-8?Q?ktobe
> >>> Oct  5 11:45:55 mail dbmail/maintenance[190013]: Error:[message]
> >>> dbmail_message_cache_envelope(+1844): SQLException: Incorrect string
> >>> value: '\xFDkids2...' for column 'envelope' at row 1
> >>> Oct  5 11:45:55 mail dbmail/maintenance[190013]: Error:[message]
> >>> dbmail_message_cache_envelope(+1846): insert envelope failed [("Tue,
> >18
> >>> Sep 2018 10:26:26 +0000" {159}
> >>> =3D?UTF-8?Q?Fw:_Einladung_zum_Vortrag_"Focusing_und_kre
> _______________________________________________
> DBmail mailing list
> [email protected]
> http://lists.nfg.nl/mailman/listinfo/dbmail
>


--=20
--Curtis

--0000000000008b7079057784a6ef
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">I used to use dbmail for my service.=C2=A0 I thought it wo=
uld be a no-brainer to set up with some sort of control panel app since, he=
y, it&#39;s SQL.=C2=A0 However, I had t stop using it because it doesn&#39;=
t look like it&#39;s maintained any longer.=C2=A0 There hasn&#39;t been an =
update since early last year.=C2=A0 I was also having trouble with database=
 size vs the actual dump size.=C2=A0 After much time, I decided that the co=
mmand-line invited too many errors.=C2=A0 IMAP searches always timed out.=
=C2=A0 All the solutions I saw used dovecot and dovecot&#39;s=C2=A0 message=
 store.=C2=A0 I had to switch.=C2=A0 such a shame.=C2=A0 It was a good idea=
, but I&#39;m not sure SQL is the right technology for the store.=C2=A0 had=
oopor mongo or some such might actually work better.=C2=A0 I know I had an =
extensive set of save queries.=C2=A0 It was just too much to manage.=C2=A0 =
I&#39;m a purist, but I&quot;m getting too old be working the command-line.=
=C2=A0=C2=A0<div><br></div><div>--Curtis Maurand</div></div><br><div class=
=3D"gmail_quote"><div dir=3D"ltr">On Fri, Oct 5, 2018 at 3:32 PM Reindl Har=
ald (mobile) &lt;<a href=3D"mailto:[email protected]">h.reindl@theloun=
ge.net</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" style=3D"m=
argin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">MariaDB 10.2.=
18 but that issue exists virtually forever and predates MariaDB<br>
<br>
I don&#39;t get what is that hard to handle database input properly and no =
you can&#39;t reject non rfc conform messages on postfix side as long the s=
erver is not for personal use<br>
<br>
when dbmail-util is not able to cleanup stuff which cannot be handled it is=
 a major bug and I am tired of turn on debug logging to get the fucking phy=
sical ID for delete the record (and so the whole) message by hand after all=
 that years <br>
<br>
Am 5. Oktober 2018 21:09:28 MESZ schrieb Maxim &lt;<a href=3D"mailto:max_co=
[email protected]" target=3D"_blank">[email protected]</a>&gt;:<br>
&gt;<br>
&gt;which DBMS do you use?<br>
&gt;<br>
&gt;05.10.18 14:52, Reindl Harald =D0=BF=D0=B8=D1=88=D0=B5=D1=82:<br>
&gt;&gt; that there is a invalid char in a header is one thing, but that<br=
>
&gt;dbmail<br>
&gt;&gt; produces non-recovery errors in that case sucks<br>
&gt;&gt;<br>
&gt;&gt; &lt;147609553.1537264268556.JavaMail.=C3=BDkids2@oekids-server&gt;=
<br>
&gt;&gt; &quot;&lt;<a href=3D"mailto:[email protected]=
hoo.com" target=3D"_blank">[email protected]</a=
>&gt;&quot;)]<br>
&gt;&gt;<br>
&gt;&gt; Oct 05 13:36:09 mail.thelounge. dbmail-util[200378]: [0x562cfcc0a6=
00]<br>
&gt;&gt; Error:[message] dbmail_message_cache_envelope(+1844): SQLException=
:<br>
&gt;&gt; Incorrect string value: &#39;\xFDkids2...&#39; for column &#39;env=
elope&#39; at row 1<br>
&gt;&gt;<br>
&gt;&gt; Am 05.10.18 um 11:51 schrieb Reindl Harald:<br>
&gt;&gt;&gt; this sucks for years<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; * why does this happen at all<br>
&gt;&gt;&gt; * why no output of database-id instead a dot<br>
&gt;&gt;&gt; * why no dbmail-util switch &quot;kill messages you can&#39;t =
handle&quot;<br>
&gt;&gt;&gt; * why spit lines with breaks into maillog confusing mailgraph<=
br>
&gt;&gt;&gt; ------------------------------<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Ok. Found [3] missing envelope values.<br>
&gt;&gt;&gt; ...<br>
&gt;&gt;&gt; Maintenance done. Errors were found and fixed.<br>
&gt;&gt;&gt; We suggest running dbmail-util again to confirm that all error=
s were<br>
&gt;&gt;&gt; repaired.<br>
&gt;&gt;&gt; Ok. Found [3] missing envelope values.<br>
&gt;&gt;&gt; ...<br>
&gt;&gt;&gt; Maintenance done. Errors were found and fixed.<br>
&gt;&gt;&gt; We suggest running dbmail-util again to confirm that all error=
s were<br>
&gt;&gt;&gt; repaired.<br>
&gt;&gt;&gt; Ok. Found [3] missing envelope values.<br>
&gt;&gt;&gt; ...<br>
&gt;&gt;&gt; Maintenance done. Errors were found and fixed.<br>
&gt;&gt;&gt; We suggest running dbmail-util again to confirm that all error=
s were<br>
&gt;&gt;&gt; repaired.<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; ------------------------------<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:54 mail dbmail/maintenance[190011]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1844): SQLException: Incorrect =
string<br>
&gt;&gt;&gt; value: &#39;\xFDkids2...&#39; for column &#39;envelope&#39; at=
 row 1<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:54 mail dbmail/maintenance[190011]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1846): insert envelope failed [=
(&quot;Tue,<br>
&gt;02<br>
&gt;&gt;&gt; Oct 2018 19:07:51 +0000&quot;<br>
&gt;&quot;=3D?UTF-8?Q?Fw:_Einladung_Jour_Fixe_am_2._O?=3D<br>
&gt;&gt;&gt; =3D?UTF-8?Q?ktobe<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:54 mail dbmail/maintenance[190011]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1844): SQLException: Incorrect =
string<br>
&gt;&gt;&gt; value: &#39;\xFDkids2...&#39; for column &#39;envelope&#39; at=
 row 1<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:54 mail dbmail/maintenance[190011]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1846): insert envelope failed [=
(&quot;Tue,<br>
&gt;18<br>
&gt;&gt;&gt; Sep 2018 10:26:26 +0000&quot; {159}<br>
&gt;&gt;&gt; =3D?UTF-8?Q?Fw:_Einladung_zum_Vortrag_&quot;Focusing_und_kre<b=
r>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:54 mail dbmail/maintenance[190011]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1844): SQLException: Incorrect =
string<br>
&gt;&gt;&gt; value: &#39;\xFDkids2...&#39; for column &#39;envelope&#39; at=
 row 1<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:54 mail dbmail/maintenance[190011]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1846): insert envelope failed [=
(&quot;Tue,<br>
&gt;11<br>
&gt;&gt;&gt; Sep 2018 12:49:54 +0000&quot; &quot;[SPAM]<br>
&gt;&gt;&gt; =3D?UTF-8?Q?Fw:_Einladung_zum_Jour_Fixe_am?=3D =3D?UTF-8?Q<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:55 mail dbmail/maintenance[190013]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1844): SQLException: Incorrect =
string<br>
&gt;&gt;&gt; value: &#39;\xFDkids2...&#39; for column &#39;envelope&#39; at=
 row 1<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:55 mail dbmail/maintenance[190013]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1846): insert envelope failed [=
(&quot;Tue,<br>
&gt;02<br>
&gt;&gt;&gt; Oct 2018 19:07:51 +0000&quot;<br>
&gt;&quot;=3D?UTF-8?Q?Fw:_Einladung_Jour_Fixe_am_2._O?=3D<br>
&gt;&gt;&gt; =3D?UTF-8?Q?ktobe<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:55 mail dbmail/maintenance[190013]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1844): SQLException: Incorrect =
string<br>
&gt;&gt;&gt; value: &#39;\xFDkids2...&#39; for column &#39;envelope&#39; at=
 row 1<br>
&gt;&gt;&gt; Oct=C2=A0 5 11:45:55 mail dbmail/maintenance[190013]: Error:[m=
essage]<br>
&gt;&gt;&gt; dbmail_message_cache_envelope(+1846): insert envelope failed [=
(&quot;Tue,<br>
&gt;18<br>
&gt;&gt;&gt; Sep 2018 10:26:26 +0000&quot; {159}<br>
&gt;&gt;&gt; =3D?UTF-8?Q?Fw:_Einladung_zum_Vortrag_&quot;Focusing_und_kre<b=
r>
_______________________________________________<br>
DBmail mailing list<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a=
><br>
<a href=3D"http://lists.nfg.nl/mailman/listinfo/dbmail" rel=3D"noreferrer" =
target=3D"_blank">http://lists.nfg.nl/mailman/listinfo/dbmail</a><br>
</blockquote></div><br clear=3D"all"><div><br></div>-- <br><div dir=3D"ltr"=
 class=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div dir=3D"l=
tr">--Curtis</div></div>

--0000000000008b7079057784a6ef--

--===============2006161685==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
DBmail mailing list
[email protected]
http://lists.nfg.nl/mailman/listinfo/dbmail

--===============2006161685==--