[Resolved?] Re: ovsqlite - bug?

Julien ÉLIE <[email protected]> writes:

> Hi Kamil,
>
>>> Are there plenty of these messages or only a very few?
>> makehistory: cannot write overview data "@03FF30000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF31000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF32000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF33000000000000000000004400000008@"
>> makehistory: cannot write overview data "@03FF35000000000000000000004400000007@"
>> makehistory: cannot write overview data "@03FF36000000000000000000004400000007@"
>> makehistory: cannot write overview data "@03FF37000000000000000000004400000007@"
>> 7 ( for 4.8 million articles in spool)
>
> OK, I thought there were far more errors than that.

Well, it seems that problem is with spool not with sqlite.
I dig somewhat deeper into overview database (with sqlite3 cli tool) and I
have some suspections about duplicates of (group,artnum) in spool 
These suspections makes me to issue command:
--8<---------------cut here---------------start------------->8---
sudo -u news env PATH=$PATH:/usr/lib/news/bin makehistory -O -x -S|grep'\(linux.debian.user:464806\|gmane.linux.debian.packages.ocaml.scm:21155\|gmane.comp.file-systems.gluster.user:28781\|gmane.comp.emulators.qemu:799173\|gmane.comp.java.jenkins.user:48616\)'|tee /tmp/spool
--8<---------------cut here---------------end--------------->8---
As a result I have:

--8<---------------cut here---------------start------------->8---
@03FF32000000000000000000004400000008@ 1643431380 0 Antipatterns and Handcuffs [was: Re: Resolved (without understanding  ...]	<[email protected]>	Fri, 24 Jul 2020 11:30:01 +0200	<[email protected]>	<[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]>	4818	57	Xref: news.kjonca linux.debian.user:464806
@03FF32000000000000000000004400000008@ 1643431380 0 Antipatterns and Handcuffs [was: Re: Resolved (without understanding  ...]	<[email protected]>	Fri, 24 Jul 2020 11:30:01 +0200	<[email protected]>	<[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]> <[email protected]>	4818	57	Xref: news.kjonca linux.debian.user:464806
@03FF33000000000000000000004400000008@ 1643433853 0 [PATCH 1/4] fuzz: adjust timeout to allow for longer inputs	Alexander Bulekov <[email protected]>	Thu, 17 Jun 2021 15:53:50 -0400	<[email protected]>	<[email protected]>	12813	68	Xref: news.kjonca gmane.comp.emulators.qemu:799173
@03FF33000000000000000000004400000008@ 1643433853 0 [PATCH 1/4] fuzz: adjust timeout to allow for longer inputs	Alexander Bulekov <[email protected]>	Thu, 17 Jun 2021 15:53:50 -0400	<[email protected]>	<[email protected]>	12813	68	Xref: news.kjonca gmane.comp.emulators.qemu:799173
@03FF35000000000000000000004400000007@ 1643412102 0 [ocaml-ctypes] branch master updated (e9b7f58 -> d0083e4)	=?UTF-8?Q?St=C3=A9phane_Glondu?= <[email protected]>	Tue, 14 Jun 2016 09:46:35 +0000	<[email protected]>		15918	200	Xref: news.kjonca gmane.linux.debian.packages.ocaml.scm:21155
@03FF35000000000000000000004400000007@ 1643412102 0 [ocaml-ctypes] branch master updated (e9b7f58 -> d0083e4)	=?UTF-8?Q?St=C3=A9phane_Glondu?= <[email protected]>	Tue, 14 Jun 2016 09:46:35 +0000	<[email protected]>		15918	200	Xref: news.kjonca gmane.linux.debian.packages.ocaml.scm:21155
@03FF36000000000000000000004400000007@ 1643417459 0 Re: volume start: data0: failed: Commit failed on localhost.	Deepak Naidu <[email protected]>	Fri, 24 Feb 2017 17:36:03 +0000	<[email protected]>	<[email protected]> <[email protected]>	277268	3740	Xref: news.kjonca gmane.comp.file-systems.gluster.user:28781
@03FF36000000000000000000004400000007@ 1643417459 0 Re: volume start: data0: failed: Commit failed on localhost.	Deepak Naidu <[email protected]>	Fri, 24 Feb 2017 17:36:03 +0000	<[email protected]>	<[email protected]> <[email protected]>	277268	3740	Xref: news.kjonca gmane.comp.file-systems.gluster.user:28781
@03FF37000000000000000000004400000007@ 1643421414 0 Re: location of email-ext template file	Chris T <[email protected]>	Wed, 6 Dec 2017 10:42:10 -0800 (PST)	<753c223c-90cd-4770-9c75-6de9afbc0446__19462.2635994621$1512588446$gmane$org@googlegroups.com>	<[email protected]> <CAPiUgVchzFuyQHWuw4-CsxqZ-tjSuGxteE9xZkMkWaJX=AcKcw@mail.gmail.com> <CACKaJRPcdnhiQwU0DevOju-5U=DJYxwhPKo97Zt1uTtnZUUxhg@mail.gmail.com> <CAPiUgVdaVCnstwympfdemOZJxGyF0jfpxayuDF1HVUz3B+UTUw@mail.gmail.com> <[email protected]> <CAPiUgVf2s_2oYGPsKMGoc1cyW-4AFEMAeYH+Cz0P5L_XXQuH+Q@mail.gmail.com>	215351	3638	Xref: news.kjonca gmane.comp.java.jenkins.user:48616
@03FF37000000000000000000004400000007@ 1643421414 0 Re: location of email-ext template file	Chris T <[email protected]>	Wed, 6 Dec 2017 10:42:10 -0800 (PST)	<753c223c-90cd-4770-9c75-6de9afbc0446__19462.2635994621$1512588446$gmane$org@googlegroups.com>	<[email protected]> <CAPiUgVchzFuyQHWuw4-CsxqZ-tjSuGxteE9xZkMkWaJX=AcKcw@mail.gmail.com> <CACKaJRPcdnhiQwU0DevOju-5U=DJYxwhPKo97Zt1uTtnZUUxhg@mail.gmail.com> <CAPiUgVdaVCnstwympfdemOZJxGyF0jfpxayuDF1HVUz3B+UTUw@mail.gmail.com> <[email protected]> <CAPiUgVf2s_2oYGPsKMGoc1cyW-4AFEMAeYH+Cz0P5L_XXQuH+Q@mail.gmail.com>	215351	3638	Xref: news.kjonca gmane.comp.java.jenkins.user:48616
--8<---------------cut here---------------end--------------->8---

So makehistory sometimes  generate two lines for spool entry.

It is worth noting, that greping /var/lib/news/history for these storage
tokesn returns nothing.
(for example)
--8<---------------cut here---------------start------------->8---
kjonca@alfa:~%grep 03FF32000000000000000000004400000008 /var/lib/news/history
kjonca@alfa:~%
--8<---------------cut here---------------end--------------->8---

So the first thigs I should do is to make history consistent with spool
and then test further.
But for now I am pretty sure, that sqlite worked properly as, it forces
uniqueness of  (group,artnum )  in overview (and other methods not) -
and this causes error messages.
Sorry for bothering you.

KJ


-- 
http://wolnelektury.pl/wesprzyj/teraz/
-- 
inn-workers mailing list
[email protected]
https://lists.isc.org/mailman/listinfo/inn-workers