Re: Blocker on checkpoint

Sébastien Pérès-Labourdette <[email protected]> Thu, 14 Apr 2022 08:48:17 +0200
Newsgroups gmane.comp.java.hsqldb.user
Organization Groupe omerin
Message-ID <[email protected]>
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--===============3817436688612239404==
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature";
 boundary="nDYTjxs7vfn6NbFGjLvWSaxnl0QoO5PyN"

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--nDYTjxs7vfn6NbFGjLvWSaxnl0QoO5PyN
Content-Type: multipart/mixed; boundary="3AVYmZfkIE2rbmxJ7itxynJMkE4nZnQxo";
 protected-headers="v1"
From: =?UTF-8?B?U8OpYmFzdGllbiBQw6lyw6hzLUxhYm91cmRldHRl?=
 <[email protected]>
To: "User discussions about HyperSQL Database Engine."
 <[email protected]>
Message-ID: <[email protected]>
Subject: Re: [Hsqldb-user] Blocker on checkpoint
References: <[email protected]>
 <[email protected]>
In-Reply-To: <[email protected]>

--3AVYmZfkIE2rbmxJ7itxynJMkE4nZnQxo
Content-Type: multipart/alternative;
 boundary="------------1E65A6995DAF6FE8A0463DD3"
Content-Language: fr-classic

This is a multi-part message in MIME format.
--------------1E65A6995DAF6FE8A0463DD3
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hi.

Another instance is now causing same issue.

Everything is fine for a certain amount of time as well as checking
instance individually in-process :
=C2=A0- checkpoint / defrag
=C2=A0- perform check all table index and fix
=C2=A0- shutdown

At some point, unable to checkpoint / defrag properly.
Disk becoming full after a month or so, unable to backup, hsqldb unable
to sync io, databases becomes corrupted ....

What may be causing defrag / checkpoint to hang like that ?


------------------------------------------------------------------------
*De : *Fred Toussi Via Hsqldb-user <[email protected]>
*Envoy=C3=A9 : * Vendredi 8 Avril 2022 18:18:03
*=C3=80 : *Hsqldb User List <[email protected]>
*Cc : *Fred Toussi <[email protected]>
*Objet : *Re: [Hsqldb-user] Blocker on checkpoint
> There's obviusly an issue with the problematic instance.=20
>
> Execute SHUTDOWN on this particular instance and open it as an in-proce=
ss database using DatabaseManagerSwing then try "perform check all table =
index and fix". If it doesn't end, there is something wrong that it canno=
t fix. Also try SHUTDOWN SCRIPT. If it doesn't work either you can get Su=
pportWare and send the database for a possible fix.
>
> Fred
>
> On Fri, Apr 8, 2022, at 10:39, S=C3=A9bastien P=C3=A9r=C3=A8s-Labourdet=
te wrote:
>> Hi there.
>>
>> Use case is the following
>> =C2=A0- Hsqldb server 2.5.1 with 14 database instances, some 100% memo=
ry,
>> some 100% cached.
>> =C2=A0- Background java job to perform checkpoint defrag on all instan=
ces.
>> =C2=A0- Job running well for 4/5 days.
>> =C2=A0- At some point, checkpoint defrag does never end on one specifi=
c instance
>> =C2=A0- Shutdown server does never end (waiting for the problematic in=
stance
>> to shutdown but never comes)
>> =C2=A0- Force to kill the server process
>> =C2=A0- Restart server and all goes well for the next 4/5 days
>>
>> The problematic instance does not mention any memory table (all cached=
)
>>
>> For this one, as well as some others, we have
>> =C2=A0- SET FILES WRITE DELAY FALSE
>>
>> As well as
>> =C2=A0- SET FILES BACKUP INCREMENT TRUE
>> =C2=A0- SET FILES NIO TRUE
>> =C2=A0- SET FILES NIO SIZE 1024
>>
>> Statements such as "perform check all table index and fix" does never
>> end as well.
>>
>> Storage / hardware is the same for all 14 instances, database "size" i=
s
>> 33Mb, other non-problematic databases goes beyond +600Mb
>>
>> Any clues ?
>>
>> --
>> S=C3=A9bastien
>>
>>
>> _______________________________________________
>> Hsqldb-user mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/hsqldb-user
>>
>> Attachments:
>> * signature.asc
>
> _______________________________________________
> Hsqldb-user mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/hsqldb-user

--------------1E65A6995DAF6FE8A0463DD3
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html>
  <head>
    <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DUTF=
-8">
  </head>
  <body smarttemplateinserted=3D"true">
    <div id=3D"smartTemplate4-template"></div>
    Hi.<br>
    <br>
    Another instance is now causing same issue.<br>
    <br>
    Everything is fine for a certain amount of time as well as checking
    instance individually in-process :<br>
    =C2=A0- checkpoint / defrag<br>
    =C2=A0- perform check all table index and fix<br>
    =C2=A0- shutdown<br>
    <br>
    At some point, unable to checkpoint / defrag properly.<br>
    Disk becoming full after a month or so, unable to backup, hsqldb
    unable to sync io, databases becomes corrupted ....<br>
    <br>
    What may be causing defrag / checkpoint to hang like that ?<br>
    <br>
    <br>
    <div id=3D"smartTemplate4-quoteHeader">
      <div style=3D"font-size:9pt;
font-family:Arial,Helvetica;padding-bottom:1px;color:#000000;padding-top:=
1px;">
        <hr size=3D"1"><b>De : </b>Fred Toussi Via Hsqldb-user
        <a class=3D"moz-txt-link-rfc2396E" href=3D"mailto:hsqldb-user@lis=
ts.sourceforge.net">&lt;[email protected]&gt;</a><br>
        <b>Envoy=C3=A9 : </b> Vendredi 8 Avril 2022 18:18:03<br>
        <b>=C3=80 : </b>Hsqldb User List
        <a class=3D"moz-txt-link-rfc2396E" href=3D"mailto:hsqldb-user@lis=
ts.sourceforge.net">&lt;[email protected]&gt;</a><br>
        <b>Cc : </b>Fred Toussi <a class=3D"moz-txt-link-rfc2396E" href=3D=
"mailto:[email protected]">&lt;[email protected]&gt;<=
/a><br>
        <b>Objet : </b>Re: [Hsqldb-user] Blocker on checkpoint<br>
      </div>
    </div>
    <blockquote type=3D"cite"
      cite=3D"mid:[email protected]">=

      <pre class=3D"moz-quote-pre" wrap=3D"">There's obviusly an issue wi=
th the problematic instance.=20

Execute SHUTDOWN on this particular instance and open it as an in-process=
 database using DatabaseManagerSwing then try "perform check all table in=
dex and fix". If it doesn't end, there is something wrong that it cannot =
fix. Also try SHUTDOWN SCRIPT. If it doesn't work either you can get Supp=
ortWare and send the database for a possible fix.

Fred

On Fri, Apr 8, 2022, at 10:39, S=C3=A9bastien P=C3=A9r=C3=A8s-Labourdette=
 wrote:
</pre>
      <blockquote type=3D"cite">
        <pre class=3D"moz-quote-pre" wrap=3D"">Hi there.

Use case is the following
=C2=A0- Hsqldb server 2.5.1 with 14 database instances, some 100% memory,=

some 100% cached.
=C2=A0- Background java job to perform checkpoint defrag on all instances=
=2E
=C2=A0- Job running well for 4/5 days.
=C2=A0- At some point, checkpoint defrag does never end on one specific i=
nstance
=C2=A0- Shutdown server does never end (waiting for the problematic insta=
nce
to shutdown but never comes)
=C2=A0- Force to kill the server process
=C2=A0- Restart server and all goes well for the next 4/5 days

The problematic instance does not mention any memory table (all cached)

For this one, as well as some others, we have
=C2=A0- SET FILES WRITE DELAY FALSE

As well as
=C2=A0- SET FILES BACKUP INCREMENT TRUE
=C2=A0- SET FILES NIO TRUE
=C2=A0- SET FILES NIO SIZE 1024

Statements such as "perform check all table index and fix" does never
end as well.

Storage / hardware is the same for all 14 instances, database "size" is
33Mb, other non-problematic databases goes beyond +600Mb

Any clues ?

--
S=C3=A9bastien


_______________________________________________
Hsqldb-user mailing list
<a class=3D"moz-txt-link-abbreviated" href=3D"mailto:[email protected]=
urceforge.net">[email protected]</a>
<a class=3D"moz-txt-link-freetext" href=3D"https://lists.sourceforge.net/=
lists/listinfo/hsqldb-user">https://lists.sourceforge.net/lists/listinfo/=
hsqldb-user</a>

Attachments:
* signature.asc
</pre>
      </blockquote>
      <pre class=3D"moz-quote-pre" wrap=3D"">

_______________________________________________
Hsqldb-user mailing list
<a class=3D"moz-txt-link-abbreviated" href=3D"mailto:[email protected]=
urceforge.net">[email protected]</a>
<a class=3D"moz-txt-link-freetext" href=3D"https://lists.sourceforge.net/=
lists/listinfo/hsqldb-user">https://lists.sourceforge.net/lists/listinfo/=
hsqldb-user</a>
</pre>
    </blockquote>
  </body>
</html>

--------------1E65A6995DAF6FE8A0463DD3--

--3AVYmZfkIE2rbmxJ7itxynJMkE4nZnQxo--

--nDYTjxs7vfn6NbFGjLvWSaxnl0QoO5PyN
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCAAdFiEEznMZYIYm11GH+LgZbWUMMqvegosFAmJXw7IACgkQbWUMMqve
gotQFgf/do4Vhjc3NT9i8zWyU6OyUVQdvQro2QLhbR2RpXcuVViLtsymZHQzC/H3
Kppt+jE6EtSGRTIzJGja6l+n8SQpX/yaXaMe4F/qbFAvpY+GZphuZh53DgU6A/oU
QJFNHZbiAC7W467JSSihJoaeM3bjZmOIWo1WkpULvZzy7pK8Gi0YWOlHCs33D+l3
Gd+Sepk+ZIS8ldZb8mPSLo0y+5zFFgiHAMtVAan83I9D061HgJHonlarxmR2PT9x
IiznynVcm1jR1AeKcBuW4r20FstQNMaQFitfJJrAOLyuEBCYyljEM9N16q0pfHUZ
lKEbzEpWH0v6cofKwmwAVXZqf1YS4A==
=lAUJ
-----END PGP SIGNATURE-----

--nDYTjxs7vfn6NbFGjLvWSaxnl0QoO5PyN--


--===============3817436688612239404==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline


--===============3817436688612239404==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Hsqldb-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/hsqldb-user

--===============3817436688612239404==--