Re: metacpan losing track of certain CPAN distributions
[email protected] (Robert Spier) Wed, 29 Oct 2025 19:35:18 -0700
| Newsgroups | perl.cpan.workers |
|---|---|
| Message-ID | <CAArofffoec4RyKDwhRNP2PiYFGP5YhauFwhqxjTmTOucz98V4g@mail.gmail.com> |
--0000000000009eeb1c0642571a6e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Thanks. Let me know if you hit more max connections errors, and I can bump up the limit for that server. -R On Sun, Oct 26, 2025 at 2:18=E2=80=AFAM Leo Lapworth <[email protected]> wrote= : > Thanks Robert, > > I've added the ability for MetaCPAN to have puppet secrets so have kept i= t > private and made the change to the new hostname. > > We currently have up to 5 separate servers running rrr-watcher - but each > with an additional nightly full rsync > > Thanks > > Leo > > > > > On Sat, Oct 25, 2025 at 4:10=E2=80=AFPM Robert Spier <[email protected]> w= rote: > >> >> I've sent you a special hostname to switch to. If you could avoid makin= g >> it public, that would be appreciated. If there's no way to not make it >> public, we'll need to do some more complicated configuration. >> >> Are you doing more than 1 rsync at a time? >> >> -R >> >> On Sat, Oct 25, 2025 at 10:24=E2=80=AFAM Leo Lapworth <[email protected]> w= rote: >> >>> Hi Ask, >>> >>> MetaCPAN is getting quite a few of these: >>> >>> ``` >>> @ERROR: max connections (10) reached -- try again later >>> rsync error: error starting client-server protocol (code 5) at >>> main.c(1666) [Receiver=3D3.1.2] >>> ``` >>> >>> Anything you can do on that? >>> >>> Cheers >>> >>> Leo >>> >>> >>> >>> On Wed, Oct 22, 2025 at 8:26=E2=80=AFPM Olaf Alders <olaf@wundersolutio= ns.com> >>> wrote: >>> >>>> I just restarted the rrr-client. Let's see if that helps. We already >>>> run a daily rsync to ensure nothing has been missed via rrr. >>>> >>>> Olaf >>>> >>>> On Wed, Oct 22, 2025, at 3:14 PM, Ask Bj=C3=B8rn Hansen wrote: >>>> >>>> >>>> We rebuilt the primary CPAN mirror source over the last weeks. (It=E2= =80=99s >>>> now in Kubernetes and operated via git, including the current version = of >>>> the various decades old tools maintaining metadata). >>>> >>>> I tried pretty hard to make sure the RRR recent data was accurate, but >>>> I had to relearn a bit about how it works in the process so the files = had >>>> some erroneous epochs for a few days. >>>> >>>> Maybe metacpan needs a onetime full rsync (or the rrr client restarted= ?) >>>> >>>> >>>> Ask >>>> >>>> >>>> -- >>>> Olaf Alders >>>> >>>> =F0=9F=93=AE [email protected] >>>> =F0=9F=9A=80 https://prettygoodping.com >>>> >>>> >>>> --0000000000009eeb1c0642571a6e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">Thanks.=C2=A0 Let me know if you hit more max connections = errors, and I can bump up the limit for that server.<div><br></div><div>-R<= /div></div><br><div class=3D"gmail_quote gmail_quote_container"><div dir=3D= "ltr" class=3D"gmail_attr">On Sun, Oct 26, 2025 at 2:18=E2=80=AFAM Leo Lapw= orth <<a href=3D"mailto:[email protected]">[email protected]</a>> wrote:<br= ></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;= border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr">T= hanks Robert,<div><br></div><div>I've added the ability for MetaCPAN to= have puppet secrets so have kept it private and made the change to the new= hostname.</div><div><br></div><div>We currently have up to 5 separate serv= ers running rrr-watcher - but each with an additional nightly full rsync</d= iv><div><br></div><div>Thanks</div><div><br></div><div>Leo</div><div><br></= div><div><br></div><div><br></div></div><br><div class=3D"gmail_quote"><div= dir=3D"ltr" class=3D"gmail_attr">On Sat, Oct 25, 2025 at 4:10=E2=80=AFPM R= obert Spier <<a href=3D"mailto:[email protected]" target=3D"_blank">rspie= [email protected]</a>> wrote:<br></div><blockquote class=3D"gmail_quote" style= =3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding= -left:1ex"><div dir=3D"ltr"><br><div>I've sent you a special hostname t= o switch to.=C2=A0 If you could avoid making it public, that would be appre= ciated.=C2=A0 If there's no way to not make it public, we'll need t= o do some more complicated configuration.</div><div><br></div><div>Are you = doing more than 1 rsync at a time?</div><div><br></div><div>-R</div></div><= br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Sat,= Oct 25, 2025 at 10:24=E2=80=AFAM Leo Lapworth <<a href=3D"mailto:leo@cu= ckoo.org" target=3D"_blank">[email protected]</a>> wrote:<br></div><blockqu= ote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px= solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr">Hi Ask,<div><br>= </div><div>MetaCPAN is getting quite a few of these:</div><div><br><div>```= </div><div>@ERROR: max connections (10) reached -- try again later<br>rsync= error: error starting client-server protocol (code 5) at main.c(1666) [Rec= eiver=3D3.1.2]</div><div>```</div></div><div><br></div><div>Anything you ca= n do on that?</div><div><br></div><div>Cheers</div><div><br></div><div>Leo<= /div><div><br></div><div><br></div></div><br><div class=3D"gmail_quote"><di= v dir=3D"ltr" class=3D"gmail_attr">On Wed, Oct 22, 2025 at 8:26=E2=80=AFPM = Olaf Alders <<a href=3D"mailto:[email protected]" target=3D"_blan= k">[email protected]</a>> wrote:<br></div><blockquote class=3D"gm= ail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,= 204,204);padding-left:1ex"><u></u><div><div>I just restarted the rrr-client= . Let's see if that helps. We already run a daily rsync to ensure nothi= ng has been missed via rrr.</div><div><br></div><div>Olaf</div><div><br></d= iv><div>On Wed, Oct 22, 2025, at 3:14 PM, Ask Bj=C3=B8rn Hansen wrote:</div= ><blockquote type=3D"cite" id=3D"m_864504207540620792m_6213522058571145360m= _7020529434666707989m_832795999474040619qt"><div><br></div><div>We rebuilt = the primary CPAN mirror source over the last weeks. (It=E2=80=99s now in Ku= bernetes and operated via git, including the current version of the various= decades old tools maintaining metadata).</div><div><br></div><div>I tried = pretty hard to make sure the RRR recent data was accurate, but I had to rel= earn a bit about how it works in the process so the files had some erroneou= s epochs for a few days.</div><div><br></div><div>Maybe metacpan needs a on= etime full rsync (or the rrr client restarted?)</div><div><br></div><div><b= r></div><div>Ask</div></blockquote><div><br></div><div id=3D"m_864504207540= 620792m_6213522058571145360m_7020529434666707989m_832795999474040619sig1215= 18600"><div>--</div><div><span style=3D"font-family:monospace"><span style= =3D"font-size:16px"><span>Olaf Alders</span></span></span></div><div style= =3D"color:rgb(32,33,36);font-family:Arial,Helvetica,sans-serif;font-size:sm= all;font-style:normal;font-variant-ligatures:normal;font-variant-caps:norma= l;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;te= xt-transform:none;word-spacing:0px;text-decoration-style:initial;text-decor= ation-color:initial"><div><span style=3D"font-family:monospace"><span style= =3D"font-size:16px"><span></span></span></span><br></div><div><div><span st= yle=3D"font-family:monospace"><span style=3D"font-size:16px"><span>=F0=9F= =93=AE <span style=3D"color:rgb(255,255,255)"><a href=3D"mailto:olaf@wunder= solutions.com" target=3D"_blank">[email protected]</a></span></span>= </span></span></div><div><span style=3D"font-family:monospace"><span style= =3D"font-size:16px"><span><span style=3D"color:rgb(255,255,255)"></span>=F0= =9F=9A=80 <a href=3D"https://prettygoodping.com/" target=3D"_blank">https:/= /prettygoodping.com</a></span></span></span></div></div></div><div><br></di= v></div><div><br></div></div></blockquote></div> </blockquote></div> </blockquote></div> </blockquote></div> --0000000000009eeb1c0642571a6e--