[rancid] Improving Rancid's processing speed when having 1k+ devices

Florin Vlad Olariu <[email protected]> Thu, 25 Jul 2019 14:29:37 +0200
Newsgroups gmane.network.rancid
Message-ID <CAJ+sFVHPM1x_T-7-fTq9a_jhb4We__p+7Wh5CZc2kNNUPh0Gjw@mail.gmail.com>
--===============8871064493436576581==
Content-Type: multipart/alternative; boundary="00000000000041a15d058e809422"

--00000000000041a15d058e809422
Content-Type: text/plain; charset="UTF-8"

Well, as per title, is there any way to improve rancid's speed with so many
devices? At the moment I set PAR_COUNT to 300, so it will connect in
parallel to 300 devices at a time, but the reality is that most time does
not seem to be taken by connecting and retrieving config but by what
happens next in the file processing and git-comitting.

To give you some stats, with current settings it takes around 9 minutes to
do 1200 devices. I have only 1 group with all devices under the same group.

Any trick you might have, please let me know!

Thanks,

Vlad

--00000000000041a15d058e809422
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<html><head><style>body{font-family:Helvetica,Arial;font-size:13px}</style>=
</head><body><div style=3D"font-family:Helvetica,Arial;font-size:13px">Well=
, as per title, is there any way to improve rancid&#39;s speed with so many=
 devices? At the moment I set PAR_COUNT to 300, so it will connect in paral=
lel to 300 devices at a time, but the reality is that most time does not se=
em to be taken by connecting and retrieving config but by what happens next=
 in the file processing and git-comitting.</div><div style=3D"font-family:H=
elvetica,Arial;font-size:13px"><br></div><div style=3D"font-family:Helvetic=
a,Arial;font-size:13px">To give you some stats, with current settings it ta=
kes around 9 minutes to do 1200 devices. I have only 1 group with all devic=
es under the same group.</div><div style=3D"font-family:Helvetica,Arial;fon=
t-size:13px"><br></div><div style=3D"font-family:Helvetica,Arial;font-size:=
13px">Any trick you might have, please let me know!</div><div style=3D"font=
-family:Helvetica,Arial;font-size:13px"><br></div><div style=3D"font-family=
:Helvetica,Arial;font-size:13px">Thanks,</div><div style=3D"font-family:Hel=
vetica,Arial;font-size:13px"><br></div><div style=3D"font-family:Helvetica,=
Arial;font-size:13px">Vlad</div><br><div class=3D"gmail_signature">=C2=A0<b=
r></div></body></html>

--00000000000041a15d058e809422--


--===============8871064493436576581==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Rancid-discuss mailing list
[email protected]
http://www.shrubbery.net/mailman/listinfo/rancid-discuss

--===============8871064493436576581==--