Re: [rancid] Improving Rancid's processing speed when having 1k+ devices
Emille Blanc <[email protected]> Thu, 25 Jul 2019 08:14:28 -0700
| Newsgroups | gmane.network.rancid |
|---|---|
| Message-ID | <4FBAFC2ECF5D6244BA4A26C1C94A1E271528FFD3F3@exchange> |
--===============3420908365564801629== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_4FBAFC2ECF5D6244BA4A26C1C94A1E271528FFD3F3exchange_" --_000_4FBAFC2ECF5D6244BA4A26C1C94A1E271528FFD3F3exchange_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I've seen/heard stories of people pre-empting rancid with an snmp-get of th= e config-last-changed / last committed OID, to generate a list of devices t= o run against. Have always wanted to set that up for our instance as we are approaching th= e 500 device mark, but it's not become a big enough problem for us... yet. From: Rancid-discuss [mailto:[email protected]] On Behal= f Of Florin Vlad Olariu Sent: Thursday, July 25, 2019 5:30 AM To: [email protected] Subject: [rancid] Improving Rancid's processing speed when having 1k+ devic= es Well, as per title, is there any way to improve rancid's speed with so many= devices? At the moment I set PAR_COUNT to 300, so it will connect in paral= lel to 300 devices at a time, but the reality is that most time does not se= em to be taken by connecting and retrieving config but by what happens next= in the file processing and git-comitting. To give you some stats, with current settings it takes around 9 minutes to = do 1200 devices. I have only 1 group with all devices under the same group. Any trick you might have, please let me know! Thanks, Vlad --_000_4FBAFC2ECF5D6244BA4A26C1C94A1E271528FFD3F3exchange_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:x=3D"urn:schemas-microsoft-com:office:excel" xmlns:p=3D"urn:schemas-m= icrosoft-com:office:powerpoint" xmlns:a=3D"urn:schemas-microsoft-com:office= :access" xmlns:dt=3D"uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:s=3D"= uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" xmlns:rs=3D"urn:schemas-microsof= t-com:rowset" xmlns:z=3D"#RowsetSchema" xmlns:b=3D"urn:schemas-microsoft-co= m:office:publisher" xmlns:ss=3D"urn:schemas-microsoft-com:office:spreadshee= t" xmlns:c=3D"urn:schemas-microsoft-com:office:component:spreadsheet" xmlns= :odc=3D"urn:schemas-microsoft-com:office:odc" xmlns:oa=3D"urn:schemas-micro= soft-com:office:activation" xmlns:html=3D"http://www.w3.org/TR/REC-html40" = xmlns:q=3D"http://schemas.xmlsoap.org/soap/envelope/" xmlns:rtc=3D"http://m= icrosoft.com/officenet/conferencing" xmlns:D=3D"DAV:" xmlns:Repl=3D"http://= schemas.microsoft.com/repl/" xmlns:mt=3D"http://schemas.microsoft.com/share= point/soap/meetings/" xmlns:x2=3D"http://schemas.microsoft.com/office/excel= /2003/xml" xmlns:ppda=3D"http://www.passport.com/NameSpace.xsd" xmlns:ois= =3D"http://schemas.microsoft.com/sharepoint/soap/ois/" xmlns:dir=3D"http://= schemas.microsoft.com/sharepoint/soap/directory/" xmlns:ds=3D"http://www.w3= .org/2000/09/xmldsig#" xmlns:dsp=3D"http://schemas.microsoft.com/sharepoint= /dsp" xmlns:udc=3D"http://schemas.microsoft.com/data/udc" xmlns:xsd=3D"http= ://www.w3.org/2001/XMLSchema" xmlns:sub=3D"http://schemas.microsoft.com/sha= repoint/soap/2002/1/alerts/" xmlns:ec=3D"http://www.w3.org/2001/04/xmlenc#"= xmlns:sp=3D"http://schemas.microsoft.com/sharepoint/" xmlns:sps=3D"http://= schemas.microsoft.com/sharepoint/soap/" xmlns:xsi=3D"http://www.w3.org/2001= /XMLSchema-instance" xmlns:udcs=3D"http://schemas.microsoft.com/data/udc/so= ap" xmlns:udcxf=3D"http://schemas.microsoft.com/data/udc/xmlfile" xmlns:udc= p2p=3D"http://schemas.microsoft.com/data/udc/parttopart" xmlns:wf=3D"http:/= /schemas.microsoft.com/sharepoint/soap/workflow/" xmlns:dsss=3D"http://sche= mas.microsoft.com/office/2006/digsig-setup" xmlns:dssi=3D"http://schemas.mi= crosoft.com/office/2006/digsig" xmlns:mdssi=3D"http://schemas.openxmlformat= s.org/package/2006/digital-signature" xmlns:mver=3D"http://schemas.openxmlf= ormats.org/markup-compatibility/2006" xmlns:m=3D"http://schemas.microsoft.c= om/office/2004/12/omml" xmlns:mrels=3D"http://schemas.openxmlformats.org/pa= ckage/2006/relationships" xmlns:spwp=3D"http://microsoft.com/sharepoint/web= partpages" xmlns:ex12t=3D"http://schemas.microsoft.com/exchange/services/20= 06/types" xmlns:ex12m=3D"http://schemas.microsoft.com/exchange/services/200= 6/messages" xmlns:pptsl=3D"http://schemas.microsoft.com/sharepoint/soap/Sli= deLibrary/" xmlns:spsl=3D"http://microsoft.com/webservices/SharePointPortal= Server/PublishedLinksService" xmlns:Z=3D"urn:schemas-microsoft-com:" xmlns:= st=3D"" xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta http-equi= v=3DContent-Type content=3D"text/html; charset=3Dus-ascii"><meta name=3DPro= gId content=3DWord.Document><meta name=3DGenerator content=3D"Microsoft Wor= d 12"><meta name=3DOriginator content=3D"Microsoft Word 12"><link rel=3DFil= e-List href=3D"cid:[email protected]"><!--[if gte mso 9]><xml> <o:OfficeDocumentSettings> <o:AllowPNG/> <o:TargetScreenSize>1024x768</o:TargetScreenSize> </o:OfficeDocumentSettings> </xml><![endif]--><!--[if gte mso 9]><xml> <w:WordDocument> <w:Zoom>120</w:Zoom> <w:TrackMoves/> <w:TrackFormatting/> <w:EnvelopeVis/> <w:ValidateAgainstSchemas/> <w:SaveIfXMLInvalid>false</w:SaveIfXMLInvalid> <w:IgnoreMixedContent>false</w:IgnoreMixedContent> <w:AlwaysShowPlaceholderText>false</w:AlwaysShowPlaceholderText> <w:DoNotPromoteQF/> <w:LidThemeOther>EN-US</w:LidThemeOther> <w:LidThemeAsian>X-NONE</w:LidThemeAsian> <w:LidThemeComplexScript>X-NONE</w:LidThemeComplexScript> <w:Compatibility> <w:DoNotExpandShiftReturn/> <w:BreakWrappedTables/> <w:SnapToGridInCell/> <w:WrapTextWithPunct/> <w:UseAsianBreakRules/> <w:DontGrowAutofit/> <w:SplitPgBreakAndParaMark/> <w:DontVertAlignCellWithSp/> <w:DontBreakConstrainedForcedTables/> <w:DontVertAlignInTxbx/> <w:Word11KerningPairs/> <w:CachedColBalance/> </w:Compatibility> <w:BrowserLevel>MicrosoftInternetExplorer4</w:BrowserLevel> <m:mathPr> <m:mathFont m:val=3D"Cambria Math"/> <m:brkBin m:val=3D"before"/> <m:brkBinSub m:val=3D"--"/> <m:smallFrac m:val=3D"off"/> <m:dispDef/> <m:lMargin m:val=3D"0"/> <m:rMargin m:val=3D"0"/> <m:defJc m:val=3D"centerGroup"/> <m:wrapIndent m:val=3D"1440"/> <m:intLim m:val=3D"subSup"/> <m:naryLim m:val=3D"undOvr"/> </m:mathPr></w:WordDocument> </xml><![endif]--><!--[if gte mso 9]><xml> <w:LatentStyles DefLockedState=3D"false" DefUnhideWhenUsed=3D"true" DefSemi= Hidden=3D"true" DefQFormat=3D"false" DefPriority=3D"99" LatentStyleCount=3D= "267"> <w:LsdException Locked=3D"false" Priority=3D"0" SemiHidden=3D"false" Unhide= WhenUsed=3D"false" QFormat=3D"true" Name=3D"Normal"/> <w:LsdException Locked=3D"false" Priority=3D"9" SemiHidden=3D"false" Unhide= WhenUsed=3D"false" QFormat=3D"true" Name=3D"heading 1"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 2"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 3"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 4"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 5"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 6"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 7"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 8"/> <w:LsdException Locked=3D"false" Priority=3D"9" QFormat=3D"true" Name=3D"he= ading 9"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 1"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 2"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 3"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 4"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 5"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 6"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 7"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 8"/> <w:LsdException Locked=3D"false" Priority=3D"39" Name=3D"toc 9"/> <w:LsdException Locked=3D"false" Priority=3D"35" QFormat=3D"true" Name=3D"c= aption"/> <w:LsdException Locked=3D"false" Priority=3D"10" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Title"/> <w:LsdException Locked=3D"false" Priority=3D"1" Name=3D"Default Paragraph F= ont"/> <w:LsdException Locked=3D"false" Priority=3D"11" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Subtitle"/> <w:LsdException Locked=3D"false" Priority=3D"22" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Strong"/> <w:LsdException Locked=3D"false" Priority=3D"20" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Emphasis"/> <w:LsdException Locked=3D"false" Priority=3D"59" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Table Grid"/> <w:LsdException Locked=3D"false" UnhideWhenUsed=3D"false" Name=3D"Placehold= er Text"/> <w:LsdException Locked=3D"false" Priority=3D"1" SemiHidden=3D"false" Unhide= WhenUsed=3D"false" QFormat=3D"true" Name=3D"No Spacing"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1 Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2 Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1 Accent 1"/> <w:LsdException Locked=3D"false" UnhideWhenUsed=3D"false" Name=3D"Revision"= /> <w:LsdException Locked=3D"false" Priority=3D"34" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"List Paragraph"/> <w:LsdException Locked=3D"false" Priority=3D"29" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Quote"/> <w:LsdException Locked=3D"false" Priority=3D"30" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Intense Quote"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2 Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1 Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2 Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3 Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid Accent 1"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3 Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid Accent 2"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3 Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid Accent 3"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3 Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid Accent 4"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3 Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid Accent 5"/> <w:LsdException Locked=3D"false" Priority=3D"60" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Shading Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"61" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light List Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"62" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Light Grid Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"63" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 1 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"64" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Shading 2 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"65" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 1 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"66" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium List 2 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"67" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 1 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"68" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 2 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"69" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Medium Grid 3 Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"70" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Dark List Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"71" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Shading Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"72" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful List Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"73" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" Name=3D"Colorful Grid Accent 6"/> <w:LsdException Locked=3D"false" Priority=3D"19" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Subtle Emphasis"/> <w:LsdException Locked=3D"false" Priority=3D"21" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Intense Emphasis"/> <w:LsdException Locked=3D"false" Priority=3D"31" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Subtle Reference"/> <w:LsdException Locked=3D"false" Priority=3D"32" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Intense Reference"/> <w:LsdException Locked=3D"false" Priority=3D"33" SemiHidden=3D"false" Unhid= eWhenUsed=3D"false" QFormat=3D"true" Name=3D"Book Title"/> <w:LsdException Locked=3D"false" Priority=3D"37" Name=3D"Bibliography"/> <w:LsdException Locked=3D"false" Priority=3D"39" QFormat=3D"true" Name=3D"T= OC Heading"/> </w:LatentStyles> </xml><![endif]--><style><!-- /* Font Definitions */ @font-face {font-family:Helvetica; panose-1:2 11 5 4 2 2 2 3 2 4; mso-font-charset:0; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:7 0 0 0 147 0;} @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4; mso-font-alt:"Calisto MT"; mso-font-charset:0; mso-generic-font-family:roman; mso-font-pitch:variable; mso-font-signature:-536870145 1107305727 0 0 415 0;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4; mso-font-alt:"Century Gothic"; mso-font-charset:0; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:-536870145 1073786111 1 0 415 0;} @font-face {font-family:Tahoma; panose-1:2 11 6 4 3 5 4 4 2 4; mso-font-charset:0; mso-generic-font-family:swiss; mso-font-pitch:variable; mso-font-signature:-520081665 -1073717157 41 0 66047 0;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-unhide:no; mso-style-qformat:yes; mso-style-parent:""; margin:0in; margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman","serif"; mso-fareast-font-family:Calibri;} a:link, span.MsoHyperlink {mso-style-noshow:yes; mso-style-priority:99; color:blue; text-decoration:underline; text-underline:single;} a:visited, span.MsoHyperlinkFollowed {mso-style-noshow:yes; mso-style-priority:99; color:purple; text-decoration:underline; text-underline:single;} span.EmailStyle17 {mso-style-type:personal-reply; mso-style-noshow:yes; mso-style-unhide:no; mso-ansi-font-size:11.0pt; mso-bidi-font-size:11.0pt; font-family:"Calibri","sans-serif"; mso-ascii-font-family:Calibri; mso-fareast-font-family:Calibri; mso-hansi-font-family:Calibri; mso-bidi-font-family:"Times New Roman"; color:#1F497D;} .MsoChpDefault {mso-style-type:export-only; mso-default-props:yes; font-size:10.0pt; mso-ansi-font-size:10.0pt; mso-bidi-font-size:10.0pt;} @page WordSection1 {size:8.5in 11.0in; margin:1.0in 1.0in 1.0in 1.0in; mso-header-margin:.5in; mso-footer-margin:.5in; mso-paper-source:0;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 10]><style>/* Style Definitions */ table.MsoNormalTable {mso-style-name:"Table Normal"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0in 5.4pt 0in 5.4pt; mso-para-margin:0in; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:10.0pt; font-family:"Times New Roman","serif";} </style><![endif]--><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue vli= nk=3Dpurple style=3D'tab-interval:.5in'><div class=3DWordSection1><p class= =3DMsoNormal><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-se= rif";color:#1F497D'>I've seen/heard stories of people pre-empting rancid wi= th an snmp-get of the config-last-changed / last committed OID, to generate= a list of devices to run against.<o:p></o:p></span></p><p class=3DMsoNorma= l><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:= #1F497D'><o:p> </o:p></span></p><p class=3DMsoNormal><span style=3D'fo= nt-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Have alway= s wanted to set that up for our instance as we are approaching the 500 devi= ce mark, but it's not become a big enough problem for us... yet.<o:p></o:p>= </span></p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;font-family= :"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><div><di= v style=3D'border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in= 0in'><p class=3DMsoNormal><b><span style=3D'font-size:10.0pt;font-family:"= Tahoma","sans-serif";mso-fareast-font-family:"Times New Roman"'>From:</span= ></b><span style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-= fareast-font-family:"Times New Roman"'> Rancid-discuss [mailto:rancid-discu= [email protected]] <b>On Behalf Of </b>Florin Vlad Olariu<br><b>Sent= :</b> Thursday, July 25, 2019 5:30 AM<br><b>To:</b> rancid-discuss@shrubber= y.net<br><b>Subject:</b> [rancid] Improving Rancid's processing speed when = having 1k+ devices<o:p></o:p></span></p></div></div><p class=3DMsoNormal><o= :p> </o:p></p><div><p class=3DMsoNormal><span style=3D'font-size:10.0p= t;font-family:"Helvetica","sans-serif";mso-fareast-font-family:"Times New R= oman"'>Well, as per title, is there any way to improve rancid's speed with = so many devices? At the moment I set PAR_COUNT to 300, so it will connect i= n parallel to 300 devices at a time, but the reality is that most time does= not seem to be taken by connecting and retrieving config but by what happe= ns next in the file processing and git-comitting.<o:p></o:p></span></p></di= v><div><p class=3DMsoNormal><span style=3D'font-size:10.0pt;font-family:"He= lvetica","sans-serif";mso-fareast-font-family:"Times New Roman"'><o:p> = ;</o:p></span></p></div><div><p class=3DMsoNormal><span style=3D'font-size:= 10.0pt;font-family:"Helvetica","sans-serif";mso-fareast-font-family:"Times = New Roman"'>To give you some stats, with current settings it takes around 9= minutes to do 1200 devices. I have only 1 group with all devices under the= same group.<o:p></o:p></span></p></div><div><p class=3DMsoNormal><span sty= le=3D'font-size:10.0pt;font-family:"Helvetica","sans-serif";mso-fareast-fon= t-family:"Times New Roman"'><o:p> </o:p></span></p></div><div><p class= =3DMsoNormal><span style=3D'font-size:10.0pt;font-family:"Helvetica","sans-= serif";mso-fareast-font-family:"Times New Roman"'>Any trick you might have,= please let me know!<o:p></o:p></span></p></div><div><p class=3DMsoNormal><= span style=3D'font-size:10.0pt;font-family:"Helvetica","sans-serif";mso-far= east-font-family:"Times New Roman"'><o:p> </o:p></span></p></div><div>= <p class=3DMsoNormal><span style=3D'font-size:10.0pt;font-family:"Helvetica= ","sans-serif";mso-fareast-font-family:"Times New Roman"'>Thanks,<o:p></o:p= ></span></p></div><div><p class=3DMsoNormal><span style=3D'font-size:10.0pt= ;font-family:"Helvetica","sans-serif";mso-fareast-font-family:"Times New Ro= man"'><o:p> </o:p></span></p></div><div><p class=3DMsoNormal><span sty= le=3D'font-size:10.0pt;font-family:"Helvetica","sans-serif";mso-fareast-fon= t-family:"Times New Roman"'>Vlad<o:p></o:p></span></p></div><p class=3DMsoN= ormal><span style=3D'font-size:10.0pt;font-family:"Helvetica","sans-serif";= mso-fareast-font-family:"Times New Roman"'><o:p> </o:p></span></p><div= ><p class=3DMsoNormal><span style=3D'font-size:10.0pt;font-family:"Helvetic= a","sans-serif";mso-fareast-font-family:"Times New Roman"'> <o:p></o:p= ></span></p></div></div></body></html>= --_000_4FBAFC2ECF5D6244BA4A26C1C94A1E271528FFD3F3exchange_-- --===============3420908365564801629== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Rancid-discuss mailing list [email protected] http://www.shrubbery.net/mailman/listinfo/rancid-discuss --===============3420908365564801629==--