Re: big jum in cpu usage
Luca Deri <[email protected]> Tue, 23 Nov 2021 08:40:50 +0100
| Newsgroups | gmane.linux.ntop.devel |
|---|---|
| Message-ID | <[email protected]> |
--===============0834152927634357850== Content-Type: multipart/alternative; boundary="Apple-Mail=_1C19322C-816F-46D5-80C2-86F5644EED24" --Apple-Mail=_1C19322C-816F-46D5-80C2-86F5644EED24 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi Steve first of all we encourage you to move to our Discord/Telegram system as = we are discontinuing the mailing list: https://www.ntop.org/community/ As of the CPU jump this is due to the fact that we have removed Lua VMs = reuse as this was causing crashes. This means that every time we spawn a = Lua VM we reload the files and thus the load. In particular for = high-frequency tasks as the second (a new VM is created every second) = you will see this jump). We plan to address this problem (see = https://github.com/ntop/ntopng/issues/6091) as some users already = complained but on the other hand ntopng is now rock solid (again without = heavy load you won=E2=80=99t note anything). Regards Luca > On 18 Nov 2021, at 19:51, Steve Clark <[email protected]> = wrote: >=20 > Replying to my own email I have narrowed it down to bewteen: > ntopng-5.0.210927-14747.x86_64 > and > ntopng-5.0.211108-14756.x86_64 >=20 > cpu usage went from 210927 being: > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ = COMMAND =20 > 589 nobody 20 0 1816004 308460 31228 S 1.6 7.9 150:24.60 = ntopng =20 > 590 nobody 20 0 1816004 308460 31228 S 1.6 7.9 152:03.58 = ntopng =20 > 591 nobody 20 0 1816004 308460 31228 S 1.6 7.9 150:17.51 = ntopng =20 > 14993 root 20 0 162404 2572 1600 R 1.3 0.1 0:04.92 top = =20 > 578 nobody 20 0 1816004 308460 31228 S 0.7 7.9 80:57.80 = second.lua =20 > 15188 root 20 0 162204 2364 1580 S 0.7 0.1 0:02.42 top = =20 > 552 nobody 20 0 1816004 308460 31228 S 0.3 7.9 1:43.76 = ntopng =20 > 585 nobody 20 0 1816004 308460 31228 S 0.3 7.9 20:28.69 = notifications.l >=20 > to on 211108 > 12606 ntopng 20 0 1668936 179032 14940 S 29.4 9.5 2:17.72 = timeseries.lua =20 > 12600 ntopng 20 0 1668936 179032 14940 S 25.7 9.5 2:12.39 = second.lua =20 > 12570 ntopng 20 0 1668936 179032 14940 S 13.9 9.5 0:24.64 = ntopng =20 > 12568 ntopng 20 0 1668936 179032 14940 S 12.2 9.5 0:25.75 = ntopng =20 > 12594 ntopng 20 0 1668936 179032 14940 S 11.9 9.5 1:01.39 = notifications.l =20 > 12596 ntopng 20 0 1668936 179032 14940 S 11.6 9.5 0:36.00 = discover.lua =20 > 12590 ntopng 20 0 1668936 179032 14940 R 10.6 9.5 0:17.90 = stats_update.lu =20 > 12595 ntopng 20 0 1668936 179032 14940 R 9.2 9.5 0:40.34 = periodic_checks =20 > 12611 ntopng 20 0 1668936 179032 14940 S 2.0 9.5 0:10.17 = ntopng >=20 >=20 > On 11/18/21 8:39 AM, Steve Clark wrote: >> Hi, >>=20 >> I just updated from >> ---> Package ntopng.x86_64 0:5.0.210820-14716 will be updated >> ---> Package ntopng.x86_64 0:5.0.211117-14757 will be an update >>=20 >> an I see a major jump in cpu usage.=20 >> before : >> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ = COMMAND >> 16550 ntopng 20 0 2775480 201056 15340 S 2.6 5.2 1:35.32 = ntopng - from top 2.6 >> Now: >> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ = COMMAND >> 28178 ntopng 20 0 2791776 235676 16896 S 190.5 6.1 21:42.67 = ntopng=20 >>=20 >> --=20 >> Stephen Clark >> NetWolves Managed Services, LLC. >> Sr. Applications Architect=20 >> Phone: 813-579-3200 >> Fax: 813-882-0209 >> Email: [email protected] <mailto:[email protected]> >> http://www.netwolves.com <http://www.netwolves.com/> >>=20 >> Email Confidentiality Notice: The information contained in this = transmission may contain privileged and confidential and/or protected = health information (PHI) and may be subject to protection under the law, = including the Health Insurance Portability and Accountability Act of = 1996, as amended (HIPAA). This transmission is intended for the sole use = of the individual or entity to whom it is addressed. If you are not the = intended recipient, you are notified that any use, dissemination, = distribution, printing or copying of this transmission is strictly = prohibited and may subject you to criminal or civil penalties. If you = have received this transmission in error, please contact the sender = immediately and delete this email and any attachments from any computer. = Vaso Corporation and its subsidiary companies are not responsible for = data leaks that result from email messages received that contain = privileged and confidential and/or protected health information (PHI).=20= >>=20 >> _______________________________________________ >> Ntop-dev mailing list >> [email protected] <mailto:[email protected]> >> http://listgateway.unipi.it/mailman/listinfo/ntop-dev = <http://listgateway.unipi.it/mailman/listinfo/ntop-dev> >=20 > --=20 > Stephen Clark > NetWolves Managed Services, LLC. > Sr. Applications Architect=20 > Phone: 813-579-3200 > Fax: 813-882-0209 > Email: [email protected] <mailto:[email protected]> > http://www.netwolves.com <http://www.netwolves.com/> >=20 > Email Confidentiality Notice: The information contained in this = transmission may contain privileged and confidential and/or protected = health information (PHI) and may be subject to protection under the law, = including the Health Insurance Portability and Accountability Act of = 1996, as amended (HIPAA). This transmission is intended for the sole use = of the individual or entity to whom it is addressed. If you are not the = intended recipient, you are notified that any use, dissemination, = distribution, printing or copying of this transmission is strictly = prohibited and may subject you to criminal or civil penalties. If you = have received this transmission in error, please contact the sender = immediately and delete this email and any attachments from any computer. = Vaso Corporation and its subsidiary companies are not responsible for = data leaks that result from email messages received that contain = privileged and confidential and/or protected health information (PHI). > _______________________________________________ > Ntop-dev mailing list > [email protected] > http://listgateway.unipi.it/mailman/listinfo/ntop-dev --Apple-Mail=_1C19322C-816F-46D5-80C2-86F5644EED24 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">Hi = Steve<div class=3D"">first of all we encourage you to move to our = Discord/Telegram system as we are discontinuing the mailing = list: <a href=3D"https://www.ntop.org/community/" = class=3D"">https://www.ntop.org/community/</a></div><div class=3D""><br = class=3D""></div><div class=3D"">As of the CPU jump this is due to the = fact that we have removed Lua VMs reuse as this was causing crashes. = This means that every time we spawn a Lua VM we reload the files and = thus the load. In particular for high-frequency tasks as the second (a = new VM is created every second) you will see this jump). We plan to = address this problem (see <a = href=3D"https://github.com/ntop/ntopng/issues/6091" = class=3D"">https://github.com/ntop/ntopng/issues/6091</a>) as some users = already complained but on the other hand ntopng is now rock solid (again = without heavy load you won=E2=80=99t note anything).</div><div = class=3D""><br class=3D""></div><div class=3D"">Regards Luca</div><div = class=3D""><br class=3D""></div><div class=3D""><br class=3D""><div><br = class=3D""><blockquote type=3D"cite" class=3D""><div class=3D"">On 18 = Nov 2021, at 19:51, Steve Clark <<a = href=3D"mailto:[email protected]" = class=3D"">[email protected]</a>> wrote:</div><br = class=3D"Apple-interchange-newline"><div class=3D""> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dutf-8" = class=3D""> <div text=3D"#000000" bgcolor=3D"#FFFFFF" class=3D""> <div class=3D"moz-cite-prefix">Replying to my own email I have narrowed = it down to bewteen:<br class=3D""> ntopng-5.0.210927-14747.x86_64<br class=3D""> and<br class=3D""> ntopng-5.0.211108-14756.x86_64<br class=3D""> <br class=3D""> cpu usage went from 210927 being:<br class=3D""> <tt class=3D""> PID USER PR = NI VIRT RES SHR S = %CPU %MEM TIME+ = COMMAND &= nbsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D""> 589 nobody 20 0 = 1816004 308460 31228 S 1.6 7.9 150:24.60 = ntopng &n= bsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D""> 590 nobody 20 0 = 1816004 308460 31228 S 1.6 7.9 152:03.58 = ntopng &n= bsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D""> 591 nobody 20 0 = 1816004 308460 31228 S 1.6 7.9 150:17.51 = ntopng &n= bsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D"">14993 root = 20 0 162404 2572 1600 R = 1.3 0.1 0:04.92 = top  = ; &= nbsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D""> 578 nobody 20 0 = 1816004 308460 31228 S 0.7 7.9 80:57.80 = second.lua &nbs= p; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D"">15188 root = 20 0 162204 2364 1580 S = 0.7 0.1 0:02.42 = top  = ; &= nbsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D""> 552 nobody 20 0 = 1816004 308460 31228 S 0.3 7.9 1:43.76 = ntopng &n= bsp; </tt><tt class=3D""><br class=3D""> </tt><tt class=3D""> 585 nobody 20 0 = 1816004 308460 31228 S 0.3 7.9 20:28.69 = notifications.l<br class=3D""> <br class=3D""> to on</tt><tt class=3D""> 211108<br class=3D""> 12606 ntopng 20 0 1668936 179032 = 14940 S 29.4 9.5 2:17.72 = timeseries.lua <br class=3D""> 12600 ntopng 20 0 1668936 179032 = 14940 S 25.7 9.5 2:12.39 = second.lua <br class=3D""> 12570 ntopng 20 0 1668936 179032 = 14940 S 13.9 9.5 0:24.64 = ntopng &n= bsp; <br class=3D""> 12568 ntopng 20 0 1668936 179032 = 14940 S 12.2 9.5 0:25.75 = ntopng &n= bsp; <br class=3D""> 12594 ntopng 20 0 1668936 179032 = 14940 S 11.9 9.5 1:01.39 = notifications.l <br class=3D""> 12596 ntopng 20 0 1668936 179032 = 14940 S 11.6 9.5 0:36.00 = discover.lua <br class=3D""> 12590 ntopng 20 0 1668936 179032 = 14940 R 10.6 9.5 0:17.90 <a = href=3D"http://stats_update.lu" = class=3D"">stats_update.lu</a> <br class=3D""> 12595 ntopng 20 0 1668936 179032 = 14940 R 9.2 9.5 0:40.34 = periodic_checks <br class=3D""> 12611 ntopng 20 0 1668936 179032 = 14940 S 2.0 9.5 0:10.17 ntopng<br class=3D""> <br class=3D""> <br class=3D""> </tt>On 11/18/21 8:39 AM, Steve Clark wrote:<br class=3D""> </div> <blockquote type=3D"cite" = cite=3D"mid:[email protected]" = class=3D""> Hi,<br class=3D""> <br class=3D""> I just updated from<br class=3D""> ---> Package ntopng.x86_64 0:5.0.210820-14716 will be updated<br = class=3D""> ---> Package ntopng.x86_64 0:5.0.211117-14757 will be an update<br = class=3D""> <br class=3D""> an I see a major jump in cpu usage. <br class=3D""> before :<br class=3D""> PID USER PR NI = VIRT RES SHR S %CPU = %MEM TIME+ COMMAND<br class=3D""> 16550 ntopng 20 0 2775480 201056 = 15340 S 2.6 5.2 1:35.32 ntopng - from top = 2.6<br class=3D""> Now:<br class=3D""> PID USER PR NI = VIRT RES SHR S %CPU = %MEM TIME+ COMMAND<br class=3D""> 28178 ntopng 20 0 2791776 235676 = 16896 S 190.5 6.1 21:42.67 ntopng <br class=3D""> <br class=3D""> <div class=3D"moz-signature">-- <br class=3D""> Stephen Clark<br class=3D""> <b class=3D"">NetWolves Managed Services, LLC.</b><br class=3D""> Sr. Applications Architect <br class=3D""> Phone: 813-579-3200<br class=3D""> Fax: 813-882-0209<br class=3D""> Email: <a class=3D"moz-txt-link-abbreviated" = href=3D"mailto:[email protected]" = moz-do-not-send=3D"true">[email protected]</a><br class=3D""> <a class=3D"moz-txt-link-freetext" href=3D"http://www.netwolves.com/" = moz-do-not-send=3D"true">http://www.netwolves.com</a><br class=3D""> <br class=3D""> </div> Email Confidentiality Notice: The information contained in this = transmission may contain privileged and confidential and/or protected = health information (PHI) and may be subject to protection under the law, = including the Health Insurance Portability and Accountability Act of 1996, as amended (HIPAA). This transmission is intended for the = sole use of the individual or entity to whom it is addressed. If you are = not the intended recipient, you are notified that any use, = dissemination, distribution, printing or copying of this transmission is strictly prohibited and may subject you to criminal or = civil penalties. If you have received this transmission in error, please = contact the sender immediately and delete this email and any attachments = from any computer. Vaso Corporation and its subsidiary companies are not responsible for data leaks that result = from email messages received that contain privileged and confidential = and/or protected health information (PHI). <br class=3D""> <fieldset class=3D"mimeAttachmentHeader"></fieldset> <pre class=3D"moz-quote-pre" = wrap=3D"">_______________________________________________ Ntop-dev mailing list <a class=3D"moz-txt-link-abbreviated" = href=3D"mailto:[email protected]">[email protected]= t</a> <a class=3D"moz-txt-link-freetext" = href=3D"http://listgateway.unipi.it/mailman/listinfo/ntop-dev">http://list= gateway.unipi.it/mailman/listinfo/ntop-dev</a></pre> </blockquote> <br class=3D""> <br class=3D""> <div class=3D"moz-signature">-- <br class=3D""> Stephen Clark<br class=3D""> <b class=3D"">NetWolves Managed Services, LLC.</b><br class=3D""> Sr. Applications Architect <br class=3D""> Phone: 813-579-3200<br class=3D""> Fax: 813-882-0209<br class=3D""> Email: <a class=3D"moz-txt-link-abbreviated" = href=3D"mailto:[email protected]">[email protected]</a><br= class=3D""> <a class=3D"moz-txt-link-freetext" = href=3D"http://www.netwolves.com">http://www.netwolves.com</a><br = class=3D""> <br class=3D""> </div> Email Confidentiality Notice: The information contained in this = transmission may contain privileged and confidential and/or protected = health information (PHI) and may be subject to protection under the law, = including the Health Insurance Portability and Accountability Act of 1996, as amended (HIPAA). This transmission is intended for the = sole use of the individual or entity to whom it is addressed. If you are = not the intended recipient, you are notified that any use, = dissemination, distribution, printing or copying of this transmission is strictly prohibited and may subject you to criminal or = civil penalties. If you have received this transmission in error, please = contact the sender immediately and delete this email and any attachments = from any computer. Vaso Corporation and its subsidiary companies are not responsible for data leaks that result = from email messages received that contain privileged and confidential = and/or protected health information (PHI). </div> _______________________________________________<br class=3D"">Ntop-dev = mailing list<br class=3D""><a = href=3D"mailto:[email protected]" = class=3D"">[email protected]</a><br = class=3D"">http://listgateway.unipi.it/mailman/listinfo/ntop-dev</div></bl= ockquote></div><br class=3D""></div></body></html>= --Apple-Mail=_1C19322C-816F-46D5-80C2-86F5644EED24-- --===============0834152927634357850== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Ntop-dev mailing list [email protected] http://listgateway.unipi.it/mailman/listinfo/ntop-dev --===============0834152927634357850==--