Nagios check latency

Muhamad Faiz <[email protected]> Tue, 13 Aug 2013 03:49:19 +0000

Newsgroups	gmane.network.nagios.user
Message-ID	<C322DBB5CEB78E47854B9568661B849C34491F74@xch-mbx07.camkmg-bangalore.com>

Hi guys,

My Nagios setup are having high service check latency.

Check nagios latency result is 240 seconds!

./check_nagios_latency.sh -w 30 -c 60
CRITICAL: Latency at 240.183 seconds!

Modification in my Nagios.cfg file is only as below. Other than this, is default.

# MODIFIED
[email protected]
[email protected]
translate_passive_host_checks=1
log_event_handlers=0
use_large_installation_tweaks=1
enable_environment_macros=0
enable_embedded_perl=0
use_embedded_perl_implicitly=0
max_concurrent_checks=1600
service_perfdata_file_processing_command=process-service-perfdata-file-pnp-bulk
host_perfdata_file_processing_command=process-host-perfdata-file-pnp-bulk
service_perfdata_file_processing_interval=60
host_perfdata_file_processing_interval=60
status_update_interval=40


# /usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg

Nagios Core 3.5.0
Copyright (c) 2009-2011 Nagios Core Development Team and Community Contributors
Copyright (c) 1999-2009 Ethan Galstad
Last Modified: 03-15-2013
License: GPL

Website: http://www.nagios.org
Timing information on object configuration processing is listed
below.  You can use this information to see if precaching your
object configuration would be useful.

Object Config Source: Config files (uncached)

OBJECT CONFIG PROCESSING TIMES      (* = Potential for precache savings with -u option)
----------------------------------
Read:                 0.415803 sec
Resolve:              0.006900 sec  *
Recomb Contactgroups: 0.001862 sec  *
Recomb Hostgroups:    3.819786 sec  *
Dup Services:         0.637380 sec  *
Recomb Servicegroups: 3.419804 sec  *
Duplicate:            0.000417 sec  *
Inherit:              0.013748 sec  *
Recomb Contacts:      0.000000 sec  *
Sort:                 0.000000 sec  *
Register:             0.616385 sec
Free:                 0.029930 sec
                      ============
TOTAL:                8.962015 sec  * = 7.899897 sec (88.15%) estimated savings


RETENTION DATA TIMES
----------------------------------
Read and Process:     0.863815 sec
                      ============
TOTAL:                0.863815 sec


Timing information on configuration verification is listed below.

CONFIG VERIFICATION TIMES          (* = Potential for speedup with -x option)
----------------------------------
Object Relationships: 0.080360 sec
Circular Paths:       0.001152 sec  *
Misc:                 0.011244 sec
                      ============
TOTAL:                0.092756 sec  * = 0.001152 sec (1.2%) estimated savings


EVENT SCHEDULING TIMES
-------------------------------------
Get service info:        0.051265 sec
Get host info info:      0.032301 sec
Get service params:      0.000010 sec
Schedule service times:  0.002476 sec
Schedule service events: 0.002514 sec
Get host params:         0.000000 sec
Schedule host times:     0.000937 sec
Schedule host events:    0.001287 sec
                         ============
TOTAL:                   0.090790 sec


Projected scheduling information for host and service checks
is listed below.  This information assumes that you are going
to start running Nagios with your current config files.

HOST SCHEDULING INFORMATION
---------------------------
Total hosts:                     11753
Total scheduled hosts:           7
Host inter-check delay method:   SMART
Average host check interval:     300.00 sec
Host inter-check delay:          42.86 sec
Max host check spread:           30 min
First scheduled check:           Tue Aug 13 11:43:54 2013
Last scheduled check:            Tue Aug 13 11:43:54 2013


SERVICE SCHEDULING INFORMATION
-------------------------------
Total services:                     18662
Total scheduled services:           170
Service inter-check delay method:   SMART
Average service check interval:     535.76 sec
Inter-check delay:                  3.15 sec
Interleave factor method:           SMART
Average services per host:          1.59
Service interleave factor:          1
Max service check spread:           30 min
First scheduled check:              Tue Aug 13 11:52:49 2013
Last scheduled check:               Tue Aug 13 11:58:39 2013


CHECK PROCESSING INFORMATION
----------------------------
Check result reaper interval:       10 sec
Max concurrent service checks:      1600


PERFORMANCE SUGGESTIONS
-----------------------
I have no suggestions - things look okay.

Any advice will be much appreciated.

Regards,
Faiz
"CONFIDENTIALITY NOTICE: This message and any attachment are confidential and may also be privileged. If you are not the intended recipient of this e-mail you may not copy, forward, disclose or otherwise use it or any part of it in any form whatsoever. If you are not the intended recipient please telephone or e-mail the sender and delete this message and any attachment from your system."

------------------------------------------------------------------------------
Get 100% visibility into Java/.NET code with AppDynamics Lite!
It's a free troubleshooting tool designed for production.
Get down to code-level detail for bottlenecks, with <2% overhead. 
Download for free and get started troubleshooting in minutes. 
http://pubads.g.doubleclick.net/gampad/clk?id=48897031&iu=/4140/ostg.clktrk

_______________________________________________
Nagios-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nagios-users
::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. 
::: Messages without supporting info will risk being sent to /dev/null

Faiz.vcf (text/x-vcard, 3 KB)

BEGIN:VCARD
VERSION:2.1
X-MS-SIGNATURE:YES
N;LANGUAGE=en-us:Faiz
FN:Faiz
ORG:YTLC Network Operations Monitoring Team
TEL;WORK;VOICE:+60 192260176
ADR;WORK;PREF:;;;;;;United States of America
X-MS-OL-DEFAULT-POSTAL-ADDRESS:2
EMAIL;PREF;INTERNET:[email protected]
X-MS-IMADDRESS:Skype: me.faiz
X-MS-CARDPICTURE;TYPE=JPEG;ENCODING=BASE64:
 /9j/4AAQSkZJRgABAQEAYABgAAD/2wBDAAcFBQYFBAcGBQYIBwcIChELCgkJChUPEAwRGBUa
 GRgVGBcbHichGx0lHRcYIi4iJSgpKywrGiAvMy8qMicqKyr/2wBDAQcICAoJChQLCxQqHBgc
 KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKir/wAAR
 CAAVADYDASIAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAA
 AgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkK
 FhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWG
 h4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl
 5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREA
 AgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYk
 NOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOE
 hYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk
 5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwD2/wAWnWYNI+1aDciKSAlpUKBg6dyPkY5H
 oBzzXK6d8SW07SpB4hVp7zf+5EcboZV753RoBj8c5rf+IXjOHwV4Ye7ba95NmO0hP8b46kf3
 R1P4DvXinhexuPFE51rU7YLbo5QFIwkckmMkDBXGMg8GvUwdCFWF6i0/F+R5OPxE6WlJ6/gv
 M9w0HxhDrWmz6hPbNYWcLBfOncbWJOPyGRz71uw3ttPGksE8ciO7RqysMMwJBA9SNp/I1hxx
 6VP4HazgdrOxeL7PIIwGdAxww78nJ55POa5+HQfCyqInvnuYY12KkkCuUULsVd2zdtUYwPUZ
 OSa5XTjKUuVNK/qdFKrKNOPPJNtb7Ho2ajEqGQxhxvABK55APfH4GvP4/DfhoTvdSajNKZB8
 knlDcGDlt+4JkuCSNx5xiqmn+HtAtoWa/wBSWSZzmMQwhVj2qFDj5Bhh13ccn8SvYLu/uZbx
 CXb7z0/rRXL+B9Ni03SrlIbmO5SW437o49mMRogzwMkhQScdSaKwlCzsbxqXVzo5LeKfBmiS
 THTeoOKq32lWl/YNazR7Ys5AjO0qfUEdKKKUZNPQc4xcWmiHSdCtdIaQ2jTESYDLJKWGfXnv
 WoEVSSABk5PHWiinKTlK7JpwjGNooasSRghFVQTkgDGSe9SYHoKKKk0sgooooGf/2Q==

X-MS-OL-DESIGN;CHARSET=utf-8:<card xmlns="http://schemas.microsoft.com/office/outlook/12/electronicbusinesscards" ver="1.0" layout="right" bgcolor="ffffff"><img xmlns="" align="midright" area="50" use="cardpicture"/><fld xmlns="" prop="name" align="left" dir="ltr" style="b" color="000000" size="10"/><fld xmlns="" prop="org" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="title" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="dept" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="telwork" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="email" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="addrwork" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="im" align="left" dir="ltr" color="000000" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="blank" size="8"/><fld xmlns="" prop="blank" size="8"/></card>
REV:20121031T020436Z
END:VCARD