Re: Metrics not collecting / No PMCD agent for domain of request messages in pmlogger.log file.

Hi, William -


>    I have attached the pmcd.log. The metrics were not getting
>    collected on the server.  I also noticed the following in the
>    pmcd/linux.log and pmcd/proc.log files [...]
> [...]
> [Mon Jan  2 15:57:02] pmcd(14930) Info: DoFetch: select timeout
> [Mon Jan  2 15:57:02] pmcd(14930) Info: CleanupAgent ...
> Cleanup "proc" agent (dom 3): protocol failure for fd=13
> [Mon Jan  2 15:57:03] pmcd(14930) Info: CleanupAgent ...
> Cleanup "linux" agent (dom 60): protocol failure for fd=17, exit(0)


Yeah, this is a known and old problem: several of our PMDAs time-out
regularly, rendering themselves inoperable until a restart.  The
underlying problems are unsolved (github issues/185, 165, 157, 152,
etc.).

More recent versions of pcp (3.11.2+) can paper over the problem by
automatic restarting of the failed PMDA processes; for even stronger
papering-over, a local "primary pmie" service can do a secondary
automatic PMDA restarting in pcp 3.11.3+.  If you are using neither of
those versions, you may be stuck with a cron-based

   service pmcd restart

periodically.  If you run pmlogger under pmmgr supervision, such a
pmcd restart blip can be scheduled any time, since pmmgr responds
apprx. immediately.  If you run pmlogger under cron (#service pmlogger),
then a prophylactic pmcd restart is best scheduled a few minutes before 
the
     25,55  *  *  *  *  pcp  /usr/libexec/pcp/bin/pmlogger_check -C
times.


>    After restarting the pmcd and pmlogger services the metrics are
>    getting collected again but I am sure that it will stop again.
>    [...]

This is unfortunately, currently, true.


- FChE

-=-=-=-=-=-=-=-=-=-=-=-
Groups.io Links:

You receive all messages sent to this group.

View/Reply Online (#14955): https://groups.io/g/pcp/message/14955
View All Messages In Topic (6): https://groups.io/g/pcp/topic/3838540
Mute This Topic: https://groups.io/mt/3838540?uid=174580
New Topic: https://groups.io/g/pcp/post
-=-=-
pcp mailing list
[email protected]
https://groups.io/g/pcp/messages
-=-=-
Change Your Subscription: https://groups.io/g/pcp/editsub?uid=174580
Group Home: https://groups.io/g/pcp
Contact Group Owner: [email protected]
Terms of Service: https://groups.io/static/tos
Unsubscribe: https://groups.io/g/pcp/leave/354243/563757577/xyzzy
-=-=-=-=-=-=-=-=-=-=-=-