Re: cfengine watchdog is not biting

Mike Weilgart <[email protected]> Wed, 21 Feb 2024 17:47:24 -0800 (PST)
Newsgroups gmane.comp.sysutils.cfengine.general
Message-ID <[email protected]>
I opened a pull request: https://github.com/cfengine/masterfiles/pull/2841

Would like some help with testing.  Would be especially great to test on 
some of these systems where the existing pidfile logic isn't working, 
besides testing the usual cases.

Best,
--Mike Weilgart
On Wednesday, February 21, 2024 at 6:59:41 AM UTC-8 [email protected] 
wrote:

> Thanks for filing the ticket. :D
>
> On Tuesday, February 20, 2024 at 6:34:15 AM UTC-6 Xander Cage wrote:
>
>> ticket created -> https://northerntech.atlassian.net/browse/CFE-4335
>>
>>
>> On Tuesday, February 20, 2024 at 11:11:20 AM UTC+1 Xander Cage wrote:
>>
>>> Hi,
>>>
>>> At times the cfengine watchdog script is unable to resolve hanging 
>>> cf-agents. the reason is that if the system is under high load the watchdog 
>>> "hangs" because it reads his own stale pid file and is doing simply 
>>> nothing. 
>>>
>>> example:
>>>
>>> i had 332 hanging cf-agent processe but the watchdog log just shows this.
>>>
>>> Tue Feb 20 10:57:00 CET 2024 Initiating watchdog 6816488
>>> Tue Feb 20 10:57:00 CET 2024 Aborting execution of watchdog 6816488, 
>>> existing watchdog process 16450014 running
>>> Tue Feb 20 10:58:00 CET 2024 Initiating watchdog 44499432
>>> Tue Feb 20 10:58:00 CET 2024 Aborting execution of watchdog 44499432, 
>>> existing watchdog process 16450014 running
>>>
>>> after deleting the pid file...
>>>
>>> Tue Feb 20 10:59:00 CET 2024 Initiating watchdog 25756150
>>> Tue Feb 20 10:59:01 CET 2024 Found cf-execd not running
>>> Tue Feb 20 10:59:03 CET 2024 Found 332 occurrences of cf-execd 
>>> terminating unresponsive cf-agent
>>> Tue Feb 20 10:59:04 CET 2024 Found 2 symptoms, threshold (0) breached.
>>> Tue Feb 20 10:59:06 CET 2024 Initiating apoptosis
>>> Tue Feb 20 10:59:10 CET 2024 Initiating anastasis
>>>
>>> i guess there is room for impovement, as this can bring a system down 
>>> quite easyily.
>>>
>>> wbr
>>>
>>> chris
>>>
>>>

-- 
You received this message because you are subscribed to the Google Groups "help-cfengine" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/help-cfengine/98d87cf8-e9a5-48ca-9c61-fae6d15a7279n%40googlegroups.com.