PHP4 & mod_fastcgi (upgrade problem)

Hi

For years we have been using Apache 1.3, suexec and mod_fastcgi to execute
PHP scripts fast and secure.

About a month ago we upgraded from mod_fastcgi 2.2.10 to 2.4.2 (we use the
Debian packages - but it seems like they contain no changes to the code),
and since then we've had a lot of internal server errors due to
"incomplete headers". 

When the problem occurs Apache's error looks like this:
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19602) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19544) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19598) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18641) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19082) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19529) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19845) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18607) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18654) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19898) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19970) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18625) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19098) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18620) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18605) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19931) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18633) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19646) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19210) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19621) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18626) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19057) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18631) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19480) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18612) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19198) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19923) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18637) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19139) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18773) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19626) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19486) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18616) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18609) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19516) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19130) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19141) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18646) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18610) termination signaled
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19931) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19923) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19898) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19626) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19970) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19845) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19646) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19621) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19602) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19598) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19544) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19529) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19516) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19486) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19480) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19210) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19198) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19141) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19139) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19130) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19098) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19082) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 19057) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18654) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18646) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18641) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18637) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18633) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18631) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18626) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18625) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18620) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18616) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18612) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18610) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18609) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18607) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18605) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:43 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (pid 18773) terminated due to uncaught signal '15' (Terminated)
[Mon Aug  8 00:14:44 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" (uid 119107, gid 120525) restarted (pid 20015)
[Mon Aug  8 00:14:45 2005] [error] [client 81.192.91.76] FastCGI:
incomplete headers (0 bytes) received from server
"/usr/lib/apache/suexec-allowed-bins/php4wrapper"

php4wrapper is a small program that starts php4 with an appropriate
configuration file.

On some of our servers the problem (the "incomplete headers") only happens
three times per hour, on others it's more than twice per minute (averaged
over a day, it seems to be load dependent).

I've googled a lot to find an explanation, and found various threads from
this list describing somewhat similar problems. I don't believe it have
understood the problem though.

My current understanding is that the problem happens because the php
scripts doesn't handle the SIGTERM it gets from the fastcgi process
manager, but if that's correct it means that all PHP scripts would have to
handle SIGTERM to be able to run as FastCGI, and then I would think others
would have noticed.

So what happens and what can we do about it?

Another problem (possibly related, possibly not a real problem at all) we
are seeing are lines like the following in apache's error.log: 
[Fri Aug  5 03:31:25 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" has failed to remain running for 30 seconds given 3 attempts, its restart interval has been backed off to 600 seconds
[Fri Aug  5 03:31:25 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" has failed to remain running for 30 seconds given 3 attempts, its restart interval has been backed off to 600 seconds
[Fri Aug  5 03:31:26 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" has failed to remain running for 30 seconds given 3 attempts, its restart interval has been backed off to 600 seconds
[Fri Aug  5 03:31:27 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" has failed to remain running for 30 seconds given 3 attempts, its restart interval has been backed off to 600 seconds
[Fri Aug  5 03:31:27 2005] [warn] FastCGI: (dynamic) server "/usr/lib/apache/suexec-allowed-bins/php4wrapper" has failed to remain running for 30 seconds given 3 attempts, its restart interval has been backed off to 600 seconds

(That friday there were 7047 occurences of this error in the log file on
that server).

.Henrik


___________________________________
fastcgi-developers mailing list
http://fastcgi.com/fastcgi-developers/