RE: Apache prefork overload caused by Googlebot crawling many host-routed sites
Marc <[email protected]> Wed, 25 Feb 2026 09:15:06 +0000
| Newsgroups | gmane.comp.apache.user |
|---|---|
| Message-ID | <[email protected]> |
QXJlIHlvdSBzdXJlIGl0IGlzIGdvb2dsZWJvdCBhbmQgbm90IGZha2UgYm90cy4gSSBoYXZlIDQw MGsgcmVxdWVzdHMgcGVyIGRheSBmcm9tIHNoaXQgTWljcm9zb2Z0IEF6dXJlIG1vc3RseS4gVHJ5 IGFuZCBmaWx0ZXIgb3V0IHRoZSBjcmFwLCBzbyB5b3UgaGF2ZSBtb3JlIHJlc291cmNlcyBsZWZ0 IGZvciByZWFsIHRyYWZmaWMuDQoNCkkgaGF2ZSBhIGhvbmV5cG90IHBhZ2Ugd2l0aCByb2JvdHMu dHh0LA0KNW0gY3JvbiwgZXZlcnl0aGluZyA+MTAwIHJlcXVlc3RzIGdvZXMgdG8gaXBzZXQgYmxh Y2tsaXN0Lg0KRXZlcnRoaW5nIGJsYWNrbGlzdGVkIGlzIHJlZGljdGVkIHRvIGxpZ2h0d2VpZ2h0 IGh0bWwgb25seSBwYWdlLg0KDQpJIHRoaW5rIHRoaXMgb25seSB3b3JrcyBvbiBpcHY0IGFzIHRo ZXNlIGFyZSBub3QgYWJ1bmRhbnQuDQoNClBTLiBtYXliZSBjcmF3bCBkZWxheSBpbiByb2JvdHM/ DQpQUFMuIHVwZ3JhZGluZyBhbHNvIGhlbHBzIHdpdGggcGVyZm9ybWFuY2UNCg0KDQo+IA0KPiAN Cj4gCUhlbGxvLA0KPiANCj4gCUnigJltIGxvb2tpbmcgZm9yIGFkdmljZSBvbiBoYW5kbGluZyBj cmF3bGVyLWRyaXZlbiBvdmVybG9hZCBpbiBhbg0KPiBBcGFjaGUNCj4gCXByZWZvcmsgZW52aXJv bm1lbnQuDQo+IA0KPiAJRW52aXJvbm1lbnQ6DQo+IAktIEFwYWNoZSBodHRwZCB3aXRoIHByZWZv cmsgTVBNDQo+IAktIENlbnRPUyA3LjQNCj4gCS0gfjIgQ1BVIC8gNCBHQiBSQU0NCj4gCS0gcHJl Zm9yayBtdXN0IHJlbWFpbiBpbiB1c2UNCj4gDQo+IAlBcmNoaXRlY3R1cmUgc3VtbWFyeToNCj4g CS0gTXVsdGlwbGUgbWFpbiBkb21haW5zDQo+IAktIFRlbnMgb2YgdGhvdXNhbmRzIG9mIHZlcnkg c21hbGwgc2l0ZXMsIGVhY2ggd2l0aCBpdHMgb3duIGhvc3RuYW1lDQo+IAktIEFsbCBob3N0bmFt ZXMgYXJlIHJvdXRlZCB0aHJvdWdoIGEgY2VudHJhbCBWaXJ0dWFsSG9zdCB1c2luZw0KPiAJdmhv c3QtbGV2ZWwgcmV3cml0ZSBydWxlcyAobm8gLmh0YWNjZXNzKQ0KPiAJLSBFYWNoIGhvc3RuYW1l IG1hcHMgZHluYW1pY2FsbHkgdG8gYSBkaXJlY3Rvcnkgc3VjaCBhczoNCj4gCS9hcHAvc2l0ZXMv e3VuaXF1ZS1zdWItZG9tYWluLXNsdWd9Lw0KPiANCj4gCVVuZGVyIG5vcm1hbCBjb25kaXRpb25z IHRoZSBzeXN0ZW0gYmVoYXZlcyB3ZWxsLg0KPiANCj4gCUlzc3VlOg0KPiAJV2hlbiBHb29nbGVi b3QgY3Jhd2xzIHRoZXNlIHNtYWxsIHNpdGVzLCBBcGFjaGUgbG9hZCBzcGlrZXMNCj4gc2V2ZXJl bHkNCj4gCShsb2FkIGF2ZXJhZ2VzID4gMjAwKS4gaHR0cGQgcHJvY2Vzc2VzIGdyb3cgcmFwaWRs eSBhbmQgbWFueSBzaXRlcw0KPiAJYmVjb21lIHVucmVhY2hhYmxlIHVudGlsIGNyYXdsZXIgYWN0 aXZpdHkgc3Vic2lkZXMuIE1haW4gZG9tYWlucw0KPiByZW1haW4NCj4gCXJlc3BvbnNpdmUgZHVy aW5nIHRoZXNlIGV2ZW50cy4NCj4gDQo+IAlTdGVwcyBhbHJlYWR5IHRha2VuOg0KPiAJLSBBbGwg cmV3cml0ZSBsb2dpYyBtb3ZlZCBmcm9tIC5odGFjY2VzcyB0byBWaXJ0dWFsSG9zdA0KPiAJLSBB bGxvd092ZXJyaWRlIGRpc2FibGVkDQo+IAktIENvbnNlcnZhdGl2ZSB0aW1lb3V0cyBhbmQgY29u bmVjdGlvbiBsaW1pdHMgYXBwbGllZA0KPiAJLSBSZXNvdXJjZXMgaW5jcmVhc2VkIGNvbXBhcmVk IHRvIHByZXZpb3VzIHNtYWxsZXIgZGVwbG95bWVudA0KPiANCj4gCVRoaXMgc2FtZSBkZXNpZ24g aGFuZGxlZCB+MTUwIHNpdGVzIHJlYXNvbmFibHkgd2VsbCBpbiB0aGUgcGFzdC4NCj4gV2l0aCBh DQo+IAltdWNoIGxhcmdlciBudW1iZXIgb2Ygc2l0ZXMsIG92ZXJsb2FkIG5vdyBoYXBwZW5zIGRh aWx5Lg0KPiANCj4gCU15IHF1ZXN0aW9uczoNCj4gCS0gSXMgdGhpcyBhIGtub3duIGZhaWx1cmUg bW9kZSBvZiBwcmVmb3JrIHVuZGVyIGhlYXZ5IGNyYXdsZXINCj4gYWN0aXZpdHk/DQo+IAktIEFy ZSB0aGVyZSBBcGFjaGUtbGV2ZWwgdGVjaG5pcXVlcyB0byBsaW1pdCBjcmF3bGVyIGltcGFjdCB3 aXRob3V0DQo+IAlibG9ja2luZyBHb29nbGVib3Q/DQo+IAktIEluIHNpbWlsYXIgc2V0dXBzLCB3 aGF0IHVzdWFsbHkgYmVjb21lcyB0aGUgYm90dGxlbmVjayBmaXJzdDoNCj4gcmV3cml0ZQ0KPiAJ cHJvY2Vzc2luZywgZmlsZXN5c3RlbSBjaGVja3MsIG9yIHByb2Nlc3Mgc3Bhd25pbmc/DQo+IA0K PiAJQW55IGluc2lnaHQgb3IgcmVhbC13b3JsZCBleHBlcmllbmNlIHdvdWxkIGJlIGdyZWF0bHkg YXBwcmVjaWF0ZWQuDQo= DQotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0NClRvIHVuc3Vic2NyaWJlLCBlLW1haWw6IHVzZXJzLXVuc3Vi c2NyaWJlQGh0dHBkLmFwYWNoZS5vcmcNCkZvciBhZGRpdGlvbmFsIGNvbW1hbmRzLCBlLW1h aWw6IHVzZXJzLWhlbHBAaHR0cGQuYXBhY2hlLm9yZw0K