Re: A deficiency in lucene code that affects memory footprint and GC
"Misha Dmitriev via java-user" <[email protected]> Mon, 26 Jan 2026 21:53:02 +0000
| Newsgroups | gmane.comp.jakarta.lucene.user |
|---|---|
| Message-ID | <CH9PR21MB585652D90FDAD278FF9347EAC293A@CH9PR21MB5856.namprd21.prod.outlook.com> |
--_000_CH9PR21MB585652D90FDAD278FF9347EAC293ACH9PR21MB5856namp_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 VGhhbmsgeW91IHZlcnkgbXVjaCwgYWxsLCBmb3IgeW91ciBxdWljayByZXNwb25zZXMhIEkndmUg YmVlbiBidXN5IHdpdGggb3RoZXIgc3R1ZmYgcmVjZW50bHksIGJ1dCB3aWxsIHJlc3VtZSBteSBh dHRlbXB0cyB0byBnZW5lcmF0ZSBhIGx1Y2VuZSBQUiBzb29uLg0KDQpJbiB0aGUgbWVhbnRpbWUs IG91ciBlYXJseSBleHBlcmltZW50cyBzZWVtIHRvIHN1Z2dlc3QgdGhhdCB3aXRoIG15IHByb3Bv c2VkIGNoYW5nZSwgd2UgY2FuIGltcHJvdmUgcGVyZm9ybWFuY2Ugb2Ygb25lIG9mIG91ciBTZWFy Y2ggYXBwcyBieSAyMC4uMjUgcGVyIGNlbnQuIFNvIGF0IGxlYXN0IGZvciBvdXIgY29tcGFueSB0 aGlzIG9wdGltaXphdGlvbiBpcyB2ZXJ5IHdvcnRod2hpbGUuDQoNCk1pc2hhDQoNCl9fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fDQpGcm9tOiBEYXdpZCBXZWlzcyA8ZGF3aWQud2Vpc3NA Z21haWwuY29tPg0KU2VudDogRnJpZGF5LCBKYW51YXJ5IDIzLCAyMDI2IDE6NTUgQU0NClRvOiBq YXZhLXVzZXJAbHVjZW5lLmFwYWNoZS5vcmcgPGphdmEtdXNlckBsdWNlbmUuYXBhY2hlLm9yZz4N CkNjOiBNaXNoYSBEbWl0cmlldiA8bWRtaXRyaWV2QGxpbmtlZGluLmNvbT4NClN1YmplY3Q6IFJl OiBBIGRlZmljaWVuY3kgaW4gbHVjZW5lIGNvZGUgdGhhdCBhZmZlY3RzIG1lbW9yeSBmb290cHJp bnQgYW5kIEdDDQoNCg0KSGkgTWlzaGEsDQoNClVzaW5nIGEgZ2l0aHViIGZvcmsgYW5kIHB1bGwg cmVxdWVzdCBpcyBieSBmYXIgdGhlIGJlc3Qgd2F5IHRvIGRvIGl0IGJlY2F1c2UgaXQgYWxsb3dz IGF1dG9tYXRlZCBjaGVja3MgdG8gYmUgcnVuLCBlYXNpZXIgcmV2aWV3cywgZXRjLiBJdCBpcyBh bHNvIGEgZ29vZCBsZWFybmluZyBleGVyY2lzZSB0byBnZXQgdXAgdG8gc3BlZWQgd2l0aCB3b3Jr aW5nIHdpdGggbXVsdGlwbGUgcmVtb3RlcyBpbiBnaXQsIGlmIHlvdSdyZSB3aWxsaW5nIHRvIGlu dmVzdCBzb21lIHRpbWUgaW4gaXQgKHlvdSBjYW4gaGF2ZSBib3RoIHRoZSB1cHN0cmVhbSBsdWNl bmUgcmVwbyBhbmQgeW91ciBvd24gZm9yayBhcyB0d28gcmVtb3RlcyBpbiB0aGUgc2FtZSBsb2Nh bCBnaXQgY2xvbmUpLg0KDQpEYXdpZA0KDQpPbiBGcmksIEphbiAyMywgMjAyNiBhdCAyOjMw4oCv QU0gTWlzaGEgRG1pdHJpZXYgdmlhIGphdmEtdXNlciA8amF2YS11c2VyQGx1Y2VuZS5hcGFjaGUu b3JnPG1haWx0bzpqYXZhLXVzZXJAbHVjZW5lLmFwYWNoZS5vcmc+PiB3cm90ZToNCkhpIGFnYWlu IERhdmlkLA0KDQpGb3JnaXZlIG15IGlnbm9yYW5jZSwgc2luY2UgSSd2ZSBuZXZlciBjb250cmli dXRlZCB0byBsdWNlbmUgb3IgYXBhY2hlIGJlZm9yZS4gSSBjcmVhdGVkIGEgZ2l0IGJyYW5jaCBi YXNlZCBvbiBsdWNlbmUgbWFpbiBicmFuY2ggbG9jYWxseSwgbWFkZSwgYnVpbGQsIGNoZWNrZWQg YW5kIGNvbW1pdGVkIG15IGZpeCwgYW5kIHRoZW4gdHJpZWQgdG8gY3JlYXRlIGEgUFIgYnkgcHVz aGluZyB0aGF0IGJyYW5jaCwgc2VlIGJlbG93LiBVbmZvcnR1bmF0ZWx5LCBJIGdldCBhbiBlcnJv ci4gSSB1c2VkIGEgY2xhc3NpYyBQQVQgYXMgYSBwYXNzd29yZCwgc28gdGhlIHByb2JsZW0gc2Vl bXMgdG8gYmUgbm90IHdpdGggcGFzc3dvcmQgaXRzZWxmLCBidXQgd2l0aCBub3QgaGF2aW5nIHNv bWUgImFjY2VzcyByaWdodHMiLiBDb3VsZCB5b3UgcGxlYXNlIHRha2UgYSBsb29rPyBJIGFtIHVz aW5nIG15IGdpdGh1YiBsb2dpbiBjb3VudG1kbSwgZW1haWwgY291bnRtZG1AZ21haWwuY29tPG1h aWx0bzpjb3VudG1kbUBnbWFpbC5jb20+DQoNCk1pc2hhDQoNCg0KJCBnaXQgcHVzaCAtdSBvcmln aW4gb3B0aW1pemUtU1RFRi1tYWluDQpVc2VybmFtZSBmb3IgJ2h0dHBzOi8vZ2l0aHViLmNvbTxo dHRwczovL2dpdGh1Yi5jb20vPic6IGNvdW50bWRtDQpQYXNzd29yZCBmb3IgJ2h0dHBzOi8vY291 bnRtZG1AZ2l0aHViLmNvbTxodHRwczovL2NvdW50bWRtQGdpdGh1Yi5jb20vPic6DQpyZW1vdGU6 IFBlcm1pc3Npb24gdG8gYXBhY2hlL2x1Y2VuZS5naXQgZGVuaWVkIHRvIGNvdW50bWRtLg0KZmF0 YWw6IHVuYWJsZSB0byBhY2Nlc3MgJ2h0dHBzOi8vZ2l0aHViLmNvbS9hcGFjaGUvbHVjZW5lLmdp dC8nOiBUaGUgcmVxdWVzdGVkIFVSTCByZXR1cm5lZCBlcnJvcjogNDAzDQoNCl9fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fDQpGcm9tOiBEYXdpZCBXZWlzcyA8ZGF3aWQud2Vpc3NAZ21h aWwuY29tPG1haWx0bzpkYXdpZC53ZWlzc0BnbWFpbC5jb20+Pg0KU2VudDogV2VkbmVzZGF5LCBK YW51YXJ5IDIxLCAyMDI2IDEwOjIxIFBNDQpUbzogamF2YS11c2VyQGx1Y2VuZS5hcGFjaGUub3Jn PG1haWx0bzpqYXZhLXVzZXJAbHVjZW5lLmFwYWNoZS5vcmc+IDxqYXZhLXVzZXJAbHVjZW5lLmFw YWNoZS5vcmc8bWFpbHRvOmphdmEtdXNlckBsdWNlbmUuYXBhY2hlLm9yZz4+DQpDYzogTWlzaGEg RG1pdHJpZXYgPG1kbWl0cmlldkBsaW5rZWRpbi5jb208bWFpbHRvOm1kbWl0cmlldkBsaW5rZWRp bi5jb20+Pg0KU3ViamVjdDogUmU6IEEgZGVmaWNpZW5jeSBpbiBsdWNlbmUgY29kZSB0aGF0IGFm ZmVjdHMgbWVtb3J5IGZvb3RwcmludCBhbmQgR0MNCg0KDQpIaSBNaXNoYSwNCg0KUGxlYXNlIHBy b3ZpZGUgYSBwdWxsIHJlcXVlc3QuIFNtYWxsLCBpc29sYXRlZCBpbXByb3ZlbWVudHMgYXJlIGVh c2llciB0byByZXZpZXcgYW5kIHBhcnNlIGJ5IHVzIHRoYW4gbGFyZ2UgY2hhbmdlcyBidXQgYWxs IGFyZSB3ZWxjb21lLg0KDQpBbHNvLCBhIGxvdCBvZiAodHJhaW5lZCkgZXllcyBhcmUgbG9va2lu ZyBhdCB0aGlzIGNvZGUuLi4gdmVyeSBvZnRlbiB0aGUgcmVwb3J0cyBvZiBMdWNlbmUgbm90IHBl cmZvcm1pbmcgd2VsbCBhcmUgY2F1c2VkIGJ5IHdyb25nIHVzYWdlIHJhdGhlciB0aGFuIHByb2Js ZW1zIHdpdGhpbiB0aGUgaW1wbGVtZW50YXRpb24gLSBpdCB3b3VsZCBiZSBnb29kIHRvIHNoYXJl IHRoZSBlbnRpcmUgY29udGV4dCBvZiB3aGVuIHRoZSBwcm9ibGVtIGlzIGhhcHBlbmluZyBhbmQg dGhlIGNvbnRleHQgb2Ygb2NjdXJyZW5jZS4NCg0KRGF3aWQNCg0KT24gV2VkLCBKYW4gMjEsIDIw MjYgYXQgMTE6MTPigK9QTSBNaXNoYSBEbWl0cmlldiB2aWEgamF2YS11c2VyIDxqYXZhLXVzZXJA bHVjZW5lLmFwYWNoZS5vcmc8bWFpbHRvOmphdmEtdXNlckBsdWNlbmUuYXBhY2hlLm9yZz48bWFp bHRvOmphdmEtdXNlckBsdWNlbmUuYXBhY2hlLm9yZzxtYWlsdG86amF2YS11c2VyQGx1Y2VuZS5h cGFjaGUub3JnPj4+IHdyb3RlOg0KSGkgTHVjZW5lIGNvbW11bml0eSwNCg0KQXQgTGlua2VkSW4s IHdlIHVzZSBsdWNlbmUgaW4gc29tZSBpbXBvcnRhbnQgc2VhcmNoIGFwcHMuIFdlIHJlY2VudGx5 IGZvdW5kIHNvbWUgcHJvYmxlbXMgd2l0aCBHQyBhbmQgbWVtb3J5IGZvb3RwcmluZyBpbiBvbmUg b2YgdGhlbS4gV2UgdG9vayBhIGhlYXAgZHVtcCBhbmQgYW5hbHl6ZWQgaXQgd2l0aCBKWFJheSAo aHR0cHM6Ly9qeHJheS5jb208aHR0cHM6Ly9qeHJheS5jb20vPjxodHRwczovL2p4cmF5LmNvbS8+ KS4gVW5mb3J0dW5hdGVseSwgd2UgY2Fubm90IHNoYXJlIHRoZSBlbnRpcmUganhyYXkgYW5hbHlz aXMgZHVlIHRvIHNlY3VyaXR5IHJlc3RyaWN0aW9ucywgYnV0IHdlIGNhbiBzaGFyZSBvbmUgZXhj ZXJwdCBmcm9tIGl0LCBzZWUgYmVsb3cuIEl0IGNvbWVzIGZyb20gc2VjdGlvbiAxMSBvZiBqeHJh eSByZXBvcnQsIOKAnEJhZCBQcmltaXRpdmUgQXJyYXlz4oCdLCB3aGljaCB0ZWxscyB1cyBob3cg bXVjaCBtZW1vcnkgaXMgd2FzdGVkIGR1ZSB0byBlbXB0eSBvciB1bmRlci11dGlsaXplZCBwcmlt aXRpdmUgYXJyYXlzLiBUaGF0IHNlY3Rpb24gc2F5cyB0aGF0IG5lYXJseSA0RyBvZiBtZW1vcnkg KDI1LjYlIG9mIHVzZWQgaGVhcCkgaXMgd2FzdGVkLiBBbmQgaXQgdHVybnMgb3V0IHRoYXQgbW9z dCBvZiB0aGF0IGlzIGR1ZSB0byBieXRlW10gYXJyYXlzIG1hbmFnZWQgYnkgU2VnbWVudFRlcm1z RW51bUZyYW1lIGNsYXNzLg0KDQpbWF0NCg0KVG8gY2xhcmlmeTogZnJvbSB0aGUgYWJvdmUgc2Ny ZWVuc2hvdCwgZS5nLiA4MCUgb2YgYWxsIGFycmF5cyBwb2ludGVkIGJ5IHN1ZmZpeEJ5dGVzIGRh dGEgZmllbGQgYXJlIGp1c3QgZW1wdHksIGkuZS4gY29udGFpbiBvbmx5IHplcm9lcywgd2hpY2gg bGlrZWx5IG1lYW5zIHRoYXQgdGhleSBoYXZlIG5ldmVyIGJlZW4gdXNlZC4gT2YgdGhlIHJlbWFp bmluZyBhcnJheXMsIDMlIGFyZSDigJx0cmFpbC0wc+KAnSwgaS5lLiBoYXZlIG1vcmUgdGhhbiBh IGhhbGYgb2YgdHJhaWxpbmcgemVybyBlbGVtZW50cywgaS5lLiB3ZXJlIG9ubHkgcGFydGlhbGx5 IHV0aWxpemVkLiBTbyBvbmx5IDE3JSBvZiB0aGVzZSBhcnJheXMgaGF2ZSBiZWVuIHV0aWxpemVk IG1vcmUgb3IgbGVzcyBmdWxseS4gVGhlIHNhbWUgaXMgdHJ1ZSBmb3IgYWxsIG90aGVyIGJ5dGVb XSBhcnJheXMgbWFuYWdlZCBieSBTZWdtZW50VGVybXNFbnVtRnJhbWUuIE5vdGUgdGhhdCBmcm9t IG90aGVyIHNlY3Rpb25zIG9mIHRoZSBoZWFwIGR1bXAgaXTigJlzIGNsZWFyIHRoYXQgdGhlIG1h am9yaXR5IG9mIHRoZXNlIG9iamVjdHMgYXJlIGdhcmJhZ2UsIGkuZS4gdGhleSBoYXZlIGFscmVh ZHkgYmVlbiB1c2VkIGFuZCBkaXNjYXJkZWQuIFRodXMsIGF0IGxlYXN0IDgwJSBvZiBtZW1vcnkg dGhhdCB3YXMgYWxsb2NhdGVkIGZvciB0aGVzZSBieXRlW10gYXJyYXlzIGhhcyBub3QgYmVlbiB1 c2VkIGFuZCB3YXMgd2FzdGVkLiBGcm9tIHNlcGFyYXRlIG1lbW9yeSBhbGxvY2F0aW9uIHByb2Zp bGluZywgd2UgZXN0aW1hdGVkIHRoYXQgdGhlc2UgYXJyYXlzIGFyZSByZXNwb25zaWJsZSBmb3Ig fjJHL3NlYyBvZiBtZW1vcnkgYWxsb2NhdGlvbi4gSWYgdGhleSB3ZXJlIGFsbG9jYXRlZCBsYXpp bHkgcmF0aGVyIHRoYW4gZWFnZXJseSwgaS5lLiBqdXN0IGJlZm9yZSB0aGV5IHdvdWxkIGJlIHJl YWxseSB1c2VkLCB3ZSBjb3VsZCBwb3RlbnRpYWxseSByZWR1Y2UgdGhlaXIgbWVtb3J5IGFsbG9j YXRpb24gcmF0ZSBzaGFyZSBmcm9tIDJHL3NlYyB0byAoMSAtIDAuOCkqMiA9IDAuNCBHL3NlYy4N Cg0KQSBzd2l0Y2ggZnJvbSBlYWdlciB0byBsYXp5IGFsbG9jYXRpb24gb2Ygc29tZSBkYXRhIHN0 cnVjdHVyZSBpcyB1c3VhbGx5IGVhc3kgdG8gaW1wbGVtZW50LiBMZXTigJlzIHRha2UgYSBxdWlj ayBsb29rIGF0IHRoZSBzb3VyY2UgY29kZTxodHRwczovL2Zvc3NpZXMub3JnL2xpbnV4L3d3dy9s dWNlbmUtMTAuMy4yLXNyYy50Z3ovbHVjZW5lLTEwLjMuMi9sdWNlbmUvYmFja3dhcmQtY29kZWNz L3NyYy9qYXZhL29yZy9hcGFjaGUvbHVjZW5lL2JhY2t3YXJkX2NvZGVjcy9sdWNlbmU5MC9ibG9j a3RyZWUvU2VnbWVudFRlcm1zRW51bUZyYW1lLmphdmE+LiBUaGUgc3VmZml4Qnl0ZXMgYXJyYXkg dXNhZ2UgaGFzIHRoZSBmb2xsb3dpbmcgcGF0dGVybjoNCg0KLy8gRWFnZXIgY29uc3RydWN0aW9u IHdpdGggaGFyZGNvZGVkIHNpemUNCmJ5dGVbXSBzdWZmaXhCeXRlcyA9IG5ldyBieXRlWzEyOF07 DQoNCuKApiAgLy8gRmFzdCBmb3J3YXJkIHRvIHRoZSBsb2FkQmxvY2soKSBtZXRob2QNCuKApg0K aWYgKHN1ZmZpeEJ5dGVzLmxlbmd0aCA8IG51bVN1ZmZpeEJ5dGVzKSB7DQogIC8vIElmIHdlIG5l ZWQgdG8gcmVhZCBtb3JlIHRoYW4gMTI4IGJ5dGVzLCBpbmNyZWFzZSB0aGUgYXJyYXnigKYNCiAg Ly8g4oCmIG9yIG1vcmUgcHJlY2lzZWx5LCB0aHJvdyBhd2F5IHRoZSBvbGQgYXJyYXkgYW5kIGFs bG9jYXRlIGFub3RoZXIgb25lDQogIHN1ZmZpeEJ5dGVzID0gbmV3IGJ5dGVbQXJyYXlVdGlsLm92 ZXJzaXplKG51bVN1ZmZpeEJ5dGVzLCAxKV07DQp9DQoNCkZyb20gdGhpcyBjb2RlLCBpdOKAmXMg Y2xlYXIgdGhhdCB0d28gbmVnYXRpdmUgdGhpbmdzIGNhbiBoYXBwZW46DQoNCiAgMS4NCnN1ZmZp eEJ5dGVzIG1heSBub3QgYmUgdXNlZCBhdCBhbGwgKHRoZSBsb2FkQmxvY2soKSBtZXRob2QgbWF5 IG5vdCBiZSBjYWxsZWQgb3IgbWF5IHJldHVybiBlYXJseSkuIFRoZSBtZW1vcnkgdXNlZCBieSB0 aGUgYXJyYXkgd2lsbCBiZSBjb21wbGV0ZWx5IHdhc3RlZA0KICAyLg0KSWYgbnVtU3VmZml4Qnl0 ZXMgaGFwcGVucyB0byBiZSBncmVhdGVyIHRoYW4gMTI4LCB0aGUgY3VycmVudCBlYWdlcmx5IGFs bG9jYXRlZCBhcnJheSB3aWxsIGJlIGRpc2NhcmRlZC4gVGhlIG1lbW9yeSB1c2VkIGJ5IGl0IHdp bGwgYmUgd2FzdGVkLg0KDQpBbmQgYXMgb3VyIGhlYXAgZHVtcCBpbGx1c3RyYXRlcywgdGhlc2Ug dGhpbmdzIGxpa2VseSBoYXBwZW4gdmVyeSBvZnRlbi4gVG8gYWRkcmVzcyB0aGlzIHByb2JsZW0s IGl0IHdvdWxkIGJlIHN1ZmZpY2llbnQgdG8gY2hhbmdlIHRoZSBjb2RlIGFzIGZvbGxvd3M6DQoN Ci8vIEF2b2lkIGVhZ2VyIGNvbnN0cnVjdGlvbg0KYnl0ZVtdIHN1ZmZpeEJ5dGVzOw0K4oCmDQpp ZiAoc3VmZml4Qnl0ZSA9PSBudWxsIHx8IHN1ZmZpeEJ5dGVzLmxlbmd0aCA8IG51bVN1ZmZpeEJ5 dGVzKSB7DQogIC8vIElmIHdlIG5lZWQgdG8gcmVhZCBtb3JlIHRoYW4gMTI4IGJ5dGVzLCBpbmNy ZWFzZSB0aGUgYXJyYXnigKYNCiAgLy8g4oCmIG9yIG1vcmUgcHJlY2lzZWx5LCB0aHJvdyBhd2F5 IHRoZSBvbGQgYXJyYXkgYW5kIGFsbG9jYXRlIGFub3RoZXIgb25lDQogIHN1ZmZpeEJ5dGVzID0g bmV3IGJ5dGVbQXJyYXlVdGlsLm92ZXJzaXplKG51bVN1ZmZpeEJ5dGVzLCAxKV07DQp9DQoNCk5v dGUgdGhhdCByZWR1Y2luZyBtZW1vcnkgYWxsb2NhdGlvbiByYXRlIHJlc3VsdHMgcHJpbWFyaWx5 IGluIHJlZHVjdGlvbiBvZiBDUFUgdXNhZ2UgYW5kL29yIGltcHJvdmVkIGxhdGVuY3kuIFRoYXTi gJlzIGJlY2F1c2UgZWFjaCBvYmplY3QgYWxsb2NhdGlvbiByZXF1aXJlcyB3b3JrIGZyb20gdGhl IEpWTSAtIHVwZGF0aW5nIHBvaW50ZXJzIGFuZCBzZXR0aW5nIGFsbCBvYmplY3QgYnl0ZXMgdG8g emVyby4gQW5kIHRoZW4gR0NpbmcgdGhlc2Ugb2JqZWN0cyBpcyBhbHNvIENQVS1pbnRlbnNpdmUs IGFuZCByZXN1bHRzIGluIHBhdXNpbmcgYXBwIHRocmVhZHMsIHdoaWNoIGFmZmVjdHMgbGF0ZW5j eS4gSG93ZXZlciwgb25jZSBtZW1vcnkgYWxsb2NhdGlvbiByYXRlIGlzIHJlZHVjZWQsIGl0IG1h eSBiZSBwb3NzaWJsZSB0byBhbHNvIHJlZHVjZSB0aGUgSlZNIGhlYXAgbWVtb3J5LiBTbyB0aGUg dWx0aW1hdGUgd2luIGlzIGdvaW5nIHRvIGJlIGluIGJvdGggQ1BVIGFuZCBtZW1vcnkuDQoNClBs ZWFzZSBsZXQgdXMga25vdyBob3cgd2UgY2FuIHByb2NlZWQgd2l0aCB0aGlzLiBUaGUgcHJvcG9z ZWQgY2hhbmdlIGlzIHRyaXZpYWwsIGFuZCB0aHVzIG1heWJlIGl0IGNhbiBiZSBkb25lIHF1aWNr bHkgYnkgc29tZSBlc3RhYmxpc2hlZCBMdWNlbmUgY29udHJpYnV0b3IuIElmIG5vdCwgSSBndWVz cyBJIGNhbiBtYWtlIGl0IG15c2VsZiBhbmQgdGhlbiBob3BlIHRoYXQgaXQgZ29lcyB0aHJvdWdo IHJldmlldyBhbmQgcmVsZWFzZSBpbiByZWFzb25hYmxlIHRpbWUuDQoNCk1pc2hhDQoNCg== --_000_CH9PR21MB585652D90FDAD278FF9347EAC293ACH9PR21MB5856namp_--