PR review request: Perform quantized vector scoring off-heap #14863
Kaival Parikh <[email protected]>
| Newsgroups | gmane.comp.jakarta.lucene.devel |
|---|---|
| Message-ID | <CAK-RQbH4cSO=GMb71skQjfStGm5Z9kB5x1pWpGvh4XygM00NJA@mail.gmail.com> |
Hi everyone, I have a PR out to perform quantized vector scoring off-heap (#14863 <https://github.com/apache/lucene/pull/14863>), similar to what we do for non-quantized byte vectors today. Hoping to avoid the unnecessary copy-to-heap, and related GC pressure. Would appreciate feedback, thanks! - Kaival