Re: Fun genai success: visualizing bloom filter tradeoffs with interactive 3D chart
Michael Wechner <[email protected]> Sat, 20 Dec 2025 10:50:23 +0100
| Newsgroups | gmane.comp.jakarta.lucene.devel |
|---|---|
| Message-ID | <[email protected]> |
very cool, thanks for sharing! Am 19.12.25 um 18:13 schrieb Michael McCandless: > Hi Team, I thought this might be interesting to some of us :) > > If anyone out there also struggles to understand / intuit how a bloom > filter's multiple hash functions (which Lucene's bloom filter > implements) improve the false positive error rate, here is an > interactive 3D surface/chart to see how hash function count (k), bits > per element (m/n), and false positive error rate relate: > > https://githubsearch.mikemccandless.com/gemini_bloom10.html > > The mouseover also shows the saturation (percent bits set) but it's > not rendered in the graph. > > I created this by iterating with Gemini Pro 3 ... see the full > prompting/iterations here: https://gemini.google.com/share/46a219e0abaf > > Net/net doing multiple hash functions into the same backing bit set is > surprisingly worthwhile even as the saturation grows, up to 50%. > > It's entirely possible Gemini hallucinated something in the graph!! > But it seems sorta correct to me. And of course that false positive > error rate formula involves e! > > Mike McCandless > > http://blog.mikemccandless.com