Re: Re: [Team] search library battle royale [draft]

Jeff Marshall <[email protected]>
Newsgroups gmane.mail.archives.mail-archive
Message-ID <[email protected]>
Lucene: it slices, it dices, it's twice as nice as...well, htDig 3.1 for 
sure.

Here are a couple reasons why Lucene is the Battle Royale champ in my eyes:

* Powerful searching features: 
http://lucene.apache.org/java/docs/queryparsersyntax.html - let's see 
the other kids do all this.

* When was the last time you searched Unicode characters on The Mail 
Archive?  That's right, never!  But with our experiemental Lucene 
interface, you can: 
http://www.mail-archive.com/lucene/search.py?list=freebsd-users-jp%40jp.freebsd.org&query=%E3%81%95%E3%82%93


Downside/upside: Xapian has the nice Omega web interface.  Lucene has 
Nutch, but for a few reasons it didn't fit our needs.  So, our web 
interface is coded up by hand using PyLucene/modpython.  The downside is 
that it meant a bit more work for us, but the upside is complete 
configurability.  Missing right now is paging - it simply displays the 
best 100 matches.

Downside: our PyLucene interface doesn't have a killer name like Omega.

Jeff Marshall
[email protected]



Jeff Breidenbach wrote:
> If you don't care about search,  don't read further.
>
> ===
>
> Sunday, Sunday, SUNDAY!
>
> Come see the data crunching, webpage hopping, free-styling
> search library action. Two monster libraries, titans of Free
> Software technology, compete to become the native search
> engine for The Mail Archive.
>
> Watch as Xapian Omega crushes and destroys the competition,
> finishing off queries in milliseconds. This probabilistic juggernaut is
> a battle tested, email chewing reigning champion in Europe. Honed
> for years and more hardened than quartz, Jeff Breidenbach will
> drive Xapian Omega during this Battle Royale.
>
> PyLucene is a mild mannered garbage collectin' programming library
> just like your mom's search index. That is, if your mom's search index
> could jump partitions, crush gigabytes down to tiny sements, and
> plow through millions of records. Forged on the anvil of a Xerox PARC
> alumni, brimming with black magic, Lucene will be wrought by the
> indomitable Jeff Marshall.
>
> We're taking these two byte belching, buffer oversized, monster libraries
> and pitting them head to head. Old geezer HtDig 3.1 will also make a
> final appearance in the arena.  All three engines can run on any list,
> just by replacing [email protected] with the listname of your choice.
>
> Who will win the monster rally? Xapian vs Lucene? Jeff vs Jeff? Yes,
> you decide! Send comments to gossip, or privately if you are shy,
> for the next week or so. Bonus points for using phrases like
> like "slamming!" "spectacular" or "crushed like a bug". Who's got
> the slickest user interface? Which contender has superior
> data-crunching  performance? How about grits, determination and
> the baddest sounding name?
>
> Want to see something tweaked? Have questions? Ask and it will
> be done if humanly possible - this is a gritty bit-for-bit battle of
> hotrod software and programmer ingenuity no holds barred.  Ladies
> and gentlemen...  Start your search engines!
>
> HtDig3.1
> http://www.mail-archive.com/cgi-bin/htsearch?config=gossip_jab_org&words=magically 
>
>
> Xapian Omega
> http://www.mail-archive.com/cgi-bin/omega/omega?P=magically&[email protected] 
>
>
> PyLucene
> http://www.mail-archive.com/lucene/[email protected]&query=magically 
>
>
> _______________________________________________
> Discussion list for The Mail Archive
> [email protected]
> http://jab.org/cgi-bin/mailman/listinfo/gossip
>


_______________________________________________
Discussion list for The Mail Archive
[email protected]
http://jab.org/cgi-bin/mailman/listinfo/gossip
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.