Re: Search engine relevance

Donald Stufft <[email protected]> Fri, 8 Mar 2013 10:22:39 -0500
Newsgroups gmane.comp.python.catalog
Message-ID <[email protected]>
On Mar 8, 2013, at 9:51 AM, Jacob Kaplan-Moss <[email protected]> wrote:

> Hi Antoine -
> 
> Yes, PyPI's search engine is rather simplistic, I think that's a
> pretty well-known problem.
> 
> For the time being you might try Crate instead (crate.io); I've found
> its search engine to be much much better.

Crate's search uses ElasticSearch whereas I believe PyPI is just using SQL against the DB.

That being said Crate's search could be a lot better still :/ But I'm not an expert on how to get the best search results.

> 
> Jacob
> 
> On Fri, Mar 8, 2013 at 8:00 AM, Antoine Pitrou <[email protected]> wrote:
>> 
>> Hello,
>> 
>> It seems the PyPI search engine is quite crude and doesn't try to make the
>> results relevant at all.
>> For example, if I'm trying to search "agi" in the hope of finding modules
>> relevant to the Asterisk Gateway Interface (nicknamed "AGI"), I get the
>> following results:
>> 
>> https://pypi.python.org/pypi?%3Aaction=search&term=agi&submit=search
>> 
>> As you can see, a large number of results pop up simply because they contain
>> the word "magic", which apparently is considered to match the "agi" request.
>> Clearly either the selection or the weighting algorithm isn't very efficient
>> here.
>> 
>> Regards
>> 
>> Antoine.
>> 
>> 
>> _______________________________________________
>> Catalog-SIG mailing list
>> [email protected]
>> http://mail.python.org/mailman/listinfo/catalog-sig
> _______________________________________________
> Catalog-SIG mailing list
> [email protected]
> http://mail.python.org/mailman/listinfo/catalog-sig


-----------------
Donald Stufft
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

_______________________________________________
Catalog-SIG mailing list
[email protected]
http://mail.python.org/mailman/listinfo/catalog-sig
signature.asc (application/pgp-signature, 841 B)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.19 (Darwin)

iQIcBAEBAgAGBQJROgI/AAoJEG48vOkzctz66Q8P/1WRi65ZfPXCJIEhV2dUoFWU
LJYNWa0YDRTBhvX/+w0DpU4eIitl+I+9ivCQruosudjFCsNss8mlabcv+SrnBdS3
PaUil11z8sevCRYs5TBxm0VtctWjBogo74q9cejcc7vdRmUnsmVLhvcSaPPZE0DL
5d2zWKRd6rePZMY05AiFisykJGnuEBQK5ioNj4era85ss8n7H4mg+Qq4ShRo621M
jknv4i/vxZhAwUo/dc5EtJNJf1mbOLWi9UfxH2M4tk/VAnE1FGmTSWY7FKPxmv1N
ATHkpCMLQI9sAfWL1Hx5g4DPQE2wyYCFG3CMpfqBmlre9z9ea4tFQ8xfIk1dir2K
sJc6GX93nIpYeXNWEHqvubWVGR0h+pR9OGMF9bCdy9I9Wy+0WGRgbs2nEqw/V6zT
5t71qmpp8rJu8TIWqEyEm/42NCPvu8JsHNm3rNOslm7YEA9PjvGNJdIM7xotD6UY
e8QOPa4A595gerQ75wEo8h37r3QtFDJHyeIwIOGvVY7QJLvTZd7H138bPkddnb8p
sEr01EW6QOrK2VaXTSbmJ5+yuVKyyoykY6smBZ0yz2pZJeZD6FMZEGKIIgLC8RO+
M/nlncN0Zm43Y1QtNnOVn0VSG1yufyU9Dm3q2pYiIvSIQO3oDkoqUyjejSjeue2t
jZ3r7Ofr7saE9tJVjIyx
=LGzX
-----END PGP SIGNATURE-----