Possible bug in Porter Stemmer

Marcel Daneck <[email protected]> Tue, 21 Oct 2014 12:59:16 +0000
Newsgroups gmane.comp.search.snowball
Message-ID <f5f30f46207340d5bc7437632c662ed4@BL2PR04MB196.namprd04.prod.outlook.com>
Hello,

I might have found a bug in the porter stemmer for english. (http://snowball.tartarus.org/algorithms/porter/stemmer.html)
In the example list of words (http://snowball.tartarus.org/algorithms/porter/diffs.txt) the word "agreement" stays "agreement" after stemming.

But step 4 says that if R2 ends with "ent" the "ent" should be deleted (and the Snowball code does so).
The region 2 for "agreement" is "ent", so it should be deleted and the resulting stem should be "agreem".

There are rules for "ment" and "ement" which could hit too. But the prefix for "ment" would be "agree" which has m=1 and not m>1. (Same for "ement")

It would be very nice if you could check this. Maybe it is just and old list.

Kindest regards




Marcel Daneck | IT Consultant

tel +49 40 688 7461-27 | mobil +49 170 6575 755

mail [email protected]<mailto:[email protected]> | www. miosoft.de<http://www.miosoft.de>


MIOsoft_Deutschland_GmbH_|_Großer_Grasbrook_9_|_20457_Hamburg_

AG_Hamburg_HRB_128042_|_Geschäftsführer:_Dr.-Ing._Ernst_Siepmann

_______________________________________________
Snowball-discuss mailing list
[email protected]
http://lists.tartarus.org/mailman/listinfo/snowball-discuss