Possible bug in Porter Stemmer
Marcel Daneck <[email protected]> Tue, 21 Oct 2014 12:59:16 +0000
| Newsgroups | gmane.comp.search.snowball |
|---|---|
| Message-ID | <f5f30f46207340d5bc7437632c662ed4@BL2PR04MB196.namprd04.prod.outlook.com> |
Hello, I might have found a bug in the porter stemmer for english. (http://snowball.tartarus.org/algorithms/porter/stemmer.html) In the example list of words (http://snowball.tartarus.org/algorithms/porter/diffs.txt) the word "agreement" stays "agreement" after stemming. But step 4 says that if R2 ends with "ent" the "ent" should be deleted (and the Snowball code does so). The region 2 for "agreement" is "ent", so it should be deleted and the resulting stem should be "agreem". There are rules for "ment" and "ement" which could hit too. But the prefix for "ment" would be "agree" which has m=1 and not m>1. (Same for "ement") It would be very nice if you could check this. Maybe it is just and old list. Kindest regards Marcel Daneck | IT Consultant tel +49 40 688 7461-27 | mobil +49 170 6575 755 mail [email protected]<mailto:[email protected]> | www. miosoft.de<http://www.miosoft.de> MIOsoft_Deutschland_GmbH_|_Großer_Grasbrook_9_|_20457_Hamburg_ AG_Hamburg_HRB_128042_|_Geschäftsführer:_Dr.-Ing._Ernst_Siepmann _______________________________________________ Snowball-discuss mailing list [email protected] http://lists.tartarus.org/mailman/listinfo/snowball-discuss