probable bug in English stemmer

Andrew Aksyonoff <[email protected]>
Newsgroups gmane.comp.search.snowball
Message-ID <[email protected]>
Hello all,

hope this mailing list is still alive and kicking after 10 years :)

I've been bringing my rusty English Porter stemmer implementation
up to date with the current state of Snowball and noticed this
discrepancy between the description and libstemmer C library
behaviour. 

These words, all following the same -(t|s)ion -(ality|alism) pattern:

   disproportionality
   unconventionality
   irrationality
   exceptionalism
   sensationalism

stem both (!) suffixes. For instance "exceptionalism" reduces to
"except" with the current version of C library.

According to algorithm description (and posted Snowball source),
-alism should reduce to -al in Step 2, and then Step 4 should reduce
*either* -al or -(t|s)ion suffix, but not both.

Is that an actual bug, or am I just misinterpreting Step 4?

Thanks.

-- 
Best regards,
 Andrew                          mailto:[email protected]
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.