Re: no words ending on alism in Porter diffs txt file

Martin Porter <[email protected]>
Newsgroups gmane.comp.search.snowball
Message-ID <CALc6duwX3_pPmJ=-+2ouCWCdkh4UE3hypwAc+Ub2xHxm65ny=g@mail.gmail.com>
Ward, the quick answer to your two points is:

On Fri, Oct 21, 2011 at 7:58 PM, Ward Bekker (TTY) <[email protected]> wrote:
> Hi,
> Two questions:
> 1) While coverage testing the Erlang implementation of the Porter algorithm
> using the "Vocabulary + stemmed equivalent" file, I noticed that there a no
> words included that end on "alism". Is this on purpose?
> See http://snowball.tartarus.org/algorithms/porter/diffs.txt

No, it is an accident.

> 2) In the Vocabulary + stemmed equivalent" file I noticed that eg.
> "terribly" is stemmed to "terribli". In the Erlang version this is stemmed
> to "terribl", which maches the way "terrible" is stemmed. That looks useful
> to the untrained eye. Is this a side effect of the abli  →  able replaced
> by bli  →  ble change?

terribly stems to terribl in the Porter algorithm, and to terribli in
the 'improved' English algorithm. which are separate algorithms on the
snowball site. Your erlang version (is that the one by Alden Dima from
tartarus.org/~martin/PorterStemmer/?) is clearlyfollowing the Porter
stemmer.

-------


But you may well ask how is the English stemmer supposed to be
improving on the Porter stemmer here. I'll investigate further and get
back to you,

Martin

_______________________________________________
Snowball-discuss mailing list
[email protected]
http://lists.tartarus.org/mailman/listinfo/snowball-discuss
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.