Re: Porter stemming not dealing well with -gist -gists

Martin Porter <[email protected]> Wed, 17 Apr 2013 06:47:21 +0100
Newsgroups gmane.comp.search.snowball
Message-ID <CALc6duzpEMM3PLQ5-hohTaQb04jNXKmiiRUQHG0CTFawBzZAtg@mail.gmail.com>
Hi Marc,

The "Porter stemmer" is now frozen in time, but this could be a
something to add to the snowball "English stemmer". It's connected to
the fact that -ist is not, in general, removed. -ologist -> olog
could, however, be added.

I've put your suggestion on the snowball-discuss list,

Thanks, Martin



On Tue, Apr 16, 2013 at 6:29 PM, Marc Schipperheijn
<[email protected]> wrote:
> Hi,
>
> The Oncologist reviewed the results and decided oncology was not for him.
>
> In this example, the stemming filter does't correctly identify the stem of Oncologists as oncol. Since there is a whole class of -gists in the world, particularly in the medical world, this seems an omission.
>
> Perhaps a next version of the algorithm can deal with this.
>
> Kind regards,
> Marc