Re: Porter stemming not dealing well with -gist -gists
Martin Porter <[email protected]> Wed, 17 Apr 2013 06:47:21 +0100
| Newsgroups | gmane.comp.search.snowball |
|---|---|
| Message-ID | <CALc6duzpEMM3PLQ5-hohTaQb04jNXKmiiRUQHG0CTFawBzZAtg@mail.gmail.com> |
Hi Marc, The "Porter stemmer" is now frozen in time, but this could be a something to add to the snowball "English stemmer". It's connected to the fact that -ist is not, in general, removed. -ologist -> olog could, however, be added. I've put your suggestion on the snowball-discuss list, Thanks, Martin On Tue, Apr 16, 2013 at 6:29 PM, Marc Schipperheijn <[email protected]> wrote: > Hi, > > The Oncologist reviewed the results and decided oncology was not for him. > > In this example, the stemming filter does't correctly identify the stem of Oncologists as oncol. Since there is a whole class of -gists in the world, particularly in the medical world, this seems an omission. > > Perhaps a next version of the algorithm can deal with this. > > Kind regards, > Marc