Re: newbie does snowball remove stop words?

Oerd Cukalla <[email protected]> Tue, 24 Mar 2015 14:22:42 +0000
Newsgroups gmane.comp.search.snowball
Message-ID <CA++hFtmMmz5BUSBi=ZSnBP15zBpSJVdQjxWy=z81S3J2iQ5Yhg@mail.gmail.com>
Hi Andrew,

you may want to implement a lookup table populated with the stopwords and
only stem a word in input if it is not in the stopwords table.

It should be quite easy to implement in Java, but let me know if you need
assistance.

Have a nice day,
    Oerd

On Tue, 17 Mar 2015 21:36 Andrew Davidson <[email protected]> wrote:

> Hi Olly
>
> I imagine removing stop words is a fairly common requirement. Any idea how
> people implement stop word removal with  snowball?
>
> The reason I originally thought snowball provided stop word removal was
> because of the following links
> http://snowball.tartarus.org/algorithms/english/stop.txt (from
> http://snowball.tartarus.org/algorithms/english/stemmer.html)
>
> It seems to suggest there is some stop word support
>
> Thanks
>
> Andy
>
> On Mar 16, 2015, at 10:20 PM, Olly Betts <[email protected]> wrote:
>
> On Mon, Mar 16, 2015 at 06:31:09PM -0700, Andrew Davidson wrote:
>
> today I downloaded the java version of snowball and compiled it. I ran
> a couple of little example through it. It does not appear to remove
> stop works. Is this a bug?
>
>
> That's not a bug - snowball is a stemmer, not a stopword remover.
>
> Cheers,
>    Olly
>
>
> _______________________________________________
> Snowball-discuss mailing list
> [email protected]
> http://lists.tartarus.org/mailman/listinfo/snowball-discuss
>

_______________________________________________
Snowball-discuss mailing list
[email protected]
http://lists.tartarus.org/mailman/listinfo/snowball-discuss