Re: Article about using snowball stemmer to dolanguage identificaction

Martin Porter <[email protected]>
Newsgroups gmane.comp.search.snowball
Message-ID <[email protected]>
Iolalla,

Very interesting. In the past I've used stopword lists for language
identification, and the results were adequate. But I did notice that
in Finnish there aren't so very many stopwords!

But I don't quite see how applying a stemmer leads to a language
identification. Do you count the number of valid endings removed, and
use that as a measure?

Like Cominvent, I wondered how the mixing was done in the hybrid approach,

Martin
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.