Re: Hungarian characters in hungarian/stop.txt
Martin Porter <[email protected]> Wed, 11 Jun 2014 07:12:21 +0100
| Newsgroups | gmane.comp.search.snowball |
|---|---|
| Message-ID | <CALc6duwaRtuuB-JUvDaot0_7PNtC6V3LP7+YirqWD0H6dK9tdQ@mail.gmail.com> |
The general "snowball" policy has been to host contributed stemmers, but not to distribute them as part of a general snowball release. This is because of our inability to evaluate and support stemmers in languages with which we have no familiarity. Changing the character encodings for Hungarian on the snowball site ought to involve Anna Tordai, the author of the algorithm. Of course, although Unicode is pretty standard nowadays, snowball is "code independent", and Unicode support didn't come in until 2005. Failure of the older contributions to conform to Unicode is a nuisance, but not an error. I'll see if we can get a message through to Ms Tordai. Martin