Stemming with german2 on hyphenated compound words
Simon <[email protected]> Tue, 24 Sep 2024 10:23:23 +0200
| Newsgroups | gmane.comp.search.snowball |
|---|---|
| Message-ID | <trinity-8ab9e424-0e13-4ad5-ae5d-87168430b71a-1727166203849@3c-app-gmx-bs29> |
--===============2972710652243415933== Content-Type: text/html; charset=UTF-8 <html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>Hello,<br/> <br/> I have a problem using the german2 stemmer on hyphenated compound words with ElasticSearch.</div> <div> </div> <div>As an example I have 2 words: "Export-Schnittstelle" and "Schnittstelle", for these words the stemmer creates "Export-Schnittstell" or "Schnittstell" respectively, which is great because with the right tokenization I can now search for "Schnitstelle" (which the stemmer within my search analyzer will transform to "Schnittstell") and it will match the second part from the word "Export-Schnittstelle" aka "Export-Schnittstell". <br/> <br/> Now I would expect that this is how it works for all hyphenated compound words. But unfortunately that's not the case. So I now have 2 other words "PA-Schiene" and "Schiene". Here the stemmer creates two completely different words: "PA-Schi" and "Schien". </div> <div> </div> <div>Can someone explain to my why this is and if there is a way to fix this? Maybe by using different stemming, like light_german oder minimal_german?<br/> <br/> I'll post this on the elasticsearch discussion board as well, as I'm not sure if this is entirely the right place for the question, but I'd be thankful for any insight on the topic.<br/> <br/> Thanks in advance.<br/> <br/> Best Regards<br/> Simon</div></div></body></html> --===============2972710652243415933== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Snowball-discuss mailing list [email protected] https://lists.tartarus.org/mailman/listinfo/snowball-discuss --===============2972710652243415933==--