A New Stemmer for Pali
Khemarato Bhikkhu <[email protected]> Sun, 28 Apr 2024 17:11:58 +0700
| Newsgroups | gmane.comp.search.snowball |
|---|---|
| Message-ID | <CAGphO26iSKCJMdo5yqn7W=XQNrmdfnBWDXR2eW4HZUMbyPjfsA@mail.gmail.com> |
--===============6926750831270817834== Content-Type: multipart/alternative; boundary="0000000000009d46ce0617255e7d" --0000000000009d46ce0617255e7d Content-Type: text/plain; charset="UTF-8" Dear Snowball, I'm a volunteer for SuttaCentral.net working on improving their search. It's currently using ArangoDB, so I thought a good first step might be to teach ArangoDB to natively "understand" Pali by adding a Pali stemmer to Snowball. Here's my first stab at it: https://github.com/snowballstem/snowball/pull/197 Any and all feedback would be greatly appreciated. I'm especially curious to know if Snowball supports separating compound words (by adding a space between components?) and also how polished an algorithm should be to get checked in. Do you want the algorithms to be polished and stable before they get merged, or do you support a process of more continuous improvement? Best regards from Thailand, Khemarato Bhikkhu --0000000000009d46ce0617255e7d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">Dear Snowball,<div><br></div><div>I'm a volunteer for = SuttaCentral.net working on improving their search. It's currently usin= g ArangoDB, so I thought a good first step might be to teach ArangoDB to na= tively "understand" Pali by adding a Pali stemmer to Snowball.</d= iv><div><br></div><div>Here's my first stab at it:=C2=A0<a href=3D"http= s://github.com/snowballstem/snowball/pull/197">https://github.com/snowballs= tem/snowball/pull/197</a></div><div><br></div><div>Any and all feedback wou= ld be=C2=A0greatly appreciated.=C2=A0 I'm especially curious to know if= Snowball supports separating=C2=A0compound words (by adding a space betwee= n components?) and also how polished an algorithm should be to get checked = in.=C2=A0 Do you want the algorithms to be polished and stable before they = get merged, or do you support a process of more continuous improvement?</di= v><div><br></div><div>Best regards from Thailand,</div><div>Khemarato Bhikk= hu</div></div> --0000000000009d46ce0617255e7d-- --===============6926750831270817834== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Snowball-discuss mailing list [email protected] https://lists.tartarus.org/mailman/listinfo/snowball-discuss --===============6926750831270817834==--