A New Stemmer for Pali

Khemarato Bhikkhu <[email protected]> Sun, 28 Apr 2024 17:11:58 +0700
Newsgroups gmane.comp.search.snowball
Message-ID <CAGphO26iSKCJMdo5yqn7W=XQNrmdfnBWDXR2eW4HZUMbyPjfsA@mail.gmail.com>
--===============6926750831270817834==
Content-Type: multipart/alternative; boundary="0000000000009d46ce0617255e7d"

--0000000000009d46ce0617255e7d
Content-Type: text/plain; charset="UTF-8"

Dear Snowball,

I'm a volunteer for SuttaCentral.net working on improving their search.
It's currently using ArangoDB, so I thought a good first step might be to
teach ArangoDB to natively "understand" Pali by adding a Pali stemmer to
Snowball.

Here's my first stab at it:
https://github.com/snowballstem/snowball/pull/197

Any and all feedback would be greatly appreciated.  I'm especially curious
to know if Snowball supports separating compound words (by adding a space
between components?) and also how polished an algorithm should be to get
checked in.  Do you want the algorithms to be polished and stable before
they get merged, or do you support a process of more continuous improvement?

Best regards from Thailand,
Khemarato Bhikkhu

--0000000000009d46ce0617255e7d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Dear Snowball,<div><br></div><div>I&#39;m a volunteer for =
SuttaCentral.net working on improving their search. It&#39;s currently usin=
g ArangoDB, so I thought a good first step might be to teach ArangoDB to na=
tively &quot;understand&quot; Pali by adding a Pali stemmer to Snowball.</d=
iv><div><br></div><div>Here&#39;s my first stab at it:=C2=A0<a href=3D"http=
s://github.com/snowballstem/snowball/pull/197">https://github.com/snowballs=
tem/snowball/pull/197</a></div><div><br></div><div>Any and all feedback wou=
ld be=C2=A0greatly appreciated.=C2=A0 I&#39;m especially curious to know if=
 Snowball supports separating=C2=A0compound words (by adding a space betwee=
n components?) and also how polished an algorithm should be to get checked =
in.=C2=A0 Do you want the algorithms to be polished and stable before they =
get merged, or do you support a process of more continuous improvement?</di=
v><div><br></div><div>Best regards from Thailand,</div><div>Khemarato Bhikk=
hu</div></div>

--0000000000009d46ce0617255e7d--


--===============6926750831270817834==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Snowball-discuss mailing list
[email protected]
https://lists.tartarus.org/mailman/listinfo/snowball-discuss

--===============6926750831270817834==--