Re: MODTOOLS-17 To osis2mod, added conversion of hex and decimal numeric entities to UTF-8, with special handling of <, >, &, ', and ".

Greg Hellings <[email protected]> Wed, 6 Aug 2025 20:30:31 -0500
Newsgroups gmane.comp.literature.sword.devel
Message-ID <CAHxvOVL5A2SGkMaG+pJq29Cigb6ooF_WnXyanXnMZaVXgXqsWA@mail.gmail.com>
--===============0488266496920857677==
Content-Type: multipart/alternative; boundary="000000000000da69cf063bbc6746"

--000000000000da69cf063bbc6746
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Binary Windows builds with your commit up:
https://src.thehellings.com/greg/mingw-sword-build/-/releases

Apologies I still haven't been able to produce a native Windows on Arm
build. The toolchain is still lagging behind the x86 version of the
toolkit, and producing some build errors that need to be addressed upstream=
.

--Greg

On Wed, Aug 6, 2025 at 4:20=E2=80=AFPM DM Smith <[email protected]> wro=
te:

> I=E2=80=99ve just checked in a change for osis2mod.
>
> MODTOOLS-17 To osis2mod, added conversion of hex and decimal numeric
> entities to UTF-8, with special handling of <, >, &, ', and ".
>
> Also:
>  * Fixed a bug in hex numeric entities which defined &xHHHH; rather than
> &#xHHHH;.
>  * Added entity sanity check of maximum length of 32.
>  * Refactored entity handling into handleEntities and comment handling
> into handleComments.
>  * Changed t_entitytype and t_commentstate into class enums EntityType an=
d
> CommentState.
>  * Added -d 1024 for entity and comment parsing.
>
> Note: The coding allows for 0 padding of the numeric entities.
> Note: The 5 need to be treated specially.
>         &#38; or &#x26; =E2=86=92 &amp;
>         &#60; or &#x3C; =E2=86=92 &lt;
>         &#62; or &#x3E; =E2=86=92 &gt;
>         &#34; or &#x22; =E2=86=92 &quot; or "
>         &#39; or &#x27; =E2=86=92 &apos; or '
> When converted to these forms, &quot; should be transformed into " except
> in attributes using " and likewise &apos; into ' except in attributes
> having =E2=80=98.
>
> I need to update the wiki to match.
>
> In Him,
>         DM Smith
>
> _______________________________________________
> sword-devel mailing list: [email protected]
> http://crosswire.org/mailman/listinfo/sword-devel
> Instructions to unsubscribe/change your settings at above page
>

--000000000000da69cf063bbc6746
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Binary Windows builds with your commit up:=C2=A0<a hr=
ef=3D"https://src.thehellings.com/greg/mingw-sword-build/-/releases">https:=
//src.thehellings.com/greg/mingw-sword-build/-/releases</a></div><div><br><=
/div><div>Apologies I still haven&#39;t been able to produce a native Windo=
ws on Arm build. The toolchain is still lagging behind the x86 version of t=
he toolkit, and producing some build errors that need to be addressed upstr=
eam.</div><div><br></div><div>--Greg</div></div><br><div class=3D"gmail_quo=
te gmail_quote_container"><div dir=3D"ltr" class=3D"gmail_attr">On Wed, Aug=
 6, 2025 at 4:20=E2=80=AFPM DM Smith &lt;<a href=3D"mailto:dmsmith@crosswir=
e.org">[email protected]</a>&gt; wrote:<br></div><blockquote class=3D"g=
mail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204=
,204,204);padding-left:1ex">I=E2=80=99ve just checked in a change for osis2=
mod.<br>
<br>
MODTOOLS-17 To osis2mod, added conversion of hex and decimal numeric entiti=
es to UTF-8, with special handling of &lt;, &gt;, &amp;, &#39;, and &quot;.=
<br>
<br>
Also:<br>
=C2=A0* Fixed a bug in hex numeric entities which defined &amp;xHHHH; rathe=
r than &amp;#xHHHH;.<br>
=C2=A0* Added entity sanity check of maximum length of 32.<br>
=C2=A0* Refactored entity handling into handleEntities and comment handling=
 into handleComments.<br>
=C2=A0* Changed t_entitytype and t_commentstate into class enums EntityType=
 and CommentState.<br>
=C2=A0* Added -d 1024 for entity and comment parsing.<br>
<br>
Note: The coding allows for 0 padding of the numeric entities.<br>
Note: The 5 need to be treated specially.<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 &amp;#38; or &amp;#x26; =E2=86=92 &amp;amp;<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 &amp;#60; or &amp;#x3C; =E2=86=92 &amp;lt;<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 &amp;#62; or &amp;#x3E; =E2=86=92 &amp;gt;<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 &amp;#34; or &amp;#x22; =E2=86=92 &amp;quot; or=
 &quot;<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 &amp;#39; or &amp;#x27; =E2=86=92 &amp;apos; or=
 &#39;<br>
When converted to these forms, &amp;quot; should be transformed into &quot;=
 except in attributes using &quot; and likewise &amp;apos; into &#39; excep=
t in attributes having =E2=80=98.<br>
<br>
I need to update the wiki to match.<br>
<br>
In Him,<br>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 DM Smith<br>
<br>
_______________________________________________<br>
sword-devel mailing list: <a href=3D"mailto:[email protected]" targ=
et=3D"_blank">[email protected]</a><br>
<a href=3D"http://crosswire.org/mailman/listinfo/sword-devel" rel=3D"norefe=
rrer" target=3D"_blank">http://crosswire.org/mailman/listinfo/sword-devel</=
a><br>
Instructions to unsubscribe/change your settings at above page<br>
</blockquote></div>

--000000000000da69cf063bbc6746--

--===============0488266496920857677==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
sword-devel mailing list: [email protected]
http://crosswire.org/mailman/listinfo/sword-devel
Instructions to unsubscribe/change your settings at above page

--===============0488266496920857677==--