Re: Unicode UTF-8 Compatible Version of Gutcheck

James Adcock <[email protected]> Thu, 26 Feb 2015 10:24:23 -0800
Newsgroups gmane.culture.literature.e-books.gutenberg.volunteers
Message-ID <[email protected]>
--===============0628515249370142162==
Content-Type: multipart/alternative;
	boundary="----=_NextPart_000_00DB_01D051AE.64274940"
Content-Language: en-us

------=_NextPart_000_00DB_01D051AE.64274940
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit

Off the top of my head, try 48325, which demonstrates the handedness issue.

 

From: gutvol-d [mailto:gutvol-d-bounces-4LCm/o+qPMZ96Xl/[email protected]] On Behalf Of Al
Haines
Sent: Wednesday, February 25, 2015 9:37 PM
To: 'Project Gutenberg Volunteer Discussion'; 'James Adcock'
Subject: Re: [gutvol-d] Unicode UTF-8 Compatible Version of Gutcheck

 

I'd like to give it a try.  Can you upload it somewhere?  Or you can send me
a copy as a zipped attachment.  

 

And if you can mention the etext numbers of several of the files you tested
it against, I can cross-check them with Gutcheck and Bookloupe
(http://www.juiblex.co.uk/pgdp/bookloupe/index.html).

 

 

Al 

 

 

 

-----Original Message-----
From: gutvol-d [mailto:gutvol-d-bounces-4LCm/o+qPMZ96Xl/[email protected]] On Behalf Of James
Adcock
Sent: Wednesday, February 25, 2015 7:49 PM
To: gutvol-d-4LCm/o+qPMZ96Xl/[email protected] <mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]> 
Subject: [gutvol-d] Unicode UTF-8 Compatible Version of Gutcheck

I've created a Unicode UTF-8 Compatible Version of Gutcheck, calling it
gutcheck_u -- if anyone wants to try it.

 

This was primarily an exercise in finding and changing 8-bit char coding
dependencies to 16-bit widechar coding dependencies, but it did require some
additional coding.

 

Currently it is a somewhat Windows-dependent implementation, so if you want
to run it on another OS it would take a little bit of work.

 

I find it more pleasant to use if one's development file format of choice is
UTF-8, and/or if one are doing such things as left-handed / right-handed
quotes.

 

Testing it on PG released files I am in fact finding a fair amount of left /
right handedness errors that are not currently being discovered.

 

Let me know if you want to try it, same distribution terms as the original.

 

Jim Adcock

[email protected] <mailto:[email protected]> 


------=_NextPart_000_00DB_01D051AE.64274940
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><META =
HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 15 =
(filtered medium)"><title>Message</title><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal;
	font-family:"Calibri",sans-serif;
	color:windowtext;}
span.EmailStyle18
	{mso-style-type:personal-reply;
	font-family:"Calibri",sans-serif;
	color:#1F497D;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US =
link=3D"#0563C1" vlink=3D"#954F72"><div class=3DWordSection1><p =
class=3DMsoNormal><span style=3D'color:#1F497D'>Off the top of my head, =
try 48325, which demonstrates the handedness =
issue.<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'color:#1F497D'><o:p>&nbsp;</o:p></span></p><div><div =
style=3D'border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in =
0in 0in'><p class=3DMsoNormal><b>From:</b> gutvol-d =
[mailto:gutvol-d-bounces-4LCm/o+qPMZ96Xl/[email protected]] <b>On Behalf Of </b>Al =
Haines<br><b>Sent:</b> Wednesday, February 25, 2015 9:37 =
PM<br><b>To:</b> 'Project Gutenberg Volunteer Discussion'; 'James =
Adcock'<br><b>Subject:</b> Re: [gutvol-d] Unicode UTF-8 Compatible =
Version of Gutcheck<o:p></o:p></p></div></div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><div><p class=3DMsoNormal><span =
style=3D'font-size:10.0pt;font-family:"Arial",sans-serif;color:blue'>I'd =
like to give it a try.&nbsp; Can you upload it somewhere?&nbsp; Or you =
can send me a copy as a zipped attachment.&nbsp; </span><span =
style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'><o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span =
style=3D'font-size:10.0pt;font-family:"Arial",sans-serif;color:blue'>And =
if you can mention the etext numbers of several of the files you tested =
it against, I can cross-check them with Gutcheck and Bookloupe (<a =
href=3D"http://www.juiblex.co.uk/pgdp/bookloupe/index.html">http://www.ju=
iblex.co.uk/pgdp/bookloupe/index.html</a>).</span><span =
style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'><o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span =
style=3D'font-size:10.0pt;font-family:"Arial",sans-serif;color:blue'>Al =
</span><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'><o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;<o:p></o:p></span></p></div><div><p =
class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'>&nbsp;<o:p></o:p></span></p></div><blockquote =
style=3D'border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in =
4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-right:0in;margin-bottom:=
5.0pt'><p class=3DMsoNormal style=3D'margin-bottom:12.0pt'><span =
style=3D'font-size:10.0pt;font-family:"Tahoma",sans-serif'>-----Original =
Message-----<br><b>From:</b> gutvol-d [<a =
href=3D"mailto:gutvol-d-bounces-4LCm/o+qPMZ96Xl/[email protected]">mailto:gutvol-d-bounces@=
lists.pglaf.org</a>] <b>On Behalf Of </b>James Adcock<br><b>Sent:</b> =
Wednesday, February 25, 2015 7:49 PM<br><b>To:</b> <a =
href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]">gutvol-d-4LCm/o+qPMZ96Xl/[email protected]</a><br>=
<b>Subject:</b> [gutvol-d] Unicode UTF-8 Compatible Version of =
Gutcheck</span><span style=3D'font-size:12.0pt;font-family:"Times New =
Roman",serif'><o:p></o:p></span></p><p class=3DMsoNormal>I&#8217;ve =
created a Unicode UTF-8 Compatible Version of Gutcheck, calling it =
gutcheck_u -- if anyone wants to try it.<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>This was =
primarily an exercise in finding and changing 8-bit char coding =
dependencies to 16-bit widechar coding dependencies, but it did require =
some additional coding.<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>Currently it =
is a somewhat Windows-dependent implementation, so if you want to run it =
on another OS it would take a little bit of work.<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>I find it =
more pleasant to use if one&#8217;s development file format of choice is =
UTF-8, and/or if one are doing such things as left-handed / right-handed =
quotes.<o:p></o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p =
class=3DMsoNormal>Testing it on PG released files I am in fact finding a =
fair amount of left / right handedness errors that are not currently =
being discovered.<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>Let me know =
if you want to try it, same distribution terms as the =
original.<o:p></o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p =
class=3DMsoNormal>Jim Adcock<o:p></o:p></p><p class=3DMsoNormal><a =
href=3D"mailto:[email protected]">[email protected]</a><o:p></o:p></p></blockquot=
e></div></body></html>
------=_NextPart_000_00DB_01D051AE.64274940--

--===============0628515249370142162==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: inline

X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KZ3V0dm9sLWQg
bWFpbGluZyBsaXN0Cmd1dHZvbC1kQGxpc3RzLnBnbGFmLm9yZwpodHRwOi8vbGlzdHMucGdsYWYu
b3JnL21haWxtYW4vbGlzdGluZm8vZ3V0dm9sLWQK

--===============0628515249370142162==--