Re: gutvol-d Digest, Vol 115, Issue 1
Rick Tonsing <[email protected]> Sun, 5 Jan 2020 12:13:53 -0800
| Newsgroups | gmane.culture.literature.e-books.gutenberg.volunteers |
|---|---|
| Message-ID | <CAA5S-6Zciwoj67_xpsKJWdYDM93eYU-o2EDzTPBxUxq+g-YZ9w@mail.gmail.com> |
--===============6759537443125597921== Content-Type: multipart/alternative; boundary="000000000000bd4ce4059b6a301a" --000000000000bd4ce4059b6a301a Content-Type: text/plain; charset="UTF-8" Greg & Al, OK. I got the wrong impression from the PG FAQ. Thank you for the explanations. And for correcting the FAQ. ppgen automatically cranks out those file name appendages. I'll put in a suggestion to change it from html to htm. Thank you, Rick On Sun, Jan 5, 2020 at 12:00 PM <gutvol-d-request-4LCm/o+qPMZ96Xl/[email protected]> wrote: > Send gutvol-d mailing list submissions to > gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.pglaf.org/mailman/listinfo/gutvol-d > or, via email, send a message with subject or body 'help' to > gutvol-d-request-4LCm/o+qPMZ96Xl/[email protected] > > You can reach the person managing the list at > gutvol-d-owner-4LCm/o+qPMZ96Xl/[email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of gutvol-d digest..." > Today's Topics: > > 1. File Recode Service is not functional (Rick Tonsing) > 2. UTF-8 File Names (Rick Tonsing) > 3. Re: UTF-8 File Names (Greg Newby) > 4. Re: File Recode Service is not functional (Greg Newby) > 5. Re: UTF-8 File Names (Al Haines) > > > > ---------- Forwarded message ---------- > From: Rick Tonsing <[email protected]> > To: gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > Cc: > Bcc: > Date: Sat, 4 Jan 2020 16:43:08 -0800 > Subject: [gutvol-d] File Recode Service is not functional > FYI > > I noticed that your File Recode Service > <https://www.gutenberg.org/catalog/world/recode> is not functional. > Specifically, there is no method for entering the Filename for testing. It > appears to be intentional. > > However, if the site is intentionally disabled then you should probably > also disable the link from "V.74. What characters can I use? > <https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#About_the_characters_you_use> > " > > Cheers, > > Rick > > > > ---------- Forwarded message ---------- > From: Rick Tonsing <[email protected]> > To: gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > Cc: > Bcc: > Date: Sat, 4 Jan 2020 23:00:28 -0800 > Subject: [gutvol-d] UTF-8 File Names > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for Latin-1 > and the xxxx-utf8.txt for UTF-8 text files came up in a DP forum > <https://www.pgdp.net/phpBB3/viewtopic.php?p=1189531#p1189531>. > > The gist of the discussion (as I see it) is that we select the file type > on the direct upload screen. Do we even need an indicator of the file type > in the file name? If so, then do we need both? UTF8 is be the default so > xxxx.txt without the (-UTF8) should be sufficient for UTF-8 files. The > -lt1 or -lat1 could remain the backup signal that the file needs to go > through the upconvert program to UTF-8. > > Cheers, > > Rick > > > > ---------- Forwarded message ---------- > From: Greg Newby <[email protected]> > To: Project Gutenberg Volunteer Discussion <gutvol-d-4LCm/o+qPMZ96Xl/[email protected]> > Cc: > Bcc: > Date: Sun, 5 Jan 2020 06:55:12 -0800 > Subject: Re: [gutvol-d] UTF-8 File Names > Hi, Rick. The whitewashers get whatever you upload. No transformation or > conversion is done automatically: it's just a .zip file that they download > and process. > > Informative filenames are fine. Any text should end in .txt > - Greg > > > > On Sat, Jan 04, 2020 at 11:00:28PM -0800, Rick Tonsing wrote: > > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for Latin-1 > > and the xxxx-utf8.txt for UTF-8 text files came up in a DP forum > > <https://www.pgdp.net/phpBB3/viewtopic.php?p=1189531#p1189531>. > > > > The gist of the discussion (as I see it) is that we select the file type > on > > the direct upload screen. Do we even need an indicator of the file type > in > > the file name? If so, then do we need both? UTF8 is be the default so > > xxxx.txt without the (-UTF8) should be sufficient for UTF-8 files. The > > -lt1 or -lat1 could remain the backup signal that the file needs to go > > through the upconvert program to UTF-8. > > > > Cheers, > > > > Rick > > > _______________________________________________ > > gutvol-d mailing list > > gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > > https://lists.pglaf.org/mailman/listinfo/gutvol-d > > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > > > > > ---------- Forwarded message ---------- > From: Greg Newby <[email protected]> > To: Project Gutenberg Volunteer Discussion <gutvol-d-4LCm/o+qPMZ96Xl/[email protected]> > Cc: > Bcc: > Date: Sun, 5 Jan 2020 07:07:08 -0800 > Subject: Re: [gutvol-d] File Recode Service is not functional > Hi, Rick. It looks like that was never working. It doesn't have any code > for actually uploading or processing a file. > > I've edited it to indicate it's no longer in use. > > Concerning the FAQ, etc.: This will soon be deprecated. The new site is > finally nearly ready, and can be viewed here: > https://dev.gutenberg.org > > We've tried to move/remove everything outdated. Stuff that is moved to the > "atic" area is clearly marked as no longer being accurate. > > There are just a few more things to be fixed before we open this for more > widespread testing. There are also a few things that will not move yet. > > Fixes/edits can be emailed, or use a pull request here: > https://github.com/gbnewby/gutenbergsite > - Greg > > On Sat, Jan 04, 2020 at 04:43:08PM -0800, Rick Tonsing wrote: > > FYI > > > > I noticed that your File Recode Service > > <https://www.gutenberg.org/catalog/world/recode> is not functional. > > Specifically, there is no method for entering the Filename for testing. > It > > appears to be intentional. > > > > However, if the site is intentionally disabled then you should probably > > also disable the link from "V.74. What characters can I use? > > < > https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#About_the_characters_you_use > > > > " > > > > Cheers, > > > > Rick > > > _______________________________________________ > > gutvol-d mailing list > > gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > > https://lists.pglaf.org/mailman/listinfo/gutvol-d > > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > > > > > ---------- Forwarded message ---------- > From: Al Haines <[email protected]> > To: <[email protected]>, "'Project Gutenberg Volunteer Discussion'" < > gutvol-d-4LCm/o+qPMZ96Xl/[email protected]>, "Joseph E. Loewenstein, M.D." < > [email protected]>, "'Al Haines'" <[email protected]>, "'Chuck > Greif'" <cbgrf-/[email protected]>, "'David Widger'" <[email protected]> > Cc: > Bcc: > Date: Sun, 5 Jan 2020 11:51:53 -0800 > Subject: Re: [gutvol-d] UTF-8 File Names > UTF8 text files should have "-utf8" in their file names, e.g. > "myfile-utf8.txt". This forces PG's posting software to treat text > files as UTF8, rather than its defaulting to Latin1/ASCII. (This has > been a de facto standard for some years now.) It's not necessary to do > this for HTML files. > > If necessary, the posting software will prompt for the correct character > set, but it's an easy prompt to skip through, or give the wrong answer > to. The presence of "-utf8" in the filename obviates the need for the > prompt. Latin1/ASCII text files don't trigger the prompt at all. > > If PG's upload check reports a UTF8 text file without the "-utf8", then > I rename the file inside the zip file, before unzipping it. > > Conversely, if a text file arrives with "-lat1", "-ltn1", "-iso", > "-asc", or some such Latin1/ASCII indicator, I rename the file to remove > it, since addhd handles Latin1/ASCII files correctly. > > Also, to avoid spurious files generated by the posting software, I make > sure the base name of the zip file is the same as the base names of the > text and HTML files, e.g. myfile.zip contains myfile.txt (or > myfile-utf8.txt) and myfile.htm. > > Re HTML files: PG's extension for them is ".htm". When an uploaded zip > file contains an HTML file with the extension ".html", I rename it, as > mentioned above. If this isn't done, the posting software copies the > file to a new file with the extension ".htm", e.g. "myfile.html" is > copied to "myfile.htm", leaving a spurious ".html" file. (BTW, the > posting software never, ever, modifies the submitted files--it copies > them to new files with the required name, then works with the new > files.) > > While I'm at it, more on file names... > > As mentioned above, I rename text and HTML files, and sometimes zip > files, so that their base names are the same (except for the "-utf8" > part of text files). There's no need for text/HTML files to have some > versioning component. For example, I recently handled a zip file named > diam-pg.zip, which contained diam-b.html and diam-cc-utf8.txt. I > renamed the files to remove the "-b" and "-cc" parts, and the zip file > to remove the "-pg" part, of their respective names. > > I've also seen names like "myfile-text.txt" and "myfile-html.html", and > "myfile-8.txt" and "myfile-h.html". There's no need for such > double-indicators of a file's type. > > There have been any number of similar variations, some probably related > to the PPer's versioning system as they work through the PPing process; > some related the PPing software. > > In one of the DP posts are these fragments: > > > All of PG uploads are currently UTF-8, even if the file is Latin-1. > > No idea where this idea comes from, but it's wrong. See below. > > > Or even do away with the appending altogether. The direct upload panel > lets > > the White Washers know what encoding to expect. So they know to run > the > > program to convert the Latin-1 characters to UTF-8. > > Also wrong. The WWers don't see PG's upload screen (except for their > own projects). They also never convert Latin1 to UTF8--that's done to > posted Latin1/ASCII files by PG's behind-the-scenes software, which the > WWers have no control over. > > I think that's sufficient food for thought/discussion for now... > > > Al > > > > > > -----Original Message----- > > From: gutvol-d [mailto:gutvol-d-bounces-4LCm/o+qPMZ96Xl/[email protected]] On > > Behalf Of Greg Newby > > Sent: Sunday, January 05, 2020 6:55 AM > > To: Project Gutenberg Volunteer Discussion > > Subject: Re: [gutvol-d] UTF-8 File Names > > > > > > Hi, Rick. The whitewashers get whatever you upload. No > > transformation or conversion is done automatically: it's just > > a .zip file that they download and process. > > > > Informative filenames are fine. Any text should end in .txt > > - Greg > > > > > > > > On Sat, Jan 04, 2020 at 11:00:28PM -0800, Rick Tonsing wrote: > > > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for > > > Latin-1 and the xxxx-utf8.txt for UTF-8 text files came up in a DP > > > forum > > <https://www.pgdp.net/phpBB3/viewtopic.php?p=1189531#p1189531> > . > > > > The gist of the discussion (as I see it) is that we select the file > > type on the direct upload screen. Do we even need an indicator of the > > > file type in the file name? If so, then do we need both? UTF8 is be > > the default so xxxx.txt without the (-UTF8) should be sufficient for > > UTF-8 files. The -lt1 or -lat1 could remain the backup signal that > > the file needs to go through the upconvert program to UTF-8. > > > > Cheers, > > > > Rick > > > _______________________________________________ > > gutvol-d mailing list > > gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > > https://lists.pglaf.org/mailman/listinfo/gutvol-d > > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > _______________________________________________ > gutvol-d mailing list > gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > https://lists.pglaf.org/mailman/listinfo/gutvol-d > Unsubscribe: https://lists.pglaf.org/mailman/options/gutvol-d > > > _______________________________________________ > gutvol-d mailing list > gutvol-d-4LCm/o+qPMZ96Xl/[email protected] > https://lists.pglaf.org/mailman/listinfo/gutvol-d > --000000000000bd4ce4059b6a301a Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div dir=3D"ltr"><div class=3D"gmail_default" style=3D"fon= t-family:georgia,serif;font-size:large">Greg & Al,</div><div class=3D"g= mail_default" style=3D"font-family:georgia,serif;font-size:large"><br></div= ><div class=3D"gmail_default" style=3D"font-family:georgia,serif;font-size:= large">OK. I got the wrong impression from the PG FAQ.=C2=A0 Thank you for = the explanations. And for correcting the FAQ.<br></div><div class=3D"gmail_= default" style=3D"font-family:georgia,serif;font-size:large"><br></div><div= class=3D"gmail_default" style=3D"font-family:georgia,serif;font-size:large= ">ppgen automatically cranks out those file name appendages.=C2=A0 I'll= put in a suggestion to change it from html to htm.<br></div><div class=3D"= gmail_default" style=3D"font-family:georgia,serif;font-size:large"><br></di= v><div class=3D"gmail_default" style=3D"font-family:georgia,serif;font-size= :large">Thank you,<br></div><div class=3D"gmail_default" style=3D"font-fami= ly:georgia,serif;font-size:large"><br></div><div class=3D"gmail_default" st= yle=3D"font-family:georgia,serif;font-size:large">Rick<br></div></div><br><= div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Sun, Jan= 5, 2020 at 12:00 PM <<a href=3D"mailto:gutvol-d-request-4LCm/o+qPMZ96Xl/[email protected]= ">gutvol-d-request-4LCm/o+qPMZ96Xl/[email protected]</a>> wrote:<br></div><blockquote clas= s=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid r= gb(204,204,204);padding-left:1ex">Send gutvol-d mailing list submissions to= <br> =C2=A0 =C2=A0 =C2=A0 =C2=A0 <a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" tar= get=3D"_blank">gutvol-d-4LCm/o+qPMZ96Xl/[email protected]</a><br> <br> To subscribe or unsubscribe via the World Wide Web, visit<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0 <a href=3D"https://lists.pglaf.org/mailman/list= info/gutvol-d" rel=3D"noreferrer" target=3D"_blank">https://lists.pglaf.org= /mailman/listinfo/gutvol-d</a><br> or, via email, send a message with subject or body 'help' to<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0 <a href=3D"mailto:gutvol-d-request-4LCm/[email protected]= org" target=3D"_blank">gutvol-d-request-4LCm/o+qPMZ96Xl/[email protected]</a><br> <br> You can reach the person managing the list at<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0 <a href=3D"mailto:gutvol-d-owner-4LCm/[email protected]= g" target=3D"_blank">gutvol-d-owner-4LCm/o+qPMZ96Xl/[email protected]</a><br> <br> When replying, please edit your Subject line so it is more specific<br> than "Re: Contents of gutvol-d digest..."<br> Today's Topics:<br> <br> =C2=A0 =C2=A01. File Recode Service is not functional (Rick Tonsing)<br> =C2=A0 =C2=A02. UTF-8 File Names (Rick Tonsing)<br> =C2=A0 =C2=A03. Re: UTF-8 File Names (Greg Newby)<br> =C2=A0 =C2=A04. Re: File Recode Service is not functional (Greg Newby)<br> =C2=A0 =C2=A05. Re: UTF-8 File Names (Al Haines)<br> <br><br><br>---------- Forwarded message ----------<br>From:=C2=A0Rick Tons= ing <<a href=3D"mailto:[email protected]" target=3D"_blank">okrick@gmail.= com</a>><br>To:=C2=A0<a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target= =3D"_blank">gutvol-d-4LCm/o+qPMZ96Xl/[email protected]</a><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date= :=C2=A0Sat, 4 Jan 2020 16:43:08 -0800<br>Subject:=C2=A0[gutvol-d] File Reco= de Service is not functional<br><div dir=3D"ltr"><div style=3D"font-family:= georgia,serif;font-size:large"> <div style=3D"font-family:georgia,serif;font-size:large">FYI</div><div styl= e=3D"font-family:georgia,serif;font-size:large"><br></div><div style=3D"fon= t-family:georgia,serif;font-size:large">I noticed that your <a href=3D"http= s://www.gutenberg.org/catalog/world/recode" target=3D"_blank">File Recode S= ervice</a> is not functional.=C2=A0 Specifically, there is no method for en= tering the Filename for testing.=C2=A0 It appears to be intentional.</div><= div style=3D"font-family:georgia,serif;font-size:large"><br></div><div styl= e=3D"font-family:georgia,serif;font-size:large">However, if the site is int= entionally disabled then you should probably also disable the link from &qu= ot;<a href=3D"https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#Ab= out_the_characters_you_use" target=3D"_blank">V.74. What characters can I u= se?</a>"</div><div style=3D"font-family:georgia,serif;font-size:large"= ><br></div><div style=3D"font-family:georgia,serif;font-size:large">Cheers,= </div><div style=3D"font-family:georgia,serif;font-size:large"><br></div><d= iv style=3D"font-family:georgia,serif;font-size:large">Rick</div> </div></div> <br><br><br>---------- Forwarded message ----------<br>From:=C2=A0Rick Tons= ing <<a href=3D"mailto:[email protected]" target=3D"_blank">okrick@gmail.= com</a>><br>To:=C2=A0<a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target= =3D"_blank">gutvol-d-4LCm/o+qPMZ96Xl/[email protected]</a><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date= :=C2=A0Sat, 4 Jan 2020 23:00:28 -0800<br>Subject:=C2=A0[gutvol-d] UTF-8 Fil= e Names<br><div dir=3D"ltr"><div style=3D"font-family:georgia,serif;font-si= ze:large">The subject of file names with xxxx-lt1.txt or=20 xxxx-lat1.txt for Latin-1 and the xxxx-utf8.txt for UTF-8 text files came u= p in a <a href=3D"https://www.pgdp.net/phpBB3/viewtopic.php?p=3D1189531#p11= 89531" target=3D"_blank">DP forum</a>.</div><div style=3D"font-family:georg= ia,serif;font-size:large"><br></div><div style=3D"font-family:georgia,serif= ;font-size:large">The gist of the discussion (as I see it) is that we selec= t the file type on the direct upload screen.=C2=A0 Do we even need an indic= ator of the file type in the file name?=C2=A0 If so, then do we need both? = UTF8 is be the default so xxxx.txt without the (-UTF8) should be sufficient= for UTF-8 files.=C2=A0 The -lt1 or -lat1 could remain the backup signal th= at the file needs to go through the upconvert program to UTF-8.<br></div><d= iv style=3D"font-family:georgia,serif;font-size:large"><br></div><div style= =3D"font-family:georgia,serif;font-size:large">Cheers,</div><div style=3D"f= ont-family:georgia,serif;font-size:large"><br></div><div style=3D"font-fami= ly:georgia,serif;font-size:large">Rick<br></div></div> <br><br><br>---------- Forwarded message ----------<br>From:=C2=A0Greg Newb= y <<a href=3D"mailto:[email protected]" target=3D"_blank">gbnewby@pglaf.= org</a>><br>To:=C2=A0Project Gutenberg Volunteer Discussion <<a href= =3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d-4LCm/[email protected]= .org</a>><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date:=C2=A0Sun, 5 Jan 2020 06:55= :12 -0800<br>Subject:=C2=A0Re: [gutvol-d] UTF-8 File Names<br>Hi, Rick. The= whitewashers get whatever you upload. No transformation or conversion is d= one automatically: it's just a .zip file that they download and process= .<br> <br> Informative filenames are fine. Any text should end in .txt<br> =C2=A0- Greg<br> <br> <br> <br> On Sat, Jan 04, 2020 at 11:00:28PM -0800, Rick Tonsing wrote:<br> > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for Latin= -1<br> > and the xxxx-utf8.txt for UTF-8 text files came up in a DP forum<br> > <<a href=3D"https://www.pgdp.net/phpBB3/viewtopic.php?p=3D1189531#p= 1189531" rel=3D"noreferrer" target=3D"_blank">https://www.pgdp.net/phpBB3/v= iewtopic.php?p=3D1189531#p1189531</a>>.<br> > <br> > The gist of the discussion (as I see it) is that we select the file ty= pe on<br> > the direct upload screen.=C2=A0 Do we even need an indicator of the fi= le type in<br> > the file name?=C2=A0 If so, then do we need both? UTF8 is be the defau= lt so<br> > xxxx.txt without the (-UTF8) should be sufficient for UTF-8 files.=C2= =A0 The<br> > -lt1 or -lat1 could remain the backup signal that the file needs to go= <br> > through the upconvert program to UTF-8.<br> > <br> > Cheers,<br> > <br> > Rick<br> <br> > _______________________________________________<br> > gutvol-d mailing list<br> > <a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d= @lists.pglaf.org</a><br> > <a href=3D"https://lists.pglaf.org/mailman/listinfo/gutvol-d" rel=3D"n= oreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/listinfo/gutvo= l-d</a><br> > Unsubscribe: <a href=3D"https://lists.pglaf.org/mailman/options/gutvol= -d" rel=3D"noreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/op= tions/gutvol-d</a><br> <br> <br> <br><br><br>---------- Forwarded message ----------<br>From:=C2=A0Greg Newb= y <<a href=3D"mailto:[email protected]" target=3D"_blank">gbnewby@pglaf.= org</a>><br>To:=C2=A0Project Gutenberg Volunteer Discussion <<a href= =3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d-4LCm/[email protected]= .org</a>><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date:=C2=A0Sun, 5 Jan 2020 07:07= :08 -0800<br>Subject:=C2=A0Re: [gutvol-d] File Recode Service is not functi= onal<br>Hi, Rick. It looks like that was never working. It doesn't have= any code for actually uploading or processing a file.<br> <br> I've edited it to indicate it's no longer in use.<br> <br> Concerning the FAQ, etc.: This will soon be deprecated. The new site is fin= ally nearly ready, and can be viewed here:<br> =C2=A0 <a href=3D"https://dev.gutenberg.org" rel=3D"noreferrer" target=3D"_= blank">https://dev.gutenberg.org</a><br> <br> We've tried to move/remove everything outdated. Stuff that is moved to = the "atic" area is clearly marked as no longer being accurate.<br= > <br> There are just a few more things to be fixed before we open this for more w= idespread testing. There are also a few things that will not move yet.<br> <br> Fixes/edits can be emailed, or use a pull request here: <a href=3D"https://= github.com/gbnewby/gutenbergsite" rel=3D"noreferrer" target=3D"_blank">http= s://github.com/gbnewby/gutenbergsite</a><br> =C2=A0- Greg<br> <br> On Sat, Jan 04, 2020 at 04:43:08PM -0800, Rick Tonsing wrote:<br> >=C2=A0 FYI<br> > <br> > I noticed that your File Recode Service<br> > <<a href=3D"https://www.gutenberg.org/catalog/world/recode" rel=3D"= noreferrer" target=3D"_blank">https://www.gutenberg.org/catalog/world/recod= e</a>> is not functional.<br> > Specifically, there is no method for entering the Filename for testing= .=C2=A0 It<br> > appears to be intentional.<br> > <br> > However, if the site is intentionally disabled then you should probabl= y<br> > also disable the link from "V.74. What characters can I use?<br> > <<a href=3D"https://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_= FAQ#About_the_characters_you_use" rel=3D"noreferrer" target=3D"_blank">http= s://www.gutenberg.org/wiki/Gutenberg:Volunteers%27_FAQ#About_the_characters= _you_use</a>><br> > "<br> > <br> > Cheers,<br> > <br> > Rick<br> <br> > _______________________________________________<br> > gutvol-d mailing list<br> > <a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d= @lists.pglaf.org</a><br> > <a href=3D"https://lists.pglaf.org/mailman/listinfo/gutvol-d" rel=3D"n= oreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/listinfo/gutvo= l-d</a><br> > Unsubscribe: <a href=3D"https://lists.pglaf.org/mailman/options/gutvol= -d" rel=3D"noreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/op= tions/gutvol-d</a><br> <br> <br> <br><br><br>---------- Forwarded message ----------<br>From:=C2=A0Al Haines= <<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]= </a>><br>To:=C2=A0<<a href=3D"mailto:[email protected]" target=3D"_bl= ank">[email protected]</a>>, "'Project Gutenberg Volunteer Disc= ussion'" <<a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D= "_blank">gutvol-d-4LCm/o+qPMZ96Xl/[email protected]</a>>, "Joseph E. Loewenstein, M.D= ." <<a href=3D"mailto:[email protected]" target=3D"_blank">loe= [email protected]</a>>, "'Al Haines'" <<a href=3D= "mailto:[email protected]" target=3D"_blank">[email protected]</a>>, "= ;'Chuck Greif'" <<a href=3D"mailto:cbgrf-/[email protected]" target= =3D"_blank">cbgrf-/[email protected]</a>>, "'David Widger'" <= ;<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]= </a>><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date:=C2=A0Sun, 5 Jan 2020 11:51:53 = -0800<br>Subject:=C2=A0Re: [gutvol-d] UTF-8 File Names<br>UTF8 text files s= hould have "-utf8" in their file names, e.g.<br> "myfile-utf8.txt".=C2=A0 This forces PG's posting software to= treat text<br> files as UTF8, rather than its defaulting to Latin1/ASCII.=C2=A0 (This has<= br> been a de facto standard for some years now.)=C2=A0 It's not necessary = to do<br> this for HTML files.<br> <br> If necessary, the posting software will prompt for the correct character<br= > set, but it's an easy prompt to skip through, or give the wrong answer<= br> to.=C2=A0 The presence of "-utf8" in the filename obviates the ne= ed for the<br> prompt.=C2=A0 Latin1/ASCII text files don't trigger the prompt at all.<= br> <br> If PG's upload check reports a UTF8 text file without the "-utf8&q= uot;, then<br> I rename the file inside the zip file, before unzipping it.<br> <br> Conversely, if a text file arrives with "-lat1", "-ltn1"= ;, "-iso",<br> "-asc", or some such Latin1/ASCII indicator, I rename the file to= remove<br> it, since addhd handles Latin1/ASCII files correctly.<br> <br> Also, to avoid spurious files generated by the posting software, I make<br> sure the base name of the zip file is the same as the base names of the<br> text and HTML files, e.g. myfile.zip contains myfile.txt (or<br> myfile-utf8.txt) and myfile.htm.<br> <br> Re HTML files: PG's extension for them is ".htm".=C2=A0 When = an uploaded zip<br> file contains an HTML file with the extension ".html", I rename i= t, as<br> mentioned above.=C2=A0 If this isn't done, the posting software copies = the<br> file to a new file with the extension ".htm", e.g. "myfile.h= tml" is<br> copied to "myfile.htm", leaving a spurious ".html" file= .=C2=A0 (BTW, the<br> posting software never, ever, modifies the submitted files--it copies<br> them to new files with the required name, then works with the new<br> files.)<br> <br> While I'm at it, more on file names...<br> <br> As mentioned above, I rename text and HTML files, and sometimes zip<br> files, so that their base names are the same (except for the "-utf8&qu= ot;<br> part of text files).=C2=A0 There's no need for text/HTML files to have = some<br> versioning component.=C2=A0 For example, I recently handled a zip file name= d<br> diam-pg.zip, which contained diam-b.html and diam-cc-utf8.txt.=C2=A0 I<br> renamed the files to remove the "-b" and "-cc" parts, a= nd the zip file<br> to remove the "-pg" part, of their respective names.<br> <br> I've also seen names like "myfile-text.txt" and "myfile-= html.html", and<br> "myfile-8.txt" and "myfile-h.html".=C2=A0 There's n= o need for such<br> double-indicators of a file's type.<br> <br> There have been any number of similar variations, some probably related<br> to the PPer's versioning system as they work through the PPing process;= <br> some related the PPing software.<br> <br> In one of the DP posts are these fragments:<br> <br> > All of PG uploads are currently UTF-8, even if the file is Latin-1. <b= r> <br> No idea where this idea comes from, but it's wrong.=C2=A0 See below.<br= > <br> > Or even do away with the appending altogether. The direct upload panel= <br> lets<br> > the White Washers know what encoding to expect. So they know to run<br= > the <br> > program to convert the Latin-1 characters to UTF-8.<br> <br> Also wrong.=C2=A0 The WWers don't see PG's upload screen (except fo= r their<br> own projects).=C2=A0 They also never convert Latin1 to UTF8--that's don= e to<br> posted Latin1/ASCII files by PG's behind-the-scenes software, which the= <br> WWers have no control over.<br> <br> I think that's sufficient food for thought/discussion for now...<br> <br> <br> Al<br> <br> <br> <br> <br> > -----Original Message-----<br> > From: gutvol-d [mailto:<a href=3D"mailto:gutvol-d-bounces-4LCm/[email protected]= org" target=3D"_blank">gutvol-d-bounces-4LCm/o+qPMZ96Xl/[email protected]</a>] On <br> > Behalf Of Greg Newby<br> > Sent: Sunday, January 05, 2020 6:55 AM<br> > To: Project Gutenberg Volunteer Discussion<br> > Subject: Re: [gutvol-d] UTF-8 File Names<br> > <br> > <br> > Hi, Rick. The whitewashers get whatever you upload. No <br> > transformation or conversion is done automatically: it's just <br> > a .zip file that they download and process.<br> > <br> > Informative filenames are fine. Any text should end in .txt<br> >=C2=A0 - Greg<br> > <br> > <br> > <br> > On Sat, Jan 04, 2020 at 11:00:28PM -0800, Rick Tonsing wrote:<br> > > The subject of file names with xxxx-lt1.txt or xxxx-lat1.txt for = <br> > > Latin-1 and the xxxx-utf8.txt for UTF-8 text files came up in a D= P <br> > > forum <br> > <<a href=3D"https://www.pgdp.net/phpBB3/viewtopic.php?p=3D1189531#p= 1189531" rel=3D"noreferrer" target=3D"_blank">https://www.pgdp.net/phpBB3/v= iewtopic.php?p=3D1189531#p1189531</a>><br> .<br> > <br> > The gist of the discussion (as I see it) is that we select the file <b= r> > type on the direct upload screen.=C2=A0 Do we even need an indicator o= f the<br> <br> > file type in the file name?=C2=A0 If so, then do we need both? UTF8 is= be <br> > the default so xxxx.txt without the (-UTF8) should be sufficient for <= br> > UTF-8 files.=C2=A0 The -lt1 or -lat1 could remain the backup signal th= at <br> > the file needs to go through the upconvert program to UTF-8.<br> > <br> > Cheers,<br> > <br> > Rick<br> <br> > _______________________________________________<br> > gutvol-d mailing list<br> > <a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d= @lists.pglaf.org</a> <br> > <a href=3D"https://lists.pglaf.org/mailman/listinfo/gutvol-d" rel=3D"n= oreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/listinfo/gutvo= l-d</a><br> > Unsubscribe: <a href=3D"https://lists.pglaf.org/mailman/options/gutvol= -d" rel=3D"noreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/op= tions/gutvol-d</a><br> <br> _______________________________________________<br> gutvol-d mailing list<br> <a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d@list= s.pglaf.org</a><br> <a href=3D"https://lists.pglaf.org/mailman/listinfo/gutvol-d" rel=3D"norefe= rrer" target=3D"_blank">https://lists.pglaf.org/mailman/listinfo/gutvol-d</= a><br> Unsubscribe: <a href=3D"https://lists.pglaf.org/mailman/options/gutvol-d" r= el=3D"noreferrer" target=3D"_blank">https://lists.pglaf.org/mailman/options= /gutvol-d</a><br> <br> <br> _______________________________________________<br> gutvol-d mailing list<br> <a href=3D"mailto:gutvol-d-4LCm/o+qPMZ96Xl/[email protected]" target=3D"_blank">gutvol-d@list= s.pglaf.org</a><br> <a href=3D"https://lists.pglaf.org/mailman/listinfo/gutvol-d" rel=3D"norefe= rrer" target=3D"_blank">https://lists.pglaf.org/mailman/listinfo/gutvol-d</= a><br> </blockquote></div></div> --000000000000bd4ce4059b6a301a-- --===============6759537443125597921== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: inline X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KZ3V0dm9sLWQg bWFpbGluZyBsaXN0Cmd1dHZvbC1kQGxpc3RzLnBnbGFmLm9yZwpodHRwczovL2xpc3RzLnBnbGFm Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL2d1dHZvbC1kClVuc3Vic2NyaWJlOiBodHRwczovL2xpc3Rz LnBnbGFmLm9yZy9tYWlsbWFuL29wdGlvbnMvZ3V0dm9sLWQ= --===============6759537443125597921==--