Re: [native-lang] native language webcontent developers please review your filenames for invalid non UTF-8 characters

--------------040301080308010600070505
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit

On 23.11.2010 08:55, Maho NAKATA wrote:
> Hi Bernd,
>   
Hi Maho!
> How we know where we use invalid non UTF-8 characters?
> It's not immediately clear to me.
>   
When you are in an environment where you have UTF-8 encoding set (eg. a 
Unix shell with the LANG=en-US.UTF-8 environment set) than list your 
files and there see any special chars that do not belong to your 
language eg. just a square or you see something like \234 being 
displayed instead of a char or similar than you know someone has 
commited those files using a different encoding, eg. BIG-5.

Another simple possible test is trying to import the whole CVS archive 
into an SVN Repository while having LANG=en-US.UTF-8 or similar set. The 
"svn import" command would complain on any non UTF-8 chars in that case.

> thanks,
>  Nakata Maho
>   

Kind regards,
Bernd Eilers

> From: Bernd Eilers <[email protected]>
> Subject: [native-lang] native language webcontent developers please review your filenames for invalid non UTF-8 characters
> Date: Mon, 22 Nov 2010 17:49:40 +0100
>
>   
>> Hi native language communities and esp. the WebContent developers
>> among you!
>>
>> I recently stumbled over a few filenames in OpenOffice.org's
>> webcontent which have invalid non-UTF-8 characters in their filenames.
>>
>> The character encoding to be used for webconent checked into
>> OpenOffice.org´s webcontent CVS repository is UTF-8. Please make sure
>> to use an UTF-8 locale when checking in files with non-us-AscII
>> chars. For example if you are in france and are using some Unix OS set
>> LANG=fr.UTF-8 and not LANG=fr.ISO8859-15. GUI CVS Clients used on
>> Windows often allow to specify the encoding to be used explicitly.
>>
>> Filenames with other encodings will not work and what is even worse
>> they do create a big problem when moving OpenOffice.org to the new
>> kenai based infrastructure.
>> While CVS does not care much about invalid chars in filenames
>> subversion which will be used on the new infrastructure does treat
>> those filenames as errornous and as a result will not import the whole
>> project at all.
>>
>> Could native language projects webcontent developers please review
>> their webcontent and change anything that is currently not UTF-8
>> compliant. And that means not only to copy the broken files to new
>> valid ones but also deleting the broken filenames from the CVS
>> repository!
>>
>> For example there are 2 broken directory names in
>> fr/www/Documentation/Gallery starting with the letters "fl" and than
>> some non UTF-8 encoded char.
>>
>> Kind regards,
>> Bernd Eilers
>> -- 
>>
>> <http://www.oracle.com/>
>> Bernd Eilers | Software Engineer
>> Phone: +49 40 23 646 967
>>
>> ORACLE Deutschland B.V. & Co. KG | Nagelsweg 55 | 20097 Hamburg
>>
>> ORACLE Deutschland B.V. & Co. KG
>> Hauptverwaltung: Riesstr. 25, D-80992 München
>> Registergericht: Amtsgericht München, HRA 95603
>>
>> Komplementärin: ORACLE Deutschland Verwaltung B.V.
>> Rijnzathe 6, 3454PV De Meern, Niederlande
>> Handelsregister der Handelskammer Midden-Niederlande, Nr. 30143697
>> Geschäftsführer: Jürgen Kunz, Marcel van de Molen, Alexander van der
>> Ven
>>
>> <http://www.oracle.com/commitment>
>>
>> 	
>>
>> Oracle is committed to developing practices and products that help
>> protect the environment
>>
>>
>>
>>     
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>
>
>
>   


-- 

<http://www.oracle.com/>
Bernd Eilers | Software Engineer
Phone: +49 40 23 646 967

ORACLE Deutschland B.V. & Co. KG | Nagelsweg 55 | 20097 Hamburg

ORACLE Deutschland B.V. & Co. KG
Hauptverwaltung: Riesstr. 25, D-80992 München
Registergericht: Amtsgericht München, HRA 95603

Komplementärin: ORACLE Deutschland Verwaltung B.V.
Rijnzathe 6, 3454PV De Meern, Niederlande
Handelsregister der Handelskammer Midden-Niederlande, Nr. 30143697
Geschäftsführer: Jürgen Kunz, Marcel van de Molen, Alexander van der Ven

<http://www.oracle.com/commitment>

	

Oracle is committed to developing practices and products that help 
protect the environment




--------------040301080308010600070505
Content-Type: multipart/related;
 boundary="------------060008020209040205070500"


--------------060008020209040205070500
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
  <title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
On 23.11.2010 08:55, Maho NAKATA wrote:
<blockquote
 cite="mid:[email protected]"
 type="cite">
  <pre wrap="">Hi Bernd,
  </pre>
</blockquote>
Hi Maho!<br>
<blockquote
 cite="mid:[email protected]"
 type="cite">
  <pre wrap="">
How we know where we use invalid non UTF-8 characters?
It's not immediately clear to me.
  </pre>
</blockquote>
When you are in an environment where you have UTF-8 encoding set (eg. a
Unix shell with the LANG=en-US.UTF-8 environment set) than list your
files and there see any special chars that do not belong to your
language eg. just a square or you see something like \234 being
displayed instead of a char or similar than you know someone has
commited those files using a different encoding, eg. BIG-5.<br>
<br>
Another simple possible test is trying to import the whole CVS archive
into an SVN Repository while having LANG=en-US.UTF-8 or similar set.
The "svn import" command would complain on any non UTF-8 chars in that
case.<br>
<br>
<blockquote
 cite="mid:[email protected]"
 type="cite">
  <pre wrap="">
thanks,
 Nakata Maho
  </pre>
</blockquote>
<br>
Kind regards,<br>
Bernd Eilers<br>
<br>
<blockquote
 cite="mid:[email protected]"
 type="cite">
  <pre wrap="">
From: Bernd Eilers <a class="moz-txt-link-rfc2396E" href="mailto:[email protected]">&lt;[email protected]&gt;</a>
Subject: [native-lang] native language webcontent developers please review your filenames for invalid non UTF-8 characters
Date: Mon, 22 Nov 2010 17:49:40 +0100

  </pre>
  <blockquote type="cite">
    <pre wrap="">Hi native language communities and esp. the WebContent developers
among you!

I recently stumbled over a few filenames in OpenOffice.org's
webcontent which have invalid non-UTF-8 characters in their filenames.

The character encoding to be used for webconent checked into
OpenOffice.org&acute;s webcontent CVS repository is UTF-8. Please make sure
to use an UTF-8 locale when checking in files with non-us-AscII
chars. For example if you are in france and are using some Unix OS set
LANG=fr.UTF-8 and not LANG=fr.ISO8859-15. GUI CVS Clients used on
Windows often allow to specify the encoding to be used explicitly.

Filenames with other encodings will not work and what is even worse
they do create a big problem when moving OpenOffice.org to the new
kenai based infrastructure.
While CVS does not care much about invalid chars in filenames
subversion which will be used on the new infrastructure does treat
those filenames as errornous and as a result will not import the whole
project at all.

Could native language projects webcontent developers please review
their webcontent and change anything that is currently not UTF-8
compliant. And that means not only to copy the broken files to new
valid ones but also deleting the broken filenames from the CVS
repository!

For example there are 2 broken directory names in
fr/www/Documentation/Gallery starting with the letters "fl" and than
some non UTF-8 encoded char.

Kind regards,
Bernd Eilers
-- 

<a class="moz-txt-link-rfc2396E" href="http://www.oracle.com/">&lt;http://www.oracle.com/&gt;</a>
Bernd Eilers | Software Engineer
Phone: +49 40 23 646 967

ORACLE Deutschland B.V. &amp; Co. KG | Nagelsweg 55 | 20097 Hamburg

ORACLE Deutschland B.V. &amp; Co. KG
Hauptverwaltung: Riesstr. 25, D-80992 M&uuml;nchen
Registergericht: Amtsgericht M&uuml;nchen, HRA 95603

Komplement&auml;rin: ORACLE Deutschland Verwaltung B.V.
Rijnzathe 6, 3454PV De Meern, Niederlande
Handelsregister der Handelskammer Midden-Niederlande, Nr. 30143697
Gesch&auml;ftsf&uuml;hrer: J&uuml;rgen Kunz, Marcel van de Molen, Alexander van der
Ven

<a class="moz-txt-link-rfc2396E" href="http://www.oracle.com/commitment">&lt;http://www.oracle.com/commitment&gt;</a>

	

Oracle is committed to developing practices and products that help
protect the environment



    </pre>
  </blockquote>
  <pre wrap=""><!---->
---------------------------------------------------------------------
To unsubscribe, e-mail: <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a>
For additional commands, e-mail: <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a>



  </pre>
</blockquote>
<br>
<br>
<div class="moz-signature">-- <br>
<meta http-equiv="CONTENT-TYPE" content="text/html; ">
<p><a href="http://www.oracle.com/" target="_blank"><img
 src="cid:[email protected]" name="Grafik1"
 align="bottom" border="0" height="26" width="114"></a><br>
<font color="#666666"><font face="Verdana, Arial, Helvetica, sans-serif"><font
 style="font-size: 8pt;" size="1">Bernd Eilers
| Software Engineer<br>
Phone: +49 40 23 646 967 <br>
</font></font></font></p>
<p><font style="font-size: 8pt;" size="1"><font color="#666666"><font
 face="Verdana, Arial, Helvetica, sans-serif">ORACLE
Deutschland B.V. &amp; Co. KG | Nagelsweg 55 | 20097 Hamburg</font></font></font></p>
<p><font style="font-size: 8pt;" size="1"><font color="#666666"><font
 face="Verdana, Arial, Helvetica, sans-serif">ORACLE
Deutschland B.V. &amp; Co. KG<br>
Hauptverwaltung: Riesstr. 25,
D-80992 M&uuml;nchen<br>
Registergericht: Amtsgericht M&uuml;nchen, HRA
95603<br>
<br>
Komplement&auml;rin: ORACLE Deutschland Verwaltung
B.V.<br>
Rijnzathe 6, 3454PV De Meern, Niederlande<br>
Handelsregister
der Handelskammer Midden-Niederlande, Nr. 30143697<br>
Gesch&auml;ftsf&uuml;hrer:
J&uuml;rgen Kunz, Marcel van de Molen, Alexander van der Ven </font></font></font>
</p>
<table border="0" cellpadding="0" cellspacing="0" width="100%">
  <tbody>
    <tr>
      <td valign="top" width="44">
      <p align="left"><a href="http://www.oracle.com/commitment"
 target="_blank"><img src="cid:[email protected]"
 name="Grafik2" align="absbottom" border="0" height="28" width="44"></a></p>
      </td>
      <td width="100%">
      <p align="left"><font color="#4b7d42"><font
 face="Verdana, Arial, Helvetica, sans-serif"><font
 style="font-size: 6pt;" size="1">Oracle is committed to developing
practices and products that help protect the environment</font></font></font></p>
      </td>
    </tr>
  </tbody>
</table>
<p><br>
<br>
</p>
</div>
</body>
</html>

--------------060008020209040205070500
Content-Type: image/gif;
 name="Grafik1"
Content-Transfer-Encoding: base64
Content-ID: <[email protected]>
Content-Disposition: inline;
 filename="Grafik1"

R0lGODlhcgAaAMQAAP8QEP/w8P/Q0P/g4P8wMP9gYP8gIP+goP9QUP+QkP+wsP9wcP+AgP9A
QP/AwP8AAP///wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
ACH5BAAAAAAALAAAAAByABoAAAX/ICSOZGmeaKqubOu+cCzPdC0GCqPvvBKUDp5wp1gFdIPV
IDfcOQa6A8yRaO4gweQoUHh4v2Bw4SdihM9egyBF8ALIpkEXDR44vA2XwkD/IgYGAAZbbX1n
BGRmhl8AWiUJYicCAIsPDFh4LXOGjQ4NAAhrEIUPBQcOqKmoB5sEZV4JqqoHhQVxlGAOJQG4
AAunsqg/dw95KwdfBgzBqKIEBMaQDwCiKpOwEIq6KANuJg14igZwEHPULMTGKbxetjF8D1It
xK7aKl8lCl8DAfALW1+2rUi3QtqgGN2mwYCXzYvAON624LoEQZ9DEfRcEFSBIE2DjyBDfnyI
qRgMcA8a/z5AZQWXOxEdHxwUgfIgsX/zMqlAWclVCQFefLpAqdJBAFJn3owgtpJEQkslEWjU
mYLnomokcDlS4s0eFzQNqvXDEyzmAwFPyaXYmGJBuxlzELWIacueiE0AFGyF4HbaNTquUEpF
RxUFUC9YXQzARYAkEJSNipKQ9kDu0i9SKKNZ9iXswMIoYgI4oJYFskpgzkkmcdrviELqmPVt
1HpRAaaLqCE1lBgjvEpqRtgl8Tevygd7TcCuiKvPm8OVEkAIYLYPThSsRIpEQJr1x94QBIT0
9FH6QJC6AiRAoB1kEb7tRb4MvyB+AwSlbejfz7+///8ABijggAQWaOCBCCao4A+CDDbo4IMQ
RijhhBQKGAIAOw==
--------------060008020209040205070500
Content-Type: image/gif;
 name="Grafik2"
Content-Transfer-Encoding: base64
Content-ID: <[email protected]>
Content-Disposition: inline;
 filename="Grafik2"

R0lGODlhLAAcAMQAAP///0x9RHmec9Pf0aa+oleFULHGrmKNW+nv6I+uivT39N7n3W6VZ7zP
uZu2lsjXxYSmfwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
ACH5BAAAAAAALAAAAAAsABwAQAXhICCOZGmeaDoaReC+sKAMR7GopIA6boIvLgPAVSAgALxj
SYdrOp/Q6NPgYqIEPkTBV2taTwgGbEw+PAZo3FfKbqMQQfeJ8DoY0Hg0wxhAKBgHCl5XLgMq
DwFCAAIFPIYDgidrOUQGkSh0cQMJAQyXOXKhoqOkpaanI2aoIwMErq+uCY0BMlANKpxkYwQG
BH82TpMicD0pAgQACToDAchqhAG3KQ4HIlQNnErG0IYqB9EAiEQvwEsozC43hy0CAeXMwsLD
LS8MAvf497ruCZ+gOA0gfNt3AIK0J/JWKVzIsEQIADs=
--------------060008020209040205070500--

--------------040301080308010600070505--