Re: Accessing directories with a german "umlaut" in the name
Kevin Edwards <[email protected]> Thu, 13 Jun 2013 00:41:39 -0500
| Newsgroups | gmane.comp.lang.io |
|---|---|
| Message-ID | <[email protected]> |
--------------010407090208060202060607 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit I took a look and the Io .c code doesn't appear to do any codepage conversions. Io just expects UTF-8 to and from Win32 ANSI API calls, while that API expects and provides strings in the ANSI system code page encoding which can't be set to UTF-8. For proper Unicode support on Windows, Io should use the Wide version (UTF-16LE) of the Win32 API and convert back and forth between MultiByte and WideChar. Sorry, this is not an easy fix. Kevin On 6/11/2013 9:40 AM, chuchuchu747 wrote: > Could someone please try this on windows? > I think this is a problem with the windows binaries. > > --- In [email protected], Jeremy Tregunna <jeremy.tregunna@...> wrote: > > > > No, sorry. > > > > Regards, > > > > Jeremy Tregunna > > > > > > On Saturday, 1 June, 2013 at 1:16 PM, chuchuchu747 wrote: > > > > > > > > Hi Jeremy, > > > > > > do you know how I can check (or change) which codepage is used by IO? In the shell self everything works fine. I can create folders with ü and ö and can access them. > > > I have tried "chcp 65001" with no luck. One thing to mention, I have installed a german windows and changed the UI langauge to english. > > > > > > With best regards, > > > Chris > > > > > > --- In [email protected] (mailto:iolanguage%40yahoogroups.com), Jeremy Tregunna <jeremy.tregunna@> wrote: > > > > > > > > That sounds to me like a codepage/encoding issue. If you are using UTF-8 you should have no problem, anything else, and all bets are off. For instance; I run > > > > > > > > $ mkdir Ãf¼ber > > > > $ mkdir Ãf¼ber/foo > > > > > > > > Then in io, this code: > > > > > > > > Io> Directory directories map(name) > > > > ==> list(Ãf¼ber) > > > > Io> Directory directories at(0) items map(name) > > > > ==> list(., ..) > > > > > > > > The above is just a simplification of your code, I can also run your code: > > > > > > > > Io> dir := Directory clone setPath("/Users/jtregunna/Ãf¼ber") > > > > ==> Directory_0x7fc7e98a58e0: > > > > > > > > Io> dir name println > > > > Ãf¼ber > > > > ==> Ãf¼ber > > > > > > > > Io> childs := dir directories map(name) > > > > ==> list(foo) > > > > > > > > Regards, > > > > > > > > Jeremy Tregunna > > > > > > > > > > > > On Saturday, 1 June, 2013 at 3:57 AM, chuchuchu747 wrote: > > > > > > > > > > > > > > Hi All, > > > > > > > > > > when I try to access a folder with a german "umlaut" in the folder name I get an exception: > > > > > > > > > > Rolfs Kinderfrâ"ÂoeâÂ.Â?hling > > > > > > > > > > Exception: Unable to open directory Y:\Shared Music\Kinderlieder\Rolfs Kinderfrâ"ÂoeâÂ.Â?hling > > > > > --------- > > > > > items Directory.io (http://Directory.io) (http://Directory.io) 48 > > > > > Directory directories umlautTest.io (http://umlautTest.io) (http://umlautTest.io) 3 > > > > > CLI doFile Z_CLI.io (http://Z_CLI.io) (http://Z_CLI.io) 140 > > > > > CLI run IoState_runCLI() 1 > > > > > > > > > > The exception occurs when I try to get the subdirectories: > > > > > dir := Directory clone setPath("Y:\\Shared Music\\Kinderlieder\\Rolfs KinderfrÃf¼hling") > > > > > dir name println > > > > > childs := dir directories > > > > > > > > > > The folder has no subdirecotries but that shouldn't raise an exception right? > > > > > I'm running Windows 8 on a german latop but the system language is english. > > > > > Does anyone has an idea? > > > > > > > > > > With best regards, > > > > > Chris > > > > > > > > > > > > > > > > > > > > > > > > > > > ------------------------------------ > > Yahoo! Groups Links > > > > --------------010407090208060202060607 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd"> <html> <head> </head> <body style="background-color: #fff;"> <span style="display:none"> </span> <!--~-|**|PrettyHtmlStartT|**|-~--> <div id="ygrp-mlmsg" style="position:relative;"> <div id="ygrp-msg" style="z-index: 1;"> <!--~-|**|PrettyHtmlEndT|**|-~--> <div id="ygrp-text" > <p> I took a look and the Io .c code doesn't appear to do any codepage conversions. Io just expects UTF-8 to and from Win32 ANSI API calls, while that API expects and provides strings in the ANSI system code page encoding which can't be set to UTF-8.<br> <br> For proper Unicode support on Windows, Io should use the Wide version (UTF-16LE) of the Win32 API and convert back and forth between MultiByte and WideChar.<br> <br> Sorry, this is not an easy fix.<br> <br> Kevin<br> <br> <div class="moz-cite-prefix">On 6/11/2013 9:40 AM, chuchuchu747 wrote:<br> </div> <blockquote class=" cite" id="mid_kp7ct4_pcn7_eGroups_com" cite="mid:[email protected]" type="cite"> <pre wrap>Could someone please try this on windows? I think this is a problem with the windows binaries. --- In <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a>, Jeremy Tregunna <a class="moz-txt-link-rfc2396E" href="mailto:jeremy.tregunna@..."><jeremy.tregunna@...></a> wrote: > > No, sorry. > > Regards, > > Jeremy Tregunna > > > On Saturday, 1 June, 2013 at 1:16 PM, chuchuchu747 wrote: > > > > > Hi Jeremy, > > > > do you know how I can check (or change) which codepage is used by IO? In the shell self everything works fine. I can create folders with ü and ö and can access them. > > I have tried "chcp 65001" with no luck. One thing to mention, I have installed a german windows and changed the UI langauge to english. > > > > With best regards, > > Chris > > > > --- In <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a> (<a class="moz-txt-link-freetext" href="mailto:iolanguage%40yahoogroups.com">mailto:iolanguage%40yahoogroups.com</a>), Jeremy Tregunna <jeremy.tregunna@> wrote: > > > > > > That sounds to me like a codepage/encoding issue. If you are using UTF-8 you should have no problem, anything else, and all bets are off. For instance; I run > > > > > > $ mkdir über > > > $ mkdir über/foo > > > > > > Then in io, this code: > > > > > > Io> Directory directories map(name) > > > ==> list(über) > > > Io> Directory directories at(0) items map(name) > > > ==> list(., ..) > > > > > > The above is just a simplification of your code, I can also run your code: > > > > > > Io> dir := Directory clone setPath("/Users/jtregunna/über") > > > ==> Directory_0x7fc7e98a58e0: > > > > > > Io> dir name println > > > über > > > ==> über > > > > > > Io> childs := dir directories map(name) > > > ==> list(foo) > > > > > > Regards, > > > > > > Jeremy Tregunna > > > > > > > > > On Saturday, 1 June, 2013 at 3:57 AM, chuchuchu747 wrote: > > > > > > > > > > > Hi All, > > > > > > > > when I try to access a folder with a german "umlaut" in the folder name I get an exception: > > > > > > > > Rolfs Kinderfrâ"œâ•hling > > > > > > > > Exception: Unable to open directory Y:\Shared Music\Kinderlieder\Rolfs Kinderfrâ"œâ•hling > > > > --------- > > > > items Directory.io (<a class="moz-txt-link-freetext" href="http://Directory.io">http://Directory.io</a>) (<a class="moz-txt-link-freetext" href="http://Directory.io">http://Directory.io</a>) 48 > > > > Directory directories umlautTest.io (<a class="moz-txt-link-freetext" href="http://umlautTest.io">http://umlautTest.io</a>) (<a class="moz-txt-link-freetext" href="http://umlautTest.io">http://umlautTest.io</a>) 3 > > > > CLI doFile Z_CLI.io (<a class="moz-txt-link-freetext" href="http://Z_CLI.io">http://Z_CLI.io</a>) (<a class="moz-txt-link-freetext" href="http://Z_CLI.io">http://Z_CLI.io</a>) 140 > > > > CLI run IoState_runCLI() 1 > > > > > > > > The exception occurs when I try to get the subdirectories: > > > > dir := Directory clone setPath("Y:\\Shared Music\\Kinderlieder\\Rolfs Kinderfrühling") > > > > dir name println > > > > childs := dir directories > > > > > > > > The folder has no subdirecotries but that shouldn't raise an exception right? > > > > I'm running Windows 8 on a german latop but the system language is english. > > > > Does anyone has an idea? > > > > > > > > With best regards, > > > > Chris > > > > > > > > > > > > > > > > ------------------------------------ Yahoo! Groups Links <*> To visit your group on the web, go to: <a class="moz-txt-link-freetext" href="http://groups.yahoo.com/group/iolanguage/">http://groups.yahoo.com/group/iolanguage/</a> <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: <a class="moz-txt-link-freetext" href="http://groups.yahoo.com/group/iolanguage/join">http://groups.yahoo.com/group/iolanguage/join</a> (Yahoo! ID required) <*> To change settings via email: <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a> <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a> <*> To unsubscribe from this group, send an email to: <a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a> <*> Your use of Yahoo! Groups is subject to: <a class="moz-txt-link-freetext" href="http://docs.yahoo.com/info/terms/">http://docs.yahoo.com/info/terms/</a> </pre> </blockquote> <br> </p> </div> <!--~-|**|PrettyHtmlStart|**|-~--> <div style="color: #fff; height: 0;">__._,_.___</div> <table cellspacing=4px style="margin-top: 20px; margin-bottom: 10px;"> <tbody> <tr> <td style="font-size: 12px; font-family: arial; font-weight: bold; padding: 7px 5px 5px; color: #FFF; background-color: #F2F2F2; border: 1px solid #EAEAEA " > <a style="text-decoration: none; color: #2D50FD" href="http://groups.yahoo.com/group/iolanguage/post;_ylc=X3oDMTJxNm4zYTNiBF9TAzk3MzU5NzE0BGdycElkAzY2Nzc0NzYEZ3Jwc3BJZAMxNzA1MDA2NzY0BG1zZ0lkAzEzMzM5BHNlYwNmdHIEc2xrA3JwbHkEc3RpbWUDMTM3MTEwMjA5Nw--?act=reply&messageNum=13339">Reply via web post</a> </td> <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px; color: #FFF; background-color: #F2F2F2; border: 1px solid #EAEAEA; " > <a href="mailto:[email protected]?subject=Re%3A%20%5BIo%5D%20Accessing%20directories%20with%20a%20german%20%22umlaut%22%20in%20the%20name" style="text-decoration: none; color: #2D50FD;"> Reply to sender </a> </td> <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px; color: #FFF; background-color: #F2F2F2; border: 1px solid #EAEAEA; "> <a href="mailto:[email protected]?subject=Re%3A%20%5BIo%5D%20Accessing%20directories%20with%20a%20german%20%22umlaut%22%20in%20the%20name" style="text-decoration: none; color: #2D50FD"> Reply to group </a> </td> <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px; color: #FFF; background-color: #F2F2F2; border: 1px solid #EAEAEA; " > <a href="http://groups.yahoo.com/group/iolanguage/post;_ylc=X3oDMTJlZ3ZyMzc4BF9TAzk3MzU5NzE0BGdycElkAzY2Nzc0NzYEZ3Jwc3BJZAMxNzA1MDA2NzY0BHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTM3MTEwMjA5Nw--" style="text-decoration: none; color: #2D50FD">Start a New Topic</a> </td> <td style="font-size: 12px; font-family: arial; padding: 7px 5px 5px; color: #2D50FD; background-color: #F2F2F2; border: 1px solid #EAEAEA; " > <a href="http://groups.yahoo.com/group/iolanguage/message/13334;_ylc=X3oDMTM2MG1rbmoxBF9TAzk3MzU5NzE0BGdycElkAzY2Nzc0NzYEZ3Jwc3BJZAMxNzA1MDA2NzY0BG1zZ0lkAzEzMzM5BHNlYwNmdHIEc2xrA3Z0cGMEc3RpbWUDMTM3MTEwMjA5NwR0cGNJZAMxMzMzNA--" style="text-decoration: none; color: #2D50FD;">Messages in this topic</a> (6) </td> </tr> </tbody> </table> <!------- Start Nav Bar ------> <!-- |**|begin egp html banner|**| --> <!-- |**|end egp html banner|**| --> <!-- |**|begin egp html banner|**| --> <div id="ygrp-vital" style="background-color: #f2f2f2; font-family: Verdana; font-size: 10px; margin-bottom: 10px; padding: 10px;"> <span id="vithd" style="font-weight: bold; color: #333; text-transform: uppercase; ">Recent Activity:</span> <ul style="list-style-type: none; margin: 0; padding: 0; display: inline;"> </ul> <div style="clear: both; padding-top: 2px; color: #1e66ae;"> <a href="http://groups.yahoo.com/group/iolanguage;_ylc=X3oDMTJlN28wNHFmBF9TAzk3MzU5NzE0BGdycElkAzY2Nzc0NzYEZ3Jwc3BJZAMxNzA1MDA2NzY0BHNlYwN2dGwEc2xrA3ZnaHAEc3RpbWUDMTM3MTEwMjA5Nw--" style="text-decoration: none;">Visit Your Group</a> </div> </div> <div id="ft" style="font-family: Arial; font-size: 11px; margin-top: 5px; padding: 0 2px 0 0; clear: both;"> <a href="http://groups.yahoo.com/;_ylc=X3oDMTJkZ3Rrc3FhBF9TAzk3NDc2NTkwBGdycElkAzY2Nzc0NzYEZ3Jwc3BJZAMxNzA1MDA2NzY0BHNlYwNmdHIEc2xrA2dmcARzdGltZQMxMzcxMTAyMDk3" style="float: left;"><img src="http://l.yimg.com/a/i/us/yg/logo/us.gif" height="15" width="137" alt="Yahoo! Groups" style="border: 0;"/></a> <div style="color: #747575; float: right;">Switch to: <a href="mailto:[email protected]?subject=Change Delivery Format: Traditional" style="text-decoration: none;">Text-Only</a>, <a href="mailto:[email protected]?subject=Email Delivery: Digest" class="margin-rt" style="text-decoration: none;">Daily Digest</a> • <a href="mailto:[email protected]?subject=Unsubscribe" style="text-decoration: none;">Unsubscribe</a> • <a href="http://docs.yahoo.com/info/terms/" style="text-decoration: none;">Terms of Use</a> • <a href="mailto:[email protected]?subject=Feedback on the redesigned individual mail v1" style="text-decoration: none;">Send us Feedback </a></div> </div> <!-- |**|end egp html banner|**| --> </div> <!-- ygrp-msg --> <!-- Sponsor --> <!-- |**|begin egp html banner|**| --> <div id="ygrp-sponsor" style="width:160px; float:right; clear:none; margin:0 0 25px 0; background: #fff;"> <!-- Start Recommendations --> <div id="ygrp-reco"> </div> <!-- End Recommendations --> </div> <!-- |**|end egp html banner|**| --> <div style="clear:both; color: #FFF; font-size:1px;">.</div> </div> <img src="http://geo.yahoo.com/serv?s=97359714/grpId=6677476/grpspId=1705006764/msgId=13339/stime=1371102097" width="1" height="1"> <br> <div style="color: #fff; height: 0;">__,_._,___</div> <!--~-|**|PrettyHtmlEnd|**|-~--> </body> <!--~-|**|PrettyHtmlStart|**|-~--> <head> <style type="text/css"> <!-- #ygrp-mkp { border: 1px solid #d8d8d8; font-family: Arial; margin: 10px 0; padding: 0 10px; } #ygrp-mkp hr { border: 1px solid #d8d8d8; } #ygrp-mkp #hd { color: #628c2a; font-size: 85%; font-weight: 700; line-height: 122%; margin: 10px 0; } #ygrp-mkp #ads { margin-bottom: 10px; } #ygrp-mkp .ad { padding: 0 0; } #ygrp-mkp .ad p { margin: 0; } #ygrp-mkp .ad a { color: #0000ff; text-decoration: none; } #ygrp-sponsor #ygrp-lc { font-family: Arial; } #ygrp-sponsor #ygrp-lc #hd { margin: 10px 0px; font-weight: 700; font-size: 78%; line-height: 122%; } #ygrp-sponsor #ygrp-lc .ad { margin-bottom: 10px; padding: 0 0; } #actions { font-family: Verdana; font-size: 11px; padding: 10px 0; } #activity { background-color: #e0ecee; float: left; font-family: Verdana; font-size: 10px; padding: 10px; } #activity span { font-weight: 700; } #activity span:first-child { text-transform: uppercase; } #activity span a { color: #5085b6; text-decoration: none; } #activity span span { color: #ff7900; } #activity span .underline { text-decoration: underline; } .attach { clear: both; display: table; font-family: Arial; font-size: 12px; padding: 10px 0; width: 400px; } .attach div a { text-decoration: none; } .attach img { border: none; padding-right: 5px; } .attach label { display: block; margin-bottom: 5px; } .attach label a { text-decoration: none; } blockquote { margin: 0 0 0 4px; } .bold { font-family: Arial; font-size: 13px; font-weight: 700; } .bold a { text-decoration: none; } dd.last p a { font-family: Verdana; font-weight: 700; } dd.last p span { margin-right: 10px; font-family: Verdana; font-weight: 700; } dd.last p span.yshortcuts { margin-right: 0; } div.attach-table div div a { text-decoration: none; } div.attach-table { width: 400px; } div.file-title a, div.file-title a:active, div.file-title a:hover, div.file-title a:visited { text-decoration: none; } div.photo-title a, div.photo-title a:active, div.photo-title a:hover, div.photo-title a:visited { text-decoration: none; } div#ygrp-mlmsg #ygrp-msg p a span.yshortcuts { font-family: Verdana; font-size: 10px; font-weight: normal; } .green { color: #628c2a; } .MsoNormal { margin: 0 0 0 0; } o { font-size: 0; } #photos div { float: left; width: 72px; } #photos div div { border: 1px solid #666666; height: 62px; overflow: hidden; width: 62px; } #photos div label { color: #666666; font-size: 10px; overflow: hidden; text-align: center; white-space: nowrap; width: 64px; } #reco-category { font-size: 77%; } #reco-desc { font-size: 77%; } .replbq { margin: 4px; } #ygrp-actbar div a:first-child { /* border-right: 0px solid #000;*/ margin-right: 2px; padding-right: 5px; } #ygrp-mlmsg { font-size: 13px; font-family: Arial, helvetica,clean, sans-serif; *font-size: small; *font: x-small; } #ygrp-mlmsg table { font-size: inherit; font: 100%; } #ygrp-mlmsg select, input, textarea { font: 99% Arial, Helvetica, clean, sans-serif; } #ygrp-mlmsg pre, code { font:115% monospace; *font-size:100%; } #ygrp-mlmsg * { line-height: 1.22em; } #ygrp-mlmsg #logo { padding-bottom: 10px; } #ygrp-msg p a { font-family: Verdana; } #ygrp-msg p#attach-count span { color: #1E66AE; font-weight: 700; } #ygrp-reco #reco-head { color: #ff7900; font-weight: 700; } #ygrp-reco { margin-bottom: 20px; padding: 0px; } #ygrp-sponsor #ov li a { font-size: 130%; text-decoration: none; } #ygrp-sponsor #ov li { font-size: 77%; list-style-type: square; padding: 6px 0; } #ygrp-sponsor #ov ul { margin: 0; padding: 0 0 0 8px; } #ygrp-text { font-family: Georgia; } #ygrp-text p { margin: 0 0 1em 0; } #ygrp-text tt { font-size: 120%; } #ygrp-vital ul li:last-child { border-right: none !important; } --> </style> </head> <!--~-|**|PrettyHtmlEnd|**|-~--> </html> <!-- end group email --> --------------010407090208060202060607--