Re: Digest Number 459

[email protected] wrote:
>
> There is 1 message in this issue.
>
> Topics in this digest:
>
>    1.  Re: question on unicode    
>          From: "Eric Bezault" ericb-D6Qt/9opevxWk0Htik3J/[email protected]
>
> ________________________________________________________________________
> ________________________________________________________________________
>
> Message 1 
>     From: "Eric Bezault" ericb-D6Qt/9opevxWk0Htik3J/[email protected]
>     Date: Tue May 9, 2006 1:53am(PDT) 
> Subject: Re: question on unicode
>
> Thomas Beale wrote:
>   
>> I have probably asked this before, but things might have changed. What 
>> is the situation for a parser application that uses gelex and geyacc 
>> built parser, for reading and correctly processing unicode files, e.g. a 
>> file containing a mixture of english text, turkish and Korean? Does gobo 
>> handle this currently? There is both the file reading and the string 
>> processing in the lexer and parser to think about.
>>     
>
> gelex does not support unicode. It only supports 8-bit character
> input stream. However you can consider your unicode files as a
> sequence of bytes (depending on the encoding choosen in the file)
> and use gelex as lexer of byte input stream. This is what is done
> in the XML parser provided in the Gobo Eiffel XML library.
>
>   
What is the output of this lexer? What do the tokens correspond to 
exactly - unicode glyphs?

thanks

- thomas



-- 
___________________________________________________________________________________
CTO Ocean Informatics (http://www.OceanInformatics.biz)
Research Fellow, University College London (http://www.chime.ucl.ac.uk)
Chair Architectural Review Board, openEHR (http://www.openEHR.org)




------------------------ Yahoo! Groups Sponsor --------------------~--> 
Get to your groups with one click. Know instantly when new email arrives
http://us.click.yahoo.com/.7bhrC/MGxNAA/yQLSAA/saFolB/TM
--------------------------------------------------------------------~-> 

To Post a message, send it to:   [email protected]
To Unsubscribe, send a blank message to: [email protected] 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/gobo-eiffel/

<*> To unsubscribe from this group, send an email to:
    [email protected]

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/