Re: question on unicode

Eric Bezault <ericb-D6Qt/9opevxWk0Htik3J/[email protected]>
Newsgroups gmane.comp.lang.eiffel.gobo.general
Organization Gobo
Message-ID <[email protected]>
Thomas Beale wrote:
> I have probably asked this before, but things might have changed. What 
> is the situation for a parser application that uses gelex and geyacc 
> built parser, for reading and correctly processing unicode files, e.g. a 
> file containing a mixture of english text, turkish and Korean? Does gobo 
> handle this currently? There is both the file reading and the string 
> processing in the lexer and parser to think about.

gelex does not support unicode. It only supports 8-bit character
input stream. However you can consider your unicode files as a
sequence of bytes (depending on the encoding choosen in the file)
and use gelex as lexer of byte input stream. This is what is done
in the XML parser provided in the Gobo Eiffel XML library.

-- 
Eric Bezault
mailto:ericb-D6Qt/9opevxWk0Htik3J/[email protected]
http://www.gobosoft.com




------------------------ Yahoo! Groups Sponsor --------------------~--> 
Get to your groups with one click. Know instantly when new email arrives
http://us.click.yahoo.com/.7bhrC/MGxNAA/yQLSAA/saFolB/TM
--------------------------------------------------------------------~-> 

To Post a message, send it to:   [email protected]
To Unsubscribe, send a blank message to: [email protected] 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/gobo-eiffel/

<*> To unsubscribe from this group, send an email to:
    [email protected]

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.