Re: Re: Gobo Regexp and Unicode support.
Eric Bezault <ericb-D6Qt/9opevxWk0Htik3J/[email protected]> Sat, 14 Jun 2008 00:04:52 +0200
| Newsgroups | gmane.comp.lang.eiffel.gobo.general |
|---|---|
| Message-ID | <[email protected]> |
Colin Paul Adams wrote: >>>>>> "Ted" == Ted <kkkkg999-/[email protected]> writes: > > Ted> --- In [email protected], Colin Paul Adams <colin@...> wrote: > >> > >> > >> I don't understand how you have done this - the regexp library > >> only handles 8-bit characters. 19981 is not an 8-bit value. > > Ted> That's what the patch does. `item_code' of UC_STRING does > Ted> return correct 4-byte Unicode character (INTEGER_32), doesn't > Ted> it? `item' didn't. > > But the library is using an 8-bit state automaton - it only knows > about 8-bit codes. > Are you taking the code modulo 256? > > > Have you tried to match ".*a.*" against a string of 256 successive > codepoints (not including ASCII")? What would be interesting is to test and try to use UC_STRING with non-ascii characters not only for the subject, but also for the regexp pattern (the string passed to the `compile' routine). That's where we could have problems. -- Eric Bezault mailto:ericb-D6Qt/9opevxWk0Htik3J/[email protected] http://www.gobosoft.com