Re: Re: Gobo Regexp and Unicode support.

Eric Bezault <ericb-D6Qt/9opevxWk0Htik3J/[email protected]> Sat, 14 Jun 2008 00:04:52 +0200
Newsgroups gmane.comp.lang.eiffel.gobo.general
Message-ID <[email protected]>
Colin Paul Adams wrote:
>>>>>> "Ted" == Ted  <kkkkg999-/[email protected]> writes:
> 
>     Ted> --- In [email protected], Colin Paul Adams <colin@...> wrote:
>     >> 
>     >> 
>     >> I don't understand how you have done this - the regexp library
>     >> only handles 8-bit characters. 19981 is not an 8-bit value.
> 
>     Ted> That's what the patch does. `item_code' of UC_STRING does
>     Ted> return correct 4-byte Unicode character (INTEGER_32), doesn't
>     Ted> it? `item' didn't.
> 
> But the library is using an 8-bit state automaton - it only knows
> about 8-bit codes.
> Are you taking the code modulo 256?
> 
> 
> Have you tried to match ".*a.*" against a string of 256 successive
> codepoints (not including ASCII")?

What would be interesting is to test and try to use UC_STRING with
non-ascii characters not only for the subject, but also for the
regexp pattern (the string passed to the `compile' routine).
That's where we could have problems.

-- 
Eric Bezault
mailto:ericb-D6Qt/9opevxWk0Htik3J/[email protected]
http://www.gobosoft.com