Re: PEP 263 and Japanese native encodings
[email protected] (Martin v. Loewis)
| Newsgroups | gmane.comp.python.internationalization |
|---|---|
| Message-ID | <[email protected]> |
"M.-A. Lemburg" <[email protected]> writes: > Martin's patch leaves these "minor" issues to the tokenizer > and that's good :-) > > I only wanted to give a very simple > example of what the original idea was when I added "ASCII > compatible encoding" to the PEP -- basically to simplify > the coding parsing part. In my implementation, the "ASCII superset" restriction is stronger, though: the tokenizer needs to find the end of a string without decoding it. That is not possible for some of the encodings that pass your "ASCII superset" test. Regards, Martin