Edit report at https://bugs.php.net/bug.php?id=65080&edit=1
ID: 65080
Updated by: [email protected]
Reported by: masakielastic at gmail dot com
-Summary: ctype_lower detects non-lower characters
+Summary: ctype_*() don't properly support multibyte locales
-Status: Open
+Status: Verified
-Type: Bug
+Type: Documentation Problem
Package: Strings related
Operating System: Mac OSX
PHP Version: 5.5.0
Block user comment: N
Private report: N
New Comment:
The ctype_*() functions are fundamentally flawed for multibyte
locales when a string is passed, since PHP strings have no
notion of their encoding, and as such each byte is passed to the
underlying C function (lower(3) in this case), and that can't
properly work. Passing the code points as int would work to some
extend, but that is deprecated as of PHP 8.1.0[1].
Contrary to the current documentation[2], I suggest to avoid these
functions in favor of MBString or PCRE's character properties. In
any way, the current behavior needs to be better documented.
[1] <https://www.php.net/manual/en/migration81.deprecated.php#migration81.deprecated.ctype.nonstring-arguments>
[2] <https://www.php.net/manual/en/intro.ctype.php>
Previous Comments:
------------------------------------------------------------------------
[2015-05-08 23:11:53] [email protected]
Related to bug #63663.
------------------------------------------------------------------------
[2013-06-21 01:47:19] masakielastic at gmail dot com
Description:
------------
ctype_lower detects non-lower characters when the local is set to 'en_US.UTF-8'
on Mac OSX 10.8. This phenomenon cannot't be reproduced on Ubuntu Linux.
This phenomenon means ctype_lower detects Chinese characters and Hangul (Korean
Alphabet) which have no concept about lower and upper cases.
The test cases for C language and showing misdetected characters can be seen
here:
https://gist.github.com/masakielastic/5828106
The tests for BSD-compatible OSes are needed judging from Xcode's manual.
http://developer.apple.com/library/Mac/documentation/Darwin/Reference/ManPages/m
an3/islower.3.html
ctype_upper also detects non-upper characters.
Test script:
---------------
$expected = [];
$result = [];
for ($i = 0; $i <= 0xFF; ++$i) {
setlocale(LC_ALL, 'C');
if (ctype_lower(chr($i))) {
$expected[] = $i;
}
setlocale(LC_ALL, 'en_US.UTF-8');
if (ctype_lower(chr($i))) {
$result[] = $i;
}
}
var_dump(
[] === array_diff($result, $expected)
);
Expected result:
----------------
bool(true)
Actual result:
--------------
bool(false)
------------------------------------------------------------------------
--
Edit this bug report at https://bugs.php.net/bug.php?id=65080&edit=1
lmpx.com only provides a reader for public news (NNTP) servers. It is not
affiliated with the servers or forums shown here and is not responsible for
the content of articles, which is written by their respective authors.