mb_ereg_replace problem with non a-z characters

McAjvar <[email protected]> Mon, 17 Jan 2005 16:55:45 +0100
Newsgroups	gmane.comp.php.internationalization
Message-ID	<[email protected]>
hi!

i hope this is the right group for my question, if i got it wrong, 
please accept my apologies and tell me where to go next.

i have a form which needs to accept strings with specific central 
european, japanese, russian, etc. charactres. the site accepts utf-8, 
all headers are sent for utf-8 and on windows, where i'm testing it, all 
works ok. eg. i enter something in japanese, korean, russian, slovene, 
etc. and if i put everything through this:

ereg_replace ("[^[:alnum:]\n]", "", $t)

all japanese, russian, etc. characters remain in the string, as i'd like 
them to.

but when i test this same function on dragonflybsd or freebsd, all those 
characters get stripped out.

php.ini settings, mbstring section has the overload setting set to 
overload everything, so php should basically be using mb_ereg_replace. 
just to be sure, i tried that function specifically.

my test environments are:
win2k, sp4, apache 2.0.50, php 4.3.8 (here, it works ok)
freebsd 5.2.1, fully patched, apache-1.3.31_4, mod_php4-4.3.8_2,1 
(doesn't work)
dragonflybsd, latest version, today freshly installed apache and php 
from ports, also doesn't work

could someone please help me, point me in the right direction, tell me 
what i am doing wrong or just explain why such a difference on windows 
and the bsd platforms? i couldn't test it on a linux platform since i 
don't have access to one. am i expectinh too much from ereg* functions 
if i want them to tell me if some foreign characters are valid in some 
alphabet or should i take a different approach?

thank you for any information!

i have mbstring extension installed and here are my php.ini mbstring 
settings:
[mbstring]
mbstring.language = Neutral
mbstring.internal_encoding = UTF-8
mbstring.http_input = UTF-8
mbstring.http_output = UTF-8
mbstring.encoding_translation = On
mbstring.substitute_character = _
mbstring.func_overload = 7

this is the (very simple) script i am using for testing:
___________________________
<?php

header("content-type:text/html; charset=utf-8");

unset ($t);
if (isset ($_POST['t']))
{
	$t = $_POST['t'];
}

?>
<?xml version="1.0" encoding="utf-8"?>
<head>
<title>mad scientists not a work</title>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
</head>

<body>
<div align="center">
<?php

if (isset ($t))
{
	echo "<pre>Got this:\n" . $t . "\n</pre>";
	echo "<hr><br><pre>put through preg_replace:\n" . preg_replace 
("/[^[:alnum:]\n]/", "", $t) . "\n</pre>";
	echo "<hr><br><pre>put through ereg_replace:\n" . ereg_replace 
("[^[:alnum:]\n]", "", $t) . "\n</pre>";
}

?>

<form action="<?php echo $_SERVER["PHP_SELF"]; ?>" method="post">
<textarea name="t" rows="7" cols="60"><?php if (isset ($t)) echo $t; 
?></textarea>
<br />
<input type="submit">
</form>
</div>
</body>

</html>
___________________________

regards,
McAjvar

-- 
PHP Internationalization Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php