Webboard: Words containing umlauts won't be indexed

Author: Amar Bouchibane
Email: 
Message:
Hi everyone,



I have mnogosearch 3.3.9 and MariaDB (5.1.44) under SuSE Linux Enterprise Server 64Bit running.



When a record containing german umlauts needs to be (re)indexed, all words containing umlauts won't be indexed.



Every charset is set to UTF-8 (LocalCharset and RemoteCharset). The collation of every table is utf8_unicode_ci.



Here's my indexer config:



--- BEGIN ---

# Defaults

DBAddr mysql://uhztest:******@localhost/hztest_mnogosearch/?dbmode=blob&trackquery=yes

VarDir /home/uhztest/www/htdocs/hztest/typo3temp/mnogosearch/var

PopRankUseShowCnt yes

PopRankUseTracking yes

PopRankFeedBack yes

PopRankSkipSameSite no

Section body 1 8092 html

Section title 2 256 text

Section meta.keywords 3 64 text

Section meta.description 4 64 text

SaveSectionSize yes

LocalCharset utf-8

BrowserCharset utf-8



#Allow *.htm *.html *.php *.txt */ *.pdf *.doc *.odt *.swx

Mime message/rfc822 text/plain "cat $1"

Mime application/msword text/plain "catdoc -a $1"

Mime application/pdf text/plain "pdftotext -enc UTF-8 $1 -"

Mime application/vnd.ms-excel text/html "xltohtml $1"

Mime application/vnd.ms-powerpoint text/html "pptohtml $1"

Mime application/vnd.oasis.opendocument.text text/plain "/usr/bin/php -q '/home/uhztest/www/htdocs/hztest/typo3conf/ext/mnogosearch/cli/catoo.php' '$1'"



Disallow *.rdf *.xml *.rss *.js *.css *.jpg *.png *.gif *.svg *.swf *.tif *.tiff

Disallow *.bz2 *.gz *.zip *.xpi *.dmg *.exe *.scr *.avi *.jpeg *.ods *.psd *.rar

Disallow *.fla Thumbs.db *.rpm *.rm *.qt *.mov *.pfb *.ttf* *.fon *.mpg *.mpeg *.ai

Disallow *.t3x *.t3d *.dll *.dat *.cab *.inf



AddType application/vnd.oasis.opendocument.text *.sxw *.odt

AddType text/plain *.txt

AddType text/html *.html *.htm

AddType text/rtf *.rtf

AddType application/pdf *.pdf

AddType message/rfc822 *.eml

AddType application/msword *.doc *.dot

AddType application/vnd.ms-excel *.xls

AddType application/vnd.ms-powerpoint *.ppt



HoldBadHrefs 2d

DetectClones yes

HTTPHeader "X-TYPO3-mnogosearch: fd5a8e20487e6295509d7196966c9025"

DefaultContentType "text/html; charset=utf-8"

RemoteCharset utf-8

Include /home/uhztest/www/htdocs/hztest/fileadmin/custom/mnogosearchcfg

# uid=1

Period 1h

Section meta.description 3 2048 text

Section meta.keywords 4 64 text

HTDBAddr mysql://uhztest:****@localhost/hztest_helpzagportal/

HTDBList "SELECT CONCAT('htdb:/tx_helpzag_main/1/', uid) FROM tx_helpzag_main WHERE pid=4 AND tx_helpzag_main.hidden=0 AND (tx_helpzag_main.starttime<=1300579860)"

HTDBLimit 4096

HTDBDoc "SELECT zag_title AS title,zag_description AS 'meta.description',tstamp AS last_mod_time,zag_keywords AS body FROM tx_helpzag_main WHERE uid=$3"

Server htdb:/tx_helpzag_main/

--- END ---



Any ideas?



best regards,

Amar

Reply: <http://www.mnogosearch.org/board/message.php?id=21220>