Webboard: Problem with national chars in URL

[email protected]
Newsgroups gmane.comp.web.mnogosearch.general
Message-ID <[email protected]>
Author: Alexander Barkov
Email: [email protected]
Message:
Hi Marcin,



> I'm getting problem if page contains URL (usually this are broken URLs) with national chars. This is example:

> 

> [5104]{01} Link '#' http://www.joemonster.org/bojownik/zorkus

> [5104]{01}  Server applied: site_id: -2069019059 URL: http://www.joemonster.org/*

> [5104]{01} Allow by default

> [5104]{01} Link 'http://mo▒e kiedy▒...' http://mo▒e kiedy▒.../

> [5104]{01} no Server, skip it

> {sql.c:1202} Query: SELECT rec_id FROM url WHERE url='http://mo▒e kiedy▒...'

> 

> [5104]{01} PQexec: ERROR:  invalid byte sequence for encoding "UTF8": 0xbf

> 

> [5104]{01} Error: 'DB err: PQexec: ERROR:  invalid byte sequence for encoding "UTF8": 0xbf

> 

> Is any way to allow indexing pages with this kind url?

> Regards.



Which mnogosearch version are you using?

Can you please paste your indexer.conf?



I could reproduce the same problem only in the other piece

of the code. Just want to make sure it's fixed everywhere.





{sql.c:2094} Query: INSERT INTO url (url,referrer,hops,crc32,next_index_time,status,seed,bad_since_time,site_id,server_id,docsize,last_mod_time,shows,pop_rank) VALUES ('http://mo�e kiedy�.../','485',1,0,1296797420,0,134,1296797420,'0','-12815354','0',0,0,0.0)



indexer[4933]: [4933]{01} PQexec: ERROR:  invalid byte sequence for encoding "UTF8": 0xbf

HINT:  This error can also happen if the byte sequence does not match the encoding expected by the server, which is controlled by "client_encoding".

indexer[4933]: [4933]{01} Error: 'DB err: PQexec: ERROR:  invalid byte sequence for encoding "UTF8": 0xbf



Thanks.



Reply: <http://www.mnogosearch.org/board/message.php?id=21202>
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.