Webboard: mnogosearch-3.3.10 vs. postgres-9.0
| Newsgroups | gmane.comp.web.mnogosearch.general |
|---|---|
| Message-ID | <[email protected]> |
Author: marcin Email: Message: Hello! Ad.2. I pressed CTRL+C to stop crawling earlier. Here is my test config: DBAddr pgsql://mnogo@/mnogo/?dbmode=blob LocalCharset UTF-8 Include stopwords.conf LangMapFile langmap/en.ascii.lm LangMapFile langmap/pl.latin2.lm HTTPHeader "User-Agent: My_Own_Agent" HTTPHeader "Accept-Language: en,pl" Disallow *.b *.sh *.md5 *.rpm Disallow *.arj *.tar *.zip *.tgz *.gz *.z *.bz2 Disallow *.lha *.lzh *.rar *.zoo *.ha *.tar.Z Disallow *.gif *.jpg *.jpeg *.bmp *.tiff *.tif *.xpm *.xbm *.pcx Disallow *.vdo *.mpeg *.mpe *.mpg *.avi *.movie *.mov *.wmv Disallow *.mid *.mp3 *.rm *.ram *.wav *.aiff *.ra Disallow *.vrml *.wrl *.png *.ico *.psd *.dat Disallow *.exe *.com *.cab *.dll *.bin *.class *.ex_ Disallow *.tex *.texi *.xls *.doc *.texinfo Disallow *.rtf *.pdf *.cdf *.ps Disallow *.ai *.eps *.ppt *.hqx Disallow *.cpt *.bms *.oda *.tcl Disallow *.o *.a *.la *.so Disallow *.pat *.pm *.m4 *.am *.css Disallow *.map *.aif *.sit *.sea Disallow *.m3u *.qt Disallow *D=A *D=D *M=A *M=D *N=A *N=D *S=A *S=D Disallow Regex \.r[0-9][0-9]$ \.a[0-9][0-9]$ \.so\.[0-9]$ AddType image/x-xpixmap *.xpm AddType image/x-xbitmap *.xbm AddType image/gif *.gif AddType text/plain *.txt *.pl *.js *.h *.c *.pm *.e AddType text/html *.html *.htm AddType text/rtf *.rtf AddType application/pdf *.pdf AddType application/msword *.doc AddType application/vnd.ms-excel *.xls AddType text/x-postscript *.ps AddType application/unknown *.* ParserTimeOut 300 DetectClones yes Section body 1 256 Section title 2 128 Section meta.keywords 3 128 Section meta.description 4 128 Section url.file 6 0 Section url.path 7 0 Section url.host 8 0 Section url.proto 9 0 Section crosswords 10 0 Section Charset 11 32 Section Content-Type 12 64 Section Content-Language 13 16 proxy 127.0.0.1:3128 server site http://blog.mejor.pl/ ######################################### I run mnogosearch with similar config using sqlite3 as backend with success. I'm guessing, config file should be working:) I run indexer to crawl all site but withou changes. indexer -Eblob shows that nothing is converted: [...] Converting intag1F Total converted: 0 records, 0 bytes Query: select state,count(state) from bdicti group by state; returns values: 2 73 . It looks that data are converted but table 'bdict' is almost empty. In postgresql log i can't see any error, all queries are correct. Is it possible to turn on debug in indexer to display queries and answers from database? Maybe there is problem with encoding chars and postgres returns "invalid sequence for encoding..."? Thank you for reply! Regards, Marcin. Reply: <http://www.mnogosearch.org/board/message.php?id=21181>