Webboard: indexer -Eblob : more than 11 hours...

Author: Alexander Barkov
Email: [email protected]
Message:
Hi Christophe,



According to your statistics you have about 910 thousand

documents. Index creation time is about 15 minutes for the same

database size.



Can you please provide some more information?



- please run "indexer -Eblob -v6", it will print some

more debug output

- what is "SELECT sum(docsize) FROM url" output?

- What is your mnoGoSearch version?

- Please post your indexer.conf file here, or send

  it to [email protected].

- Can you upload your database dump somewhere,

  so I can download it and try with the same data?





Thanks!





> Hi all,

> 

> indexer[14475]: Converting to blob

> indexer[14475]: Loading URL list

> indexer[14475]: Converting intag00

> indexer[14475]: Converting intag01

> indexer[14475]: Converting intag02

> indexer[14475]: Converting intag03

> indexer[14475]: Converting intag04

> indexer[14475]: Converting intag05

> indexer[14475]: Converting intag06

> secno variable empty

> indexer[14475]: Converting intag07

> indexer[14475]: Converting intag08

> indexer[14475]: Converting intag09

> indexer[14475]: Converting intag0A

> indexer[14475]: Converting intag0B

> indexer[14475]: Converting intag0C

> indexer[14475]: Converting intag0D

> nintags variable empty

> indexer[14475]: Converting intag0E

> indexer[14475]: Converting intag0F

> indexer[14475]: Converting intag10

> indexer[14475]: Converting intag11

> indexer[14475]: Converting intag12

> indexer[14475]: Converting intag13

> indexer[14475]: Converting intag14

> indexer[14475]: Converting intag15

> indexer[14475]: Converting intag16

> indexer[14475]: Converting intag17

> indexer[14475]: Converting intag18

> indexer[14475]: Converting intag19

> indexer[14475]: Converting intag1A

> indexer[14475]: Converting intag1B

> indexer[14475]: Converting intag1C

> indexer[14475]: Converting intag1D

> secno variable empty

> indexer[14475]: Converting intag1E

> indexer[14475]: Converting intag1F

> indexer[14475]: Total converted: 159643688 records, 677784146 bytes

> indexer[14475]: Converting url data

> indexer[14475]: Switching to new blob table.

> indexer[14475]: Converting to blob finished     39944.20

> 

> For the slower. Never less than 28000. Isn't it a bit too long?

> 

>           Database statistics [2010-06-07 13:37:46]

> 

>     Status    Expired      Total

>    -----------------------------

>          0          0          5 Not indexed yet

>        200       2041     912360 OK

>        204          0        154 Unknown status

>        206          0         17 Partial OK

>        301          0       2499 Moved Permanently

>        302          0       7458 Moved Temporarily

>        303          0         11 See Other

>        304          0      58622 Not Modified

>        400          0        214 Bad Request

>        401          0        875 Unauthorized

>        403          0      60948 Forbidden

>        404          0      15423 Not found

>        414          0         58 Request-URI Too Long

>        415          0      22847 Unsupported Media Type

>        500        138        142 Internal Server Error

>        502          0        195 Bad Gateway

>        503          8     128112 Service Unavailable

>        504       1097       1097 Gateway Timeout

>    -----------------------------

>      Total       3284    1211037

> 

>      Christophe.

> 



Reply: <http://www.mnogosearch.org/board/message.php?id=21086>