Author: Christophe NOUVEL
Email: [email protected]
Message:
> Hi,
>
> > Hi,
> >
> > mnogosearch is working well here for years now.
>
> Good to know. Which version are you using?
3.2.38, 3.2.39, 3.2.41, 3.3.0, 3.3.3, 3.3.4, 3.3.5, 3.3.6 and since last monday 3.3.9...
> >
> > From time to time, old servers disappear.
> >
> > I never really cared about that, but more than 100000 documents have a 404 http status. And more than 200000 are 503. And plying with indexer -I, I found docs with a 200 status from servers down for more than 1 year...
> >
> > indexer.conf says (once) :
> > HoldBadHrefs 30d
> >
> > But bad (undestand : non reachable) docs are here for AGES, and have a non zero bad_since_time in url table.
> >
> > I just ran
> > indexer -Cw -s404
> > It worked! So continued with :
> > indexer -Cw -s503
> > Still running.
>
> The above is a correct alternative way to delete bad documents.
>
> >
> > So my question :
> > - How is HoldBadHrefs supposed to work? What more is needed tu purge docs and words from dead servers?
>
>
>
> I found a bug in HoldBadHref related code.
> Please apply this patch (for version 3.3.x)
>
>
> --- sql.c 5 May 2010 20:56:06 -0000 1.1441
> +++ sql.c 6 May 2010 14:54:46 -0000
> @@ -3148,7 +3148,7 @@ UdmDeleteBadHrefs(UDM_AGENT *Indexer,
> return UDM_OK;
>
> udm_snprintf(q, sizeof(q), "SELECT rec_id FROM url WHERE status > 300 AND status<>304 AND referrer=%s%i%s AND bad_since_time<%d",
> - qu, url_id, qu, qu, qu, (int)time(NULL) - hold_period);
> + qu, url_id, qu, (int)time(NULL) - hold_period);
> if(UDM_OK!=(rc=UdmSQLQuery(db,&SQLRes,q)))return rc;
>
> nrows = UdmSQLNumRows(&SQLRes);
Will give a try soon!
Thanks!
Christophe.
Reply: <http://www.mnogosearch.org/board/message.php?id=21082>
lmpx.com only provides a reader for public news (NNTP) servers. It is not
affiliated with the servers or forums shown here and is not responsible for
the content of articles, which is written by their respective authors.