RE: RE: DB2 problem when running htdig

 Georgina,
That would depend on your system, but approx 2GB is a common limit for
various reasons. From what you describe that is probably not the
problem, but it depends how you do your digs: are they Updates or Fresh?

Either way, have a look at the size of the databases that you have, and
try and compare with known good versions from a backup.

Mike

> -----Original Message-----
> From: [email protected] 
> [mailto:[email protected]] On Behalf 
> Of Georgina Allbrook
> Sent: Monday, March 13, 2006 8:49 PM
> To: [email protected]
> Subject: [htdig] RE: DB2 problem when running htdig
> 
> Hi,
> 
> Please forgive me if this is a silly question,
> How would I know if the databases have grown to big?  Is this 
> something
> we can change on the server?
> 
> I would have thought that since it sometimes works, then that 
> cannot be
> the cause of the problem.
> The last time I attempted to dig the site, it failed twice after about
> 30mins any and was only sucessful the third time.  It usually takes
> about 6 hours for htdig create the index.  This was all in one
> afternoon.
> 
> Georgina.
> > -----Original Message-----
> Subject: RE: [htdig] DB2 problem when running htdig
> Date: Fri, 10 Mar 2006 09:45:19 -0000
> From: <[email protected]>
> To: <[email protected]>
> 
> Have your databases grown too big? The page number looks 
> rather large to
> me, but I can't do the maths without knowing how large a page 
> is on your
> system.
> 
> Mike
> 
> > -----Original Message-----
> > From: [email protected]=20
> > [mailto:[email protected]] On Behalf=20
> > Of Georgina Allbrook
> > Sent: Friday, March 10, 2006 3:10 AM
> > To: [email protected]
> > Subject: [htdig] DB2 problem when running htdig
> >=20
> >=20
> > Hi all,
> >=20
> > We are having a problem with our htdig process.  It used to be an
> > intermittent problem but now is occuring more often.
> >=20
> > The output from dig has lots of lines like:
> > DB2 problem...: /home/htdig/db/db.docdb: page 0: reference count
> > overflow
> > DB2 problem...: /home/htdig/db/db.docdb: page 137183088 
> doesn't exist,
> > create flag not set
> > BAD TAG IN SERIALIZED DATA: 244
> > DB2 problem...: /home/htdig/db/db.docdb: page 137183088 
> doesn't exist,
> > create flag not set
> > DB2 problem...: /home/htdig/db/db.docdb: page 137183088 
> doesn't exist,
> > create flag not set
> >=20
> > The htdig process keeps running, but stops actually doing=20
> > anything, and
> > starts to use almost all of the CPU.
> > When the job is killed off htmerge does its thing but=20
> > searching returns
> > no results.
> >=20
> > I've searched the mailing list and have found posts reporting these
> > types of errors, it seems that these errors are due to a corrupt
> > database but they should not occur when running htdig with the -i
> > option. =20
> >=20
> > We are using htdig -i -s  and then running htmerge.
> >=20
> > We are using 3.1.6, the config file has not changed for some time.
> >=20
> > Does anyone have ideas or suggestions?
> >=20
> > Thanks in advance,
> > Georgina.
> 
> 
> -------------------------------------------------------
> This SF.Net email is sponsored by xPML, a groundbreaking 
> scripting language
> that extends applications into web and mobile media. Attend 
> the live webcast
> and join the prime developer group breaking into this new 
> coding territory!
> http://sel.as-us.falkag.net/sel?cmd=k&kid0944&bid$1720&dat1642
> _______________________________________________
> ht://Dig general mailing list: <[email protected]>
> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
> List information (subscribe/unsubscribe, etc.)
> https://lists.sourceforge.net/lists/listinfo/htdig-general
> 


-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid0944&bid$1720&dat1642
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general