Re: Htdig and MHT files
<[email protected]> Mon, 11 Feb 2008 11:16:28 -0000
| Newsgroups | gmane.comp.web.htdig.general |
|---|---|
| Message-ID | <498C92D39B24504CA6C753B477F19E6C04E13014@E03MVZ4-UKDY.domain1.systemhost.net> |
This is a multi-part message in MIME format. --===============2011309945== Content-class: urn:content-classes:message Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C86C9F.8C5A2D18" This is a multi-part message in MIME format. ------_=_NextPart_001_01C86C9F.8C5A2D18 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Ainhoa, My first instinct would now be to check the parser output - try adding another v to your config, (and possibly restricting your indexing to just this one file) and check the log output - it may be that htdig does not like the output from your PERL script. www.htdig.org explains what the output means. I seem to recall you saying that you had already tested that it ran on its own, but possibly there is something not right there, or a typo in the config that neither of us can see. =20 Regards, Mike =20 =20 ________________________________ From: Ainhoa L [mailto:[email protected]]=20 Sent: Monday, February 11, 2008 9:33 AM To: Brockington,MJ,Michael,JPGA4X R Cc: [email protected] Subject: Re: [htdig] Htdig and MHT files Hi Mike, Yes you were right, I was missing that part and I didn't even noticed! I changed the config file and wrote this: application/pdf->text/html /usr/local/apache/htdocs/htdig-3.1.6/contrib/parsepdf.pl \ application/vnd.wap.xhtml+xml->text/html /opt/vin/mht2html.pl vnd.wap.xhtml+xml was the MIME type for my mht documents.=20 So I run dig and everything seems to go fine, having at the end: 0/http://172.26.0.169/testdig/ 1/http://172.26.0.169/testdig/About_comments_eex3.mht 2/http://172.26.0.169/testdig/aster.pdf 3/http://172.26.0.169/testdig/beepmacro.mht 4/http://172.26.0.169/testdig/index.txt 5/http://172.26.0.169/testdig/test.html =20 (I am doing this in a test folder) =20 But when I go to the search page, it won't find words inside the mht files. It works for the pdf, txt and html ones, but can't find the words that are in the mht ones. =20 I suppose I am missing something here... do I need to setup any other settings for the search engine? =20 Thanks a lot for all your help, =20 Ainhoa ------_=_NextPart_001_01C86C9F.8C5A2D18 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> <HTML><HEAD> <META http-equiv=3DContent-Type content=3D"text/html; = charset=3Dus-ascii"> <META content=3D"MSHTML 6.00.2900.2802" name=3DGENERATOR></HEAD> <BODY> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2>Ainhoa,</FONT></SPAN></DIV> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2>My first instinct would now be to check the = parser output -=20 try adding another v to your config, (and possibly = restricting your=20 indexing to just this one file) and check the log output - it may be = that htdig=20 does not like the output from your PERL script. <A=20 href=3D"http://www.htdig.org">www.htdig.org</A> explains what the = output=20 means. I seem to recall you saying that you had already tested that it = ran on=20 its own, but possibly there is something not right there, or a typo in = the=20 config that neither of us can see.</FONT></SPAN></DIV> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2></FONT></SPAN> </DIV> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2>Regards,</FONT></SPAN></DIV> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2>Mike</FONT></SPAN></DIV> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2></FONT></SPAN> </DIV> <DIV dir=3Dltr align=3Dleft><SPAN class=3D489351011-11022008><FONT = face=3DArial=20 color=3D#0000ff size=3D2></FONT></SPAN> </DIV> <DIV dir=3Dltr align=3Dleft> <HR tabIndex=3D-1> </DIV> <DIV dir=3Dltr align=3Dleft><FONT face=3DTahoma size=3D2><B>From:</B> = Ainhoa L=20 [mailto:[email protected]] <BR><B>Sent:</B> Monday, February 11, 2008 = 9:33=20 AM<BR><B>To:</B> Brockington,MJ,Michael,JPGA4X R<BR><B>Cc:</B>=20 [email protected]<BR><B>Subject:</B> Re: [htdig] Htdig = and MHT=20 files<BR></FONT><BR></DIV> <BLOCKQUOTE=20 style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px = solid; MARGIN-RIGHT: 0px"> <DIV></DIV> <DIV>Hi Mike,</DIV> <DIV>Yes you were right, I was missing that part and I didn't even=20 noticed!<BR>I changed the config file and wrote this:</DIV><FONT = size=3D2> <P>application/pdf->text/html=20 /usr/local/apache/htdocs/htdig-3.1.6/contrib/parsepdf.pl \</P> <P>application/vnd.wap.xhtml+xml->text/html = /opt/vin/mht2html.pl</P> <DIV></DIV></FONT>vnd.wap.xhtml+xml was the MIME type for my mht = documents.=20 <DIV>So I run dig and everything seems to go fine, having at the=20 end:</DIV> = <DIV><BR><BR>0/http://172.26.0.169/testdig/<BR>1/http://172.26.0.169/test= dig/About_comments_eex3.mht<BR>2/http://172.26.0.169/testdig/aster.pdf<BR= >3/http://172.26.0.169/testdig/beepmacro.mht<BR>4/http://172.26.0.169/tes= tdig/index.txt<BR>5/http://172.26.0.169/testdig/test.html</DIV> <DIV> </DIV> <DIV>(I am doing this in a test folder)</DIV> <DIV> </DIV> <DIV>But when I go to the search page, it won't find words inside the = mht=20 files. It works for the pdf, txt and html ones, but can't find the = words that=20 are in the mht ones.</DIV> <DIV> </DIV> <DIV>I suppose I am missing something here... do I need to setup any = other=20 settings for the search engine?</DIV> <DIV> </DIV> <DIV>Thanks a lot for all your help,</DIV> <DIV> </DIV> <DIV>Ainhoa</DIV></BLOCKQUOTE></BODY></HTML> ------_=_NextPart_001_01C86C9F.8C5A2D18-- --===============2011309945== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ --===============2011309945== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ ht://Dig general mailing list: <[email protected]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general --===============2011309945==--