Re: Problem with finding server

Can you send the contents of robots.txt? It looks like indexing is 
being disallowed.

> Found 'disallow' line:
> Pattern:
>  pushed
>         1:1:http://bdis/ skipped

even though the error message is perhaps misleading.

Do you get the same result if you remove the robots.txt file?

Just a thought...

Ted Stresen-Reuter

On Jan 25, 2006, at 9:57 AM, Wolfgang Winkler wrote:

> Hi,
> i have a problem with htdig.
> This is the first time i use htdig, maybe its a very simple error.
> i start htdig -vvv and get the following output:
>
> bdfl01:~ # htdig -vvv
>         0:1:http://bdis/
> New server: bdis, 80
> Retrieval command for http://bdis/robots.txt: GET /robots.txt HTTP/1.0
> User-Agent: htdig/3.1.6 ([email protected])
> Host: bdis
>
> Header line: HTTP/1.1 200 OK
> Header line: Date: Wed, 25 Jan 2006 09:46:28 GMT
> Header line: Server: Apache/2.0.49 (Linux/SuSE)
> Header line: Last-Modified: Tue, 10 Jan 2006 12:37:48 GMT
> Converted Tue, 10 Jan 2006 12:37:48 GMT to Tue, 10 Jan 2006 12:37:48
> Header line: ETag: "1447f-18-40a00620adf00"
> Header line: Accept-Ranges: bytes
> Header line: Content-Length: 24
> Header line: Connection: close
> Header line: Content-Type: text/plain; charset=ISO-8859-1
> Header line:
> returnStatus = 0
> Read 24 from document
> Read a total of 24 bytes
> Parsing robots.txt file using myname = htdig
> Robots.txt line: User-Agent: *
> Found 'user-agent' line: *
> Robots.txt line: Disallow:
> Found 'disallow' line:
> Pattern:
>  pushed
>         1:1:http://bdis/ skipped
> pick: bdis, # servers = 1
> 0:1:0:http://bdis/: Unable to build connection with bdis:80
>  no server running
> pick: bdis, # servers = 1
> bdfl01:~ #
>
> it says "Unable to build connection with bdis:80" but why the 
> robots.txt is found?
>
> any suggestions are welcome.
>
>
> Best regards
> Mit freundlichen Grüßen
>
>
> Wolfgang Winkler
>
> -- 
> Landeshauptstadt München, Kreisverwaltungsreferat
> Branddirektion, Sachgebiet Informationsverarbeitung
> An der Hauptfeuerwache 8, 80331 München
> Tel.: 089 2353-6169  E-Mail: [email protected]
>
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by: Splunk Inc. Do you grep through log 
> files
> for problems?  Stop!  Download the new AJAX search engine that makes
> searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid3432&bid#0486&dat1642
> _______________________________________________
> ht://Dig general mailing list: <[email protected]>
> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
> List information (subscribe/unsubscribe, etc.)
> https://lists.sourceforge.net/lists/listinfo/htdig-general



-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid3432&bid#0486&dat1642
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general