(HtDig) robot.txt: File does not exist

Hello group! 
 
I have installed htdig via RPM (along with htdig-web), this is vercion 3.1.6. 
I am having trouble with indexing users password-protected directories /home/*/public_html. (all ao them have the same password for simplisity). 
 
I put links to this directories to main web site at the root of indexing. 
When i run "rundig" i am getting errors like: 
-------[Fri Jul 01 11:18:24 2005] [error] [client 165.91.154.122] File does not exist: /var/www/html/robots.txt ------
 
And when searching keywords in restricted links i get no results. 
Please take a look at my settings and tell me what is wrong! 
 
at httpd.conf: 
---------------
<Directory /home/*/public_html/
    AllowOverride AuthConfig 
    Options MultiViews Indexes SymLinksIfOwnerMatch IncludesNoExec 
    <Limit GET POST OPTIONS>    

           Order allow,deny 
            Allow from all 
     </Limit>

      <LimitExept GET PODT OPTIONS>
              Order deny,allow 
              Deny from all
       </LimitExept>
</Directory> 
 
at htdig.conf:
 ----authorization: username:password ---- 



		
---------------------------------
Yahoo! Sports
 Rekindle the Rivalries. Sign up for Fantasy Football