RE: indexing a directory tree in the file system

I recall doing something very similar to this as a College project, as a
DOS batch file, so I know that this is also possible if you are not
running a *NIX system.

Mike


> -----Original Message-----
> From: Douglas Kline [mailto:[email protected]] 
> Sent: 27 April 2005 19:11
> To: Brockington,MJ,Mike,IQ D
> Cc: [email protected]
> Subject: Re: [htdig] indexing a directory tree in the file system 
> 
> 
> > If you want all files indexed within that tree, then you 
> could use some
> > sort of script to dump out a recursive directory listing to 
> a file, then
> > use that file as the source for your Start_URL.
> > 
> > If you only want a subset then that technique might not be 
> practical.
> > 
> > Mike
> > 
> > > -----Original Message-----
> > > From: [email protected] 
> > > [mailto:[email protected]] On Behalf 
> 
> > > Hi,
> > > 
> > > is there a simple incantation of htdig that would allow 
> me to index a
> > > file tree (not via the web server)?
> > > I have a hodgepodge of files, all text, some with and some without
> > > extensions that I would like to have full text search 
> capabilities on.
> > > But I can not figure out how to get them all indexed. 
> Some do, some
> > > don't. (I am using a file:// URL as the starting point).
> > > I am using 3.2.0b6.
> > > Looks like htdig is geared mainly towards web site 
> indexing and I am
> > > trying to bend it too much...
> 
> 
> 
> If this is under Unix, you could use the "find" command to 
> write out all the
> files in a tree.  If you want to select some of them, you 
> could use options to
> the "find" command which are more plentiful with the Gnu 
> version or you could
> pipe the output to a command like a grep or sed to select 
> some files.  The
> argument to ht-Dig should be a URL or list of URL's.  So 
> somewhere a URL has to
> be used to address the files.  Once you have a URL you can 
> use, the various
> files can be addressed by pathnames starting from the URL.  
> You could convert
> the list of files into a list of URL's with substitutions 
> which could be
> executed in the same pipe from the find command.
> 
> If you're not running Unix, there might be some parallel 
> operations you could
> use.
> 
> Douglas
> 
> ========
> Douglas Kline
> [email protected]
> 
> 
> 


-------------------------------------------------------
SF.Net email is sponsored by: Tell us your software development plans!
Take this survey and enter to win a one-year sub to SourceForge.net
Plus IDC's 2005 look-ahead and a copy of this survey
Click here to start!  http://www.idcswdc.com/cgi-bin/survey?id5hix
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general