Local storage of page data

Jeff Taylor <[email protected]> Fri, 27 Jan 2012 18:55:45 -0700
Newsgroups gmane.comp.web.mnogosearch.general
Message-ID <[email protected]>
One of the sites I am indexing decided to redirect to YouTube, and my 
database has blown up to over 50GB.  I have been looking around, but 
cannot find any references to this subject.  Does mnogosearch store a 
cache copy of the components of each page indexed?  If so, how can I 
control what is actually stored?

For my purposes, I am only doing text searches.  I do not need any type 
of video, audio, or image files stored, however I have no problem with 
indexing the *names* of these files.