Webboard: Indexing email with multiple file type attachments

Author: Alexander Barkov
Email: [email protected]
Message:
> We would like to index email saved in a single file (versus mbox for example) which contain multiple file types. Specifically, we save and file emails with a .eml suffix which our pop3 email client (Thunderbird) can read.  As I understand it, they are basically, a file type with nested attachments identified with mime headers.

> 

> Since mnogosearch appears to select parsers based upon file suffix type rather then mine type, it seems to be necessary to separate each type into separate files before indexing. 

> 

> Any ideas how one might index each imbedded mime type and also reference the original email URL rather then the various imbedded files?

> 



You can try to write an external program

which will break the letters into parts,

execute various converters for the parts

and then collect output data from all the parts

into a single output stream, so indexer will just

think of it as of a single file.





> My preliminary idea: use mpack package.  That package includes munpack which unpacks messages by MIME header and outputs to a separate file which is named as imbedded which normally includes the correct mime type suffix as saved.  The Text part of message is a bit trickier, it can either ignore or output to files with no suffix. But I still have no idea how to pipe this into mnogosearch.

> 

> mpack and munpack is available at  http://ftp.andrew.cmu.edu/pub/mpack/

> 

> All ideas welcome.  The solution might be a good addition to the documentation.

> 

> 

Reply: <http://www.mnogosearch.org/board/message.php?id=21399>