Multiple categories and more
James Lee <csejl-/[email protected]>
| Newsgroups | gmane.mail.spam.crm114 |
|---|---|
| Message-ID | <[email protected]> |
Hi, I'm currently trying to categorize plain texts into 7 different categories (cat0 ... cat5 and other). To see what works the best, I have trained a set with OSB <osb microgroom>, OSB <osb unique microgroom>, OSBF <osbf microgroom>, OSBF <osbf unique microgroom>, Hyperspace <hyperspace> and Hyperspace <hyperspqce unique> classifiers. OSB was trained using SSTTT, OSBF using DSTTTR and HyperSpace using TOE. Preliminary results showed that OSB <osb unique microgroom> was most accurate. Here are my questions: - As I increase the number of categories, will classification process slow down? What about accuracy? Also, theoretically speaking, is there a limit on how many categories I can classify into? - If the number of categories becomes an issue, will be it better (both performance and accuracy wise) for me to classify into two categories at a time and pick the highest pR? For example, classify the text into cat0 and other, cat1 and other ... cat5 and other. - The pR score for HyperSpace seems to be lower than OSB and OSBF, is this normal? - Is there a such thing as optimal statistics file size for each classifier? It appears that the default size for OSB is 6M, OSBF is 1.1M and Hyperspace varies across different categories. - Is it possible to "over-train" the classifier? As I train more and more, since the file size is limited, does it simply throw away the oldest data? Or is it more complicated than that? Thanks for your help in advance. -James ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Crm114-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/crm114-general