Re: Effect of widely differing volumes on ifile classification

"Brett Nemeroff" <[email protected]> Thu, 20 Mar 2003 13:37:39 -0500 (EST)
Newsgroups gmane.mail.ifile.general
Message-ID <[email protected]>
Jack,
I know this is slightly off topic, but I was wondering if you had custom
scripts you could share that would report accuracy as you have in this
post?
Thanks,
Brett

> I use ifile to classify all my emails, including the mailing lists I
> subscribe to, and I tend to get a classification success rate of around
> 95-98%.
>
> Recently, the rate, which had been consistent for some time, began to
> plunge to about 50% and stayed there, until I deleted .idata and rebuilt
> it from scratch, and it's now classifying better than before.  (Data
> attached at bottom for completeness)
>
> I'm wondering whether ifile's database got "overloaded" by having large
> numbers of different volumes sent into different categories.  However,
> if that were the case, then I'd have expected it to start classifying
> emails into the mailing list categories rather than into other
> categories.  This didn't happen - it actually started to misclassify the
> mailing lists which receive all the volume.
>
> Any ideas what could cause this "chaotic" effect?
>
> jack
>
>
> Date            Total   Incorrect       Percentage
> ----            ------- ---------       ----------
> Thu Feb 20	160	8		95%
> Fri Feb 21	189	7		96.2%
> Sat Feb 22	164	2		98.7%
> Sun Feb 23	45	3		93.3%
> Mon Feb 24	85	1		98.8%
> Tue Feb 25	136	2		98.5%
> Wed Feb 26	171	7		95.9%
> Thu Feb 27	167	23		86.2%
> Fri Feb 28	164	44		73.1%
> Sat Mar  1	166	58		65%
> Sun Mar  2	131	29		77.8%
> Mon Mar  3	129	17		86.8%
> Tue Mar  4	195	43		77.9%
> Wed Mar  5	279	62		77.7%
> Thu Mar  6	180	50		72.2%
> Fri Mar  7	257	9		96.4%
> Sat Mar  8	157	28		82.1%
> Sun Mar  9	106	0		100%    - didn't read email; no reclassification done
> Mon Mar 10	93	48		48.3%
> Tue Mar 11	172	76		55.8%
> Wed Mar 12	160	51		68.1%
> Thu Mar 13	131	4		96.9%   - regenerated .idata
> Fri Mar 14	176	0		100%
> Sat Mar 15	141	7		95%
> Sun Mar 16	86	2		97.6%
> Mon Mar 17	124	1		99.1%
> Tue Mar 18	204	4		98%
> Wed Mar 19	230	3		98.6%
> Thu Mar 20	204	4		98%
>
>
> _______________________________________________
> Ifile-discuss mailing list
> [email protected]
> http://mail.nongnu.org/mailman/listinfo/ifile-discuss