Re: Looking for weka's docs
Peter holunaro <[email protected]> Thu, 27 Jun 2024 03:10:07 +0100
| Newsgroups | gmane.comp.ai.weka |
|---|---|
| Message-ID | <CAGn1Z5_EGeHwx5SyGPHWYKoTxtdGPchO1BTURfpiwx-SS3CHVQ@mail.gmail.com> |
--===============6900343501362358997== Content-Type: multipart/alternative; boundary="000000000000d2b338061bd5a113" --000000000000d2b338061bd5a113 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable *Sorry for sending this here, but I'm not sure whether my previous messages were received or not, and I have no time to wait. * Dear all, When working with "imageFilters" I found the following strange behaviour: I divided the data into training and test sets. The test set, as usual, is totally different from the training set. Then, when running the classification process via FilteredClassifier (classifier: J48; filter: MultiFilter--ColorLayoutFilter + Remove the first attribute), I have an error like this: ImageFilter Exception: was unable to read file mno001.jpg! The idea here is that the desired image is not in the training set, it is only in the test set. But, when adding this image to the training set, apply the classification process (highlighted up), and use it as well in the test set (i.e., the desired image existing in both datasets). The classification process works well and the target label is predicted normally. I'm trying to say that the performed prediction procedure is not conducted fairly when using ImageFilter since all the images in the test set need to be originally in the training set. Hence, the classifier will see the images twice--on the training and the test set--resulting in an optimistic result (overfitting). Any advice to avoid such an issue is highly appreciated. Regards, Peter On Thu, Jun 27, 2024 at 12:17=E2=80=AFAM Eibe Frank <[email protected].= nz> wrote: > Apologies for the broken links. Change in our university=E2=80=99s web se= tup has > broken them. Unfortunately, appropriate forwarding is still not in place, > and we haven=E2=80=99t gone through all the links in the docs to update t= hem yet. > > > > Basically, > > > > https://www.cs.waikato.ac.nz/~ml > > > > has been replaced by > > > > https://ml.cms.waikato.ac.nz/ > > > > So, for example, rather than > > > > https://www.cs.waikato.ac.nz/~ml/weka/book.html > > > > or > > > > https://www.cs.waikato.ac.nz/ml/weka/book.html > > > > it should be > > > > https://ml.cms.waikato.ac.nz/weka/book.html > > > > Cheers, > > Eibe > > > > > > *From: *Javi H <[email protected]> > *Date: *Thursday, 27 June 2024 at 11:06=E2=80=AFAM > *To: *[email protected] <[email protected]> > *Subject: *[Wekalist] Looking for weka's docs > > Some people who received this message don't often get email from > [email protected]. Learn why this is important > <https://aka.ms/LearnAboutSenderIdentification> > > Hi! I am going to be working with weka java library and would need some > kind of documentation to guide me through it. I was searching at > https://waikato.github.io/weka-wiki/documentation/ ,but some of the links > seem to be down. I have been able to find WekaManual-3-8-3.pdf but I woul= d > probably make good use of some java code examples. There's an svn repo > linked in the book, but that link also seems to be down. Is it maybe host= ed > on github or someone else? > > > > Thank you! > _______________________________________________ > Wekalist mailing list -- [email protected] > Send posts to [email protected] > To unsubscribe send an email to [email protected] > To subscribe, unsubscribe, etc., visit > https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz > List etiquette: > http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html > --000000000000d2b338061bd5a113 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div><b>Sorry for sending this here, but I'm not sure = whether my previous messages were received or not, and I have no time to wa= it.=C2=A0</b></div><div><br></div>Dear all,=C2=A0<div><br></div><div>When w= orking with "imageFilters" I found the following strange behaviou= r:</div><div><br></div><div>I divided the data into training and test sets.= The test set, as usual, is totally different from the training set. Then, = when running the classification process via=C2=A0FilteredClassifier (classi= fier: J48; filter: MultiFilter--ColorLayoutFilter + Remove the first attrib= ute), I have an error like this:</div><div><br></div><div>=C2=A0ImageFilter= Exception: was unable to read file mno001.jpg!=C2=A0</div><div><br></div><= div>The idea here is that the desired image is not in the training set, it = is only in the test set. But, when adding this image to the training set, a= pply the classification process (highlighted up), and use it as well in the= test set (i.e., the desired image existing in both datasets). The classifi= cation process works well and the target label is predicted normally.</div>= <div><br></div><div>I'm trying to say that the performed prediction pro= cedure is not conducted fairly when using ImageFilter since all the images = in the test set need to be originally in the training set. Hence, the class= ifier will see the images twice--on the training and the test set--resultin= g in an optimistic result (overfitting).=C2=A0=C2=A0</div><div><br></div><d= iv>Any advice to avoid such an issue is highly appreciated.<br></div><div><= br></div><div>Regards,=C2=A0</div><font color=3D"#888888"><div>Peter</div><= /font></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_= attr">On Thu, Jun 27, 2024 at 12:17=E2=80=AFAM Eibe Frank <<a href=3D"ma= ilto:[email protected]">[email protected]</a>> wrote:<br><= /div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bo= rder-left:1px solid rgb(204,204,204);padding-left:1ex"><div class=3D"msg630= 0812871566798898"> <div lang=3D"EN-NZ" style=3D"overflow-wrap: break-word;"> <div class=3D"m_6300812871566798898WordSection1"> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">Apologies for the bro= ken links. Change in our university=E2=80=99s web setup has broken them. Un= fortunately, appropriate forwarding is still not in place, and we haven=E2= =80=99t gone through all the links in the docs to update them yet.<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">Basically,<u></u><u><= /u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">=C2=A0 <a href=3D"htt= ps://www.cs.waikato.ac.nz/~ml" target=3D"_blank"> https://www.cs.waikato.ac.nz/~ml</a><u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">has been replaced by<= u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">=C2=A0 <a href=3D"htt= ps://ml.cms.waikato.ac.nz/" target=3D"_blank"> https://ml.cms.waikato.ac.nz/</a><u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">So, for example, rath= er than<u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">=C2=A0 <a href=3D"htt= ps://www.cs.waikato.ac.nz/~ml/weka/book.html" target=3D"_blank"> https://www.cs.waikato.ac.nz/~ml/weka/book.html</a><u></u><u></u></span></p= > <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">or<u></u><u></u></spa= n></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">=C2=A0 <a href=3D"htt= ps://www.cs.waikato.ac.nz/ml/weka/book.html" target=3D"_blank"> https://www.cs.waikato.ac.nz/ml/weka/book.html</a><u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">it should be<u></u><u= ></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">=C2=A0 <a href=3D"htt= ps://ml.cms.waikato.ac.nz/weka/book.html" target=3D"_blank"> https://ml.cms.waikato.ac.nz/weka/book.html</a><u></u><u></u></span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">Cheers,<u></u><u></u>= </span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt">Eibe<u></u><u></u></s= pan></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <p class=3D"MsoNormal"><span style=3D"font-size:11pt"><u></u>=C2=A0<u></u><= /span></p> <div id=3D"m_6300812871566798898mail-editor-reference-message-container"> <div> <div style=3D"border-right:none;border-bottom:none;border-left:none;border-= top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm"> <p class=3D"MsoNormal" style=3D"margin-bottom:12pt"><b><span style=3D"color= :black">From: </span></b><span style=3D"color:black">Javi H <<a href=3D"mailto:javiher= [email protected]" target=3D"_blank">[email protected]</a>><br> <b>Date: </b>Thursday, 27 June 2024 at 11:06</span><span style=3D"font-fami= ly:Arial,sans-serif;color:black">=E2=80=AF</span><span style=3D"color:black= ">AM<br> <b>To: </b><a href=3D"mailto:[email protected]" target=3D"_blank"= >[email protected]</a> <<a href=3D"mailto:[email protected]= o.ac.nz" target=3D"_blank">[email protected]</a>><br> <b>Subject: </b>[Wekalist] Looking for weka's docs<u></u><u></u></span>= </p> </div> <table border=3D"0" cellspacing=3D"0" cellpadding=3D"0" align=3D"left" widt= h=3D"100%" style=3D"width:100%;display:table;float:none"> <tbody> <tr> <td style=3D"background:rgb(166,166,166);padding:5.25pt 1.5pt"></td> <td width=3D"100%" style=3D"width:100%;background:rgb(234,234,234);padding:= 5.25pt 3.75pt 5.25pt 11.25pt"> <div> <p class=3D"MsoNormal"> <span style=3D"font-size:9pt;font-family:"Segoe UI",sans-serif;co= lor:rgb(33,33,33)">Some people who received this message don't often ge= t email from <a href=3D"mailto:[email protected]" target=3D"_blank">jav= [email protected]</a>. <a href=3D"https://aka.ms/LearnAboutSenderIdentification" target=3D"_blank"= >Learn why this is important</a><u></u><u></u></span></p> </div> </td> <td width=3D"75" style=3D"width:56.25pt;background:rgb(234,234,234);padding= :5.25pt 3.75pt"> </td> </tr> </tbody> </table> <div> <div> <div> <p class=3D"MsoNormal">Hi! I am going to be working with weka java library = and would need some kind of documentation to guide me through it. I was sea= rching at <a href=3D"https://waikato.github.io/weka-wiki/documentation/" target=3D"_b= lank">https://waikato.github.io/weka-wiki/documentation/</a> ,but some of t= he links seem to be down. I have been able to find WekaManual-3-8-3.pdf but= I would probably make good use of some java code examples. There's an svn repo linked in the book, but that l= ink also seems to be down. Is it maybe hosted on github or someone else?=C2= =A0<u></u><u></u></p> </div> <div> <p class=3D"MsoNormal"><u></u>=C2=A0<u></u></p> </div> <div> <p class=3D"MsoNormal">Thank you!<u></u><u></u></p> </div> </div> </div> </div> </div> </div> </div> _______________________________________________<br> Wekalist mailing list -- <a href=3D"mailto:[email protected]" tar= get=3D"_blank">[email protected]</a><br> Send posts to <a href=3D"mailto:[email protected]" target=3D"_bla= nk">[email protected]</a><br> To unsubscribe send an email to <a href=3D"mailto:[email protected]= to.ac.nz" target=3D"_blank">[email protected]</a><br> To subscribe, unsubscribe, etc., visit <a href=3D"https://list.waikato.ac.n= z/postorius/lists/wekalist.list.waikato.ac.nz" rel=3D"noreferrer" target=3D= "_blank">https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.a= c.nz</a><br> List etiquette: <a href=3D"http://www.cs.waikato.ac.nz/~ml/weka/mailinglist= _etiquette.html" rel=3D"noreferrer" target=3D"_blank">http://www.cs.waikato= .ac.nz/~ml/weka/mailinglist_etiquette.html</a><br> </div></blockquote></div> --000000000000d2b338061bd5a113-- --===============6900343501362358997== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Wekalist mailing list -- [email protected] Send posts to [email protected] To unsubscribe send an email to [email protected] To subscribe, unsubscribe, etc., visit https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html --===============6900343501362358997==--