Re: Crossvalidation
Michael Hall <[email protected]> Tue, 26 Mar 2024 18:17:23 -0500
| Newsgroups | gmane.comp.ai.weka |
|---|---|
| Message-ID | <[email protected]> |
--===============0698174972392809037== Content-Type: multipart/alternative; boundary="Apple-Mail=_F81B4C45-F3F5-4ED3-88B4-8A3497FC2FFB" --Apple-Mail=_F81B4C45-F3F5-4ED3-88B4-8A3497FC2FFB Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Mar 26, 2024, at 4:57=E2=80=AFPM, Michael Hall <[email protected]> = wrote: >=20 >=20 >=20 >> On Mar 26, 2024, at 4:32=E2=80=AFPM, Eibe Frank = <[email protected]> wrote: >>=20 >> Take a look at this: >> =20 >> = https://weka.sourceforge.io/doc.packages/wekaServer/weka/server/WekaServer= .html >> = https://pentaho-public.atlassian.net/wiki/spaces/DATAMINING/pages/29612536= 6/Weka+Server >> =20 >> The WEKA server gives you a new button in the Classify panel that = sends jobs to the WEKA server (which you need to start separately at a = command-line interface). >> =20 >> Most learning schemes that can be easily parallelised, such as = RandomForest, have an option to specify the number of threads to be used = to build trees in parallel. >> =20 >> Cheers, >> Eibe >> =20 >=20 > The Explorer plugin for distributed cross-validation definitely sounds = like it=E2=80=99s worth a look. >=20 > Thanks again. This worked for me to run the server.=20 java --add-opens java.base/java.lang=3DALL-UNNAMED -cp = /Applications/weka-3-9-5/weka.jar -Djava.awt.headless=3Dtrue weka.Run = WekaServer -host localhost -port 8085 -slots 6 Server running RandomForest against the iris dataset also worked = although the Weka bird icon keeps bouncing. No indication of any = parallel processing but I would guess it can be assumed. I noticed RandomForest itself does support a slots parameter now. = Either I didn=E2=80=99t notice it before or it=E2=80=99s new since I = looked. Are there others with this parameter I should look for?= --Apple-Mail=_F81B4C45-F3F5-4ED3-88B4-8A3497FC2FFB Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"content-type" content=3D"text/html; = charset=3Dutf-8"></head><body style=3D"overflow-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;"><br = id=3D"lineBreakAtBeginningOfMessage"><div><br><blockquote = type=3D"cite"><div>On Mar 26, 2024, at 4:57=E2=80=AFPM, Michael Hall = <[email protected]> wrote:</div><br = class=3D"Apple-interchange-newline"><div><meta charset=3D"UTF-8"><div = style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: = 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; = letter-spacing: normal; text-align: start; text-indent: 0px; = text-transform: none; white-space: normal; word-spacing: 0px; = -webkit-text-stroke-width: 0px; text-decoration: none;"><br = class=3D"Apple-interchange-newline"><br><blockquote type=3D"cite"><div>On = Mar 26, 2024, at 4:32=E2=80=AFPM, Eibe Frank = <[email protected]> wrote:</div><br = class=3D"Apple-interchange-newline"><div><div class=3D"WordSection1" = style=3D"page: WordSection1; caret-color: rgb(0, 0, 0); font-family: = Helvetica; font-size: 12px; font-style: normal; font-variant-caps: = normal; font-weight: 400; letter-spacing: normal; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: = none;"><div style=3D"margin: 0cm; font-size: 10pt; font-family: Calibri, = sans-serif;"><span style=3D"font-size: 11pt;">Take a look at = this:<o:p></o:p></span></div><div style=3D"margin: 0cm; font-size: 10pt; = font-family: Calibri, sans-serif;"><span style=3D"font-size: = 11pt;"><o:p> </o:p></span></div><div style=3D"margin: 0cm; = font-size: 10pt; font-family: Calibri, sans-serif;"><span = style=3D"font-size: 11pt;"><a = href=3D"https://weka.sourceforge.io/doc.packages/wekaServer/weka/server/We= kaServer.html" style=3D"color: blue; text-decoration: = underline;">https://weka.sourceforge.io/doc.packages/wekaServer/weka/serve= r/WekaServer.html</a><o:p></o:p></span></div><div style=3D"margin: 0cm; = font-size: 10pt; font-family: Calibri, sans-serif;"><span = style=3D"font-size: 11pt;"><a = href=3D"https://pentaho-public.atlassian.net/wiki/spaces/DATAMINING/pages/= 296125366/Weka+Server" style=3D"color: blue; text-decoration: = underline;">https://pentaho-public.atlassian.net/wiki/spaces/DATAMINING/pa= ges/296125366/Weka+Server</a><o:p></o:p></span></div><div style=3D"margin:= 0cm; font-size: 10pt; font-family: Calibri, sans-serif;"><span = style=3D"font-size: 11pt;"><o:p> </o:p></span></div><div = style=3D"margin: 0cm; font-size: 10pt; font-family: Calibri, = sans-serif;"><span style=3D"font-size: 11pt;">The WEKA server gives you = a new button in the Classify panel that sends jobs to the WEKA server = (which you need to start separately at a command-line = interface).<o:p></o:p></span></div><div style=3D"margin: 0cm; font-size: = 10pt; font-family: Calibri, sans-serif;"><span style=3D"font-size: = 11pt;"><o:p> </o:p></span></div><div style=3D"margin: 0cm; = font-size: 10pt; font-family: Calibri, sans-serif;"><span = style=3D"font-size: 11pt;">Most learning schemes that can be easily = parallelised, such as RandomForest, have an option to specify the number = of threads to be used to build trees in = parallel.<o:p></o:p></span></div><div style=3D"margin: 0cm; font-size: = 10pt; font-family: Calibri, sans-serif;"><span style=3D"font-size: = 11pt;"><o:p> </o:p></span></div><div style=3D"margin: 0cm; = font-size: 10pt; font-family: Calibri, sans-serif;"><span = style=3D"font-size: 11pt;">Cheers,<o:p></o:p></span></div><div = style=3D"margin: 0cm; font-size: 10pt; font-family: Calibri, = sans-serif;"><span style=3D"font-size: = 11pt;">Eibe<o:p></o:p></span></div><div style=3D"margin: 0cm; font-size: = 10pt; font-family: Calibri, sans-serif;"><span style=3D"font-size: = 11pt;"><o:p> </o:p></span></div></div></div></blockquote><br></div><d= iv style=3D"caret-color: rgb(0, 0, 0); font-family: Helvetica; = font-size: 12px; font-style: normal; font-variant-caps: normal; = font-weight: 400; letter-spacing: normal; text-align: start; = text-indent: 0px; text-transform: none; white-space: normal; = word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: = none;">The Explorer plugin for distributed cross-validation definitely = sounds like it=E2=80=99s worth a look.</div><div style=3D"caret-color: = rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: = normal; font-variant-caps: normal; font-weight: 400; letter-spacing: = normal; text-align: start; text-indent: 0px; text-transform: none; = white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = text-decoration: none;"><br></div><div style=3D"caret-color: rgb(0, 0, = 0); font-family: Helvetica; font-size: 12px; font-style: normal; = font-variant-caps: normal; font-weight: 400; letter-spacing: normal; = text-align: start; text-indent: 0px; text-transform: none; white-space: = normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; = text-decoration: none;">Thanks = again.</div></div></blockquote></div><br><div>This worked for me to run = the server. </div><div><br></div><div>java --add-opens = java.base/java.lang=3DALL-UNNAMED -cp /Applications/weka-3-9-5/weka.jar = -Djava.awt.headless=3Dtrue weka.Run WekaServer -host localhost -port = 8085 -slots 6</div><div><br></div><div>Server running RandomForest = against the iris dataset also worked although the Weka bird icon keeps = bouncing. No indication of any parallel processing but I would guess it = can be assumed.</div><div><br></div><div>I noticed RandomForest itself = does support a slots parameter now. Either I didn=E2=80=99t notice = it before or it=E2=80=99s new since I looked. Are there others with this = parameter I should look for?</div></body></html>= --Apple-Mail=_F81B4C45-F3F5-4ED3-88B4-8A3497FC2FFB-- --===============0698174972392809037== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Wekalist mailing list -- [email protected] Send posts to [email protected] To unsubscribe send an email to [email protected] To subscribe, unsubscribe, etc., visit https://list.waikato.ac.nz/postorius/lists/wekalist.list.waikato.ac.nz List etiquette: http://www.cs.waikato.ac.nz/~ml/weka/mailinglist_etiquette.html --===============0698174972392809037==--