Re: 30% faster with a batch size of 63 instead of 64!
Rémi Coulom <[email protected]> Sat, 9 May 2020 22:22:13 +0200
| Newsgroups | gmane.games.devel.go |
|---|---|
| Message-ID | <CANs0NNWkvE5fnfS+faKeP1xvo4Rgw5UXv35GGZDJ2tYZ_zYwxg@mail.gmail.com> |
--===============5644724756931256302== Content-Type: multipart/alternative; boundary="000000000000354a5705a53cdf6f" --000000000000354a5705a53cdf6f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Yeaaaah! first win against Kata! http://www.yss-aya.com/cgos/viewer.cgi?9x9/SGF/2020/05/09/999849.sgf In addition to the optimized batch size, I did two other things: - I use two batches of 63 instead of one, with double buffering, so that the GPU is kept 100% busy. About 14k nodes per second now. - I make the search less selective, by using a bigger exploration constant in the MCTS formula. I should download Katago and CLOP my search parameters against it. So far I have tried to keep the "Zero" philosophy of using self-play only, but playing against other opponents is very likely to be a better approach at making progress. R=C3=A9mi --000000000000354a5705a53cdf6f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>Yeaaaah! first win against Kata!</div><div><a href=3D= "http://www.yss-aya.com/cgos/viewer.cgi?9x9/SGF/2020/05/09/999849.sgf">http= ://www.yss-aya.com/cgos/viewer.cgi?9x9/SGF/2020/05/09/999849.sgf</a></div><= div><br></div><div>In addition to the optimized batch size, I did two other= things:</div><div>=C2=A0- I use two batches of 63 instead of one, with dou= ble buffering, so that the GPU is kept 100% busy. About 14k nodes per secon= d now.<br></div><div>=C2=A0- I make the search less selective, by using a b= igger exploration constant in the MCTS formula.<br></div><div></div><div>I = should download Katago and CLOP my search parameters against it.</div><div>= <br></div><div>So far I have tried to keep the "Zero" philosophy = of using self-play only, but playing against other opponents is very likely= to be a better approach at making progress.<br></div><div><br></div><div>R= =C3=A9mi<br></div></div> --000000000000354a5705a53cdf6f-- --===============5644724756931256302== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Computer-go mailing list [email protected] http://computer-go.org/mailman/listinfo/computer-go --===============5644724756931256302==--