Re: 30% faster with a batch size of 63 instead of 64!

RĂ©mi Coulom <[email protected]> Sat, 9 May 2020 22:22:13 +0200
Newsgroups gmane.games.devel.go
Message-ID <CANs0NNWkvE5fnfS+faKeP1xvo4Rgw5UXv35GGZDJ2tYZ_zYwxg@mail.gmail.com>
--===============5644724756931256302==
Content-Type: multipart/alternative; boundary="000000000000354a5705a53cdf6f"

--000000000000354a5705a53cdf6f
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Yeaaaah! first win against Kata!
http://www.yss-aya.com/cgos/viewer.cgi?9x9/SGF/2020/05/09/999849.sgf

In addition to the optimized batch size, I did two other things:
 - I use two batches of 63 instead of one, with double buffering, so that
the GPU is kept 100% busy. About 14k nodes per second now.
 - I make the search less selective, by using a bigger exploration constant
in the MCTS formula.
I should download Katago and CLOP my search parameters against it.

So far I have tried to keep the "Zero" philosophy of using self-play only,
but playing against other opponents is very likely to be a better approach
at making progress.

R=C3=A9mi

--000000000000354a5705a53cdf6f
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Yeaaaah! first win against Kata!</div><div><a href=3D=
"http://www.yss-aya.com/cgos/viewer.cgi?9x9/SGF/2020/05/09/999849.sgf">http=
://www.yss-aya.com/cgos/viewer.cgi?9x9/SGF/2020/05/09/999849.sgf</a></div><=
div><br></div><div>In addition to the optimized batch size, I did two other=
 things:</div><div>=C2=A0- I use two batches of 63 instead of one, with dou=
ble buffering, so that the GPU is kept 100% busy. About 14k nodes per secon=
d now.<br></div><div>=C2=A0- I make the search less selective, by using a b=
igger exploration constant in the MCTS formula.<br></div><div></div><div>I =
should download Katago and CLOP my search parameters against it.</div><div>=
<br></div><div>So far I have tried to keep the &quot;Zero&quot; philosophy =
of using self-play only, but playing against other opponents is very likely=
 to be a better approach at making progress.<br></div><div><br></div><div>R=
=C3=A9mi<br></div></div>

--000000000000354a5705a53cdf6f--

--===============5644724756931256302==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Computer-go mailing list
[email protected]
http://computer-go.org/mailman/listinfo/computer-go

--===============5644724756931256302==--