Re: Distcc pump mode
yudhistir reddy <[email protected]> Fri, 14 Mar 2014 17:18:03 +0530
| Newsgroups | gmane.comp.compilers.distcc |
|---|---|
| Message-ID | <CA+KcdAre3N_mP2Hb2CzzyNfy1W+fFxpCHPXhUmkJDXrT7ysRyg@mail.gmail.com> |
--===============6851595795371322120== Content-Type: multipart/alternative; boundary=001a11c352a477bdde04f48fa4cc --001a11c352a477bdde04f48fa4cc Content-Type: text/plain; charset=ISO-8859-1 I have a query , Client machine(where build is running) : 16 CPU dual socket ( logically 32 Cores ) Server1 (distccd running ) : 16 CPU dual socket ( logically 32 Cores ) Server2 (distccd running ): 16 CPU dual socket ( logically 32 Cores ) How much -j value i can give so that it would give best performance . for running single build on client ? for running two concurrent builds on client ? might be silly question , but that would be help me reducing my testing time to give demo . Regards Yudhistir On Fri, Mar 14, 2014 at 4:55 PM, yudhistir reddy <[email protected]>wrote: > Thank you so much for helping me . This issue is resolved . Now i am > testing the pump mode . > > Regards > Yudhsitir > > > On Fri, Mar 14, 2014 at 12:07 AM, Fergus Henderson <[email protected]>wrote: > >> >> On 13 Mar 2014 13:29, "yudhistir reddy" <[email protected]> >> wrote: >> > >> > # May need to override this (eg. for logging) >> > exec_cmd() { >> > exec "$@" >> > } >> > >> > # This is my official name >> > MYNAME=mk >> > >> > Mydir=`dirname $0` >> > >> > # for customization >> > unset mk_cmd_hooks mk_setup_hooks mk_finish_hooks >> > >> > # override this for more complex requirements >> > mk_target_machine() { >> > MACHINE=$1 >> > export MACHINE >> > } >> > >> > . $Mydir/sb-env.sh >> >> What's in sb-env.sh? >> That looks suspicious... >> >> > # for backwards compatability >> > mk_cmd_hook() { :; } >> > add_hooks mk_cmd_hooks mk_cmd_hook >> > >> > run_hooks mk_setup_hooks >> > run_hooks mk_cmd_hooks >> > run_hooks mk_cmd_hooks_lifo LIFO >> > run_hooks mk_finish_hooks >> > >> > # we generally cannot afford to consume the command line >> > # since virtually any option might be for $cmd >> > # but we'll make an exception for these >> > while : >> > do >> > case "$1" in >> > --) shift; break;; # stop trying to interpret anything >> > --doc) __doc;; # does not return >> > --help) __help;; # does not return >> > --machine) mk_target_machine $2; shift 2;; >> > *) break;; >> > esac >> > done >> > >> > case $Myname in >> > mk|mk-*|*make) >> > nice=${nice:-nice} >> > cmd=${cmd:-${REAL_MAKE:-/usr/bin/make}};; >> > *) cmd=${cmd:-$Myname.real};; >> > esac >> > # at last! do some work >> > exec_cmd $nice $cmd "$@" >> > >> > >> > On Thu, Mar 13, 2014 at 5:31 PM, Vanush <[email protected]> wrote: >> >> >> >> On Thu, Mar 13, 2014 at 05:23:14PM +0530, yudhistir reddy wrote: >> >> > Sorry for that , that was silly mistake by me . >> >> > >> >> > Here is the use case , i did : >> >> > >> >> > 1. eval `pump --startup` >> >> > checked pump mode variables , i can see INCLUDE_SERVER_PORT set to >> >> > /tmp/distcc-pump.LIlIcs/socket >> >> > >> >> > >> >> > 2. started build >> >> > mk kernel -j30 WITH_DISTCC=yes >> >> > Build finished with pump mode ( But actually it is turing back to >> Normal >> >> > mode ) . >> >> > I see the warning messages in distcclog as like below >> >> >> >> can you show us your "mk" wrapper? >> >> >> >> Misha >> >> >> >> >> >> -- >> >> Vanush "Misha" Paturyan >> >> Senior Technical Officer >> >> Room 1.37 >> >> Computer Science Department >> >> NUI Maynooth >> > >> > >> > >> > __ >> > distcc mailing list http://distcc.samba.org/ >> > To unsubscribe or change options: >> > https://lists.samba.org/mailman/listinfo/distcc >> >> > --001a11c352a477bdde04f48fa4cc Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div><div><div>I have a query ,<br><br></div>Client machin= e(where build is running) : 16 CPU dual socket ( logically 32 Cores )<br><b= r></div>Server1 (distccd running ) : 16 CPU dual socket ( logically 32 Core= s )<br> <br></div><div>Server2 (distccd running ): 16 CPU dual socket ( logically 3= 2 Cores )<br><br></div><div>How much -j value i can give so that it would g= ive best performance . <br></div><div>for running single build on client ?<= br> </div><div>for running two concurrent builds on client ?<br><br><br></div><= div>might be silly question , but that would be help me reducing my testing= time to give demo . <br><br><br></div><div>Regards<br></div><div>Yudhistir= <br> </div><div><br></div><br><div><div><br><br></div></div></div><div class=3D"= gmail_extra"><br><br><div class=3D"gmail_quote">On Fri, Mar 14, 2014 at 4:5= 5 PM, yudhistir reddy <span dir=3D"ltr"><<a href=3D"mailto:yudhistir.red= [email protected]" target=3D"_blank">[email protected]</a>></span> wr= ote:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p= x #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div><div>Thank you so much= for helping me . This issue is resolved . Now i am testing the pump mode .= <br> <br></div>Regards<br></div>Yudhsitir<br></div><div class=3D"HOEnZb"><div cl= ass=3D"h5"><div class=3D"gmail_extra"><br><br><div class=3D"gmail_quote"> On Fri, Mar 14, 2014 at 12:07 AM, Fergus Henderson <span dir=3D"ltr"><<a= href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>&= gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0 0 = 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div><p dir=3D"ltr"><br> On 13 Mar 2014 13:29, "yudhistir reddy" <<a href=3D"mailto:yud= [email protected]" target=3D"_blank">[email protected]</a>>= wrote:<br> ><br> > # May need to override this (eg. for logging)<br> > exec_cmd() {<br> > =A0=A0=A0 exec "$@"<br> > }<br> ><br> > # This is my official name<br> > MYNAME=3Dmk<br> ><br> > Mydir=3D`dirname $0`<br> ><br> > # for customization<br> > unset mk_cmd_hooks mk_setup_hooks mk_finish_hooks<br> ><br> > # override this for more complex requirements<br> > mk_target_machine() {<br> > =A0=A0=A0 MACHINE=3D$1<br> > =A0=A0=A0 export MACHINE<br> > }<br> ><br> > . $Mydir/sb-env.sh</p> </div><p dir=3D"ltr">What's in sb-env.sh?<br> That looks suspicious...</p> <p dir=3D"ltr"></p><div><div>> # for backwards compatability<br> > mk_cmd_hook() { :; }<br> > add_hooks mk_cmd_hooks mk_cmd_hook<br> ><br> > run_hooks mk_setup_hooks<br> > run_hooks mk_cmd_hooks<br> > run_hooks mk_cmd_hooks_lifo LIFO<br> > run_hooks mk_finish_hooks<br> ><br> > # we generally cannot afford to consume the command line<br> > # since virtually any option might be for $cmd<br> > # but we'll make an exception for these<br> > while :<br> > do<br> > =A0=A0=A0 case "$1" in<br> > =A0=A0=A0 --) shift; break;;=A0=A0=A0=A0=A0=A0=A0=A0=A0 # stop trying = to interpret anything<br> > =A0=A0=A0 --doc) __doc;;=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 # does= not return<br> > =A0=A0=A0 --help) __help;;=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 # does not= return<br> > =A0=A0=A0 --machine) mk_target_machine $2; shift 2;;<br> > =A0=A0=A0 *) break;;<br> > =A0=A0=A0 esac<br> > done<br> ><br> > case $Myname in<br> > mk|mk-*|*make)<br> > =A0=A0=A0=A0=A0=A0=A0 nice=3D${nice:-nice}<br> > =A0=A0=A0=A0=A0=A0=A0 cmd=3D${cmd:-${REAL_MAKE:-/usr/bin/make}};;<br> > *)=A0=A0=A0=A0=A0 cmd=3D${cmd:-$Myname.real};;<br> > esac<br> > # at last! do some work<br> > exec_cmd $nice $cmd "$@"<br> ><br> ><br> > On Thu, Mar 13, 2014 at 5:31 PM, Vanush <<a href=3D"mailto:misha@cs= .nuim.ie" target=3D"_blank">[email protected]</a>> wrote:<br> >><br> >> On Thu, Mar 13, 2014 at 05:23:14PM +0530, yudhistir reddy wrote:<b= r> >> > Sorry for that , that was silly mistake by me .<br> >> ><br> >> > Here is the use case , i did :<br> >> ><br> >> > 1. eval `pump --startup`<br> >> > checked pump mode variables , i can see INCLUDE_SERVER_PORT s= et to<br> >> > /tmp/distcc-pump.LIlIcs/socket<br> >> ><br> >> ><br> >> > 2. started build<br> >> > mk kernel -j30 WITH_DISTCC=3Dyes<br> >> > Build finished with pump mode =A0( But actually it is turing = back to Normal<br> >> > mode ) .<br> >> > I see the warning messages in distcclog as like below<br> >><br> >> can you show us your "mk" wrapper?<br> >><br> >> Misha<br> >><br> >><br> >> --<br> >> Vanush "Misha" Paturyan<br> >> Senior Technical Officer<br> >> Room 1.37<br> >> Computer Science Department<br> >> NUI Maynooth<br> ><br> ><br> ><br></div></div><div> > __<br> > distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://distcc.sa= mba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> > To unsubscribe or change options:<br> > <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" target=3D"= _blank">https://lists.samba.org/mailman/listinfo/distcc</a><br> </div><p></p> </blockquote></div><br></div> </div></div></blockquote></div><br></div> --001a11c352a477bdde04f48fa4cc-- --===============6851595795371322120== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline __ distcc mailing list http://distcc.samba.org/ To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/distcc --===============6851595795371322120==--