Re: Distcc pump mode
yudhistir reddy <[email protected]> Thu, 13 Mar 2014 15:51:46 +0530
| Newsgroups | gmane.comp.compilers.distcc |
|---|---|
| Message-ID | <CA+KcdAp2TxPj6rRNv8xHnf02MohZABwRh_nQLfg1bvs7_ofygw@mail.gmail.com> |
--===============6841517929598590424== Content-Type: multipart/alternative; boundary=001a1137e98607c54104f47a52aa --001a1137e98607c54104f47a52aa Content-Type: text/plain; charset=ISO-8859-1 sample output.. src >pump env __________Using distcc-pump from /shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin __________Using 4 distcc servers in pump mode LOGNAME= _=/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump BLOCKSIZE=K INCLUDE_SERVER_PORT=/tmp/distcc-pump.iA44t8/socket OSTYPE=linux SSH_CONNECTION=<ip address> 58236 <ip address> 22 DISTCC_HOSTS=s-server01/32,cpp,lzo s-server02/32,cpp,lzo s-server03/32,cpp,lzo s-server04/32,cpp,lzo HOSTTYPE=x86_64-linux EDITOR=vi __________Shutting down distcc-pump include server It is diplaying the INCLUDE_SERVER_PORT and its creating the file there in /tmp directory . otherway: eval 'pump --startup' export INCLUDE_SERVER_PID='13821' export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' On Thu, Mar 13, 2014 at 2:48 PM, Vanush <[email protected]> wrote: > On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrote: > > Thank you. Is there any way i can display the list of environment > variables > > it sets once pump script starts . mk is just the wrapper to call make . > We > > are not doing anything in that . But still i will dig into it more (mk) . > > distcc normal mode is working fine and i see 10% build time reduction. > > I would suspect that whichever way mk is started by the shell it > resets the environment. Can you show this "mk" script (or at least its > first few lines)? > > Withouth looking at pump itself: is it possible to do someting like > "pump env" (this should show the environment), and then add an env > invocation into "mk" script, just before calling make, and compare > outputs? > > Misha. > > > Is there any work around for this . I can export these variable for some > > fixed port like 3632 for tcp . Pls let me know any other variables i > need > > to set to make this pump mode work . Actually i am running out of time > > because i need to show my colleagues and friends , how distcc is working > > and improving build time . For the time being , i need some work around > for > > pump mode to work , then later i will debug more on this . > > > > Any help on this much appreciated . > > > > Regards > > Yudhistir > > Any help on this much appreciated . > > > > Regards > > Yudhistir > > > > > > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <[email protected]> > wrote: > > > > > The pump script will set that environment variable before invoking > "mk". > > > But perhaps "mk" is resetting the environment? Or something else > between > > > "mk" and "distcc" might be unsetting it? > > > On 11 Mar 2014 14:13, "yudhistir reddy" <[email protected]> > wrote: > > > > > >> Hi, > > >> > > >> I am trying to build using distcc pump mode . > > >> > > >> I set DISTCC_HOSTS . > > >> > > >> i am starting the pump mode with > > >> > > >> pump mk jkernel-jobs WITH_DISTCC=yes > > >> > > >> I am getting below waring > > >> > > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you forget to > run > > >> under 'pump'? > > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get includes > from > > >> include server, preprocessing locally > > >> > > >> > > >> When we start pump mode , is distcc not setting this variable ? > > >> > > >> > > >> > > >> Regards > > >> Yudhistir > > >> > > >> > > >> > > >> > > >> __ > > >> distcc mailing list http://distcc.samba.org/ > > >> To unsubscribe or change options: > > >> https://lists.samba.org/mailman/listinfo/distcc > > >> > > > > > > __ > > distcc mailing list http://distcc.samba.org/ > > To unsubscribe or change options: > > https://lists.samba.org/mailman/listinfo/distcc > > > -- > Vanush "Misha" Paturyan > Senior Technical Officer > Room 1.37 > Computer Science Department > NUI Maynooth > __ > distcc mailing list http://distcc.samba.org/ > To unsubscribe or change options: > https://lists.samba.org/mailman/listinfo/distcc > --001a1137e98607c54104f47a52aa Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>sample output..<br></div><div><br>src >pump env<br= >__________Using distcc-pump from /shared_location/Linux/Ubuntu-12.04/x86_6= 4/distcc/3.1/bin<br>__________Using 4 distcc servers in pump mode<br>LOGNAM= E=3D<br> _=3D/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump<br>BLOCK= SIZE=3DK<br>INCLUDE_SERVER_PORT=3D/tmp/distcc-pump.iA44t8/socket<br>OSTYPE= =3Dlinux<br>SSH_CONNECTION=3D<ip address> 58236 <ip address> 22= <br>DISTCC_HOSTS=3Ds-server01/32,cpp,lzo s-server02/32,cpp,lzo s-server03/3= 2,cpp,lzo s-server04/32,cpp,lzo<br> HOSTTYPE=3Dx86_64-linux<br>EDITOR=3Dvi<br>__________Shutting down distcc-pu= mp include server<br><br></div>It is diplaying the INCLUDE_SERVER_PORT and = its creating the file there in /tmp directory .<br><div><br></div><div>othe= rway:<br> eval 'pump --startup'<br>export INCLUDE_SERVER_PID=3D'13821'= ;<br>export INCLUDE_SERVER_DIR=3D'/tmp/distcc-pump.ygmgYX'<br>expor= t INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket'<br><br></d= iv> <div><br></div></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail= _quote">On Thu, Mar 13, 2014 at 2:48 PM, Vanush <span dir=3D"ltr"><<a hr= ef=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>></= span> wrote:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p= x #ccc solid;padding-left:1ex"><div class=3D"">On Thu, Mar 13, 2014 at 12:1= 0:24PM +0530, yudhistir reddy wrote:<br> > Thank you. Is there any way i can display the list of environment vari= ables<br> > it sets once pump script starts . mk is just the wrapper to call make = . We<br> > are not doing anything in that . But still i will dig into it more (mk= ) .<br> > distcc normal mode is working fine and i see 10% build time reduction.= <br> <br> </div>I would suspect that whichever way mk is started by the shell it<br> resets the environment. Can you show this "mk" script (or at leas= t its<br> first few lines)?<br> <br> Withouth looking at pump itself: is it possible to do someting like<br> "pump env" (this should show the environment), and then add an en= v<br> invocation into "mk" script, just before calling make, and compar= e<br> outputs?<br> <br> Misha.<br> <div class=3D"HOEnZb"><div class=3D"h5"><br> > Is there any work around for this . I can export these variable for so= me<br> > fixed port like 3632 for tcp . =A0Pls let me know any other variables = i need<br> > to set to make this pump mode work . Actually i am running out of time= <br> > because i need to show my colleagues and friends , how distcc is worki= ng<br> > and improving build time . For the time being , i need some work aroun= d for<br> > pump mode to work , then later i will debug more on this .<br> ><br> > Any help on this much appreciated .<br> ><br> > Regards<br> > Yudhistir<br> > Any help on this much appreciated .<br> ><br> > Regards<br> > Yudhistir<br> ><br> ><br> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <<a href=3D"mailt= o:[email protected]">[email protected]</a>> wrote:<br> ><br> > > The pump script will set that environment variable before invokin= g "mk".<br> > > But perhaps "mk" is resetting the environment? Or somet= hing else between<br> > > "mk" and "distcc" might be unsetting it?<br> > > On 11 Mar 2014 14:13, "yudhistir reddy" <<a href=3D"= mailto:[email protected]">[email protected]</a>> wrote:<= br> > ><br> > >> Hi,<br> > >><br> > >> I am trying to build using distcc pump mode .<br> > >><br> > >> I set DISTCC_HOSTS .<br> > >><br> > >> i am starting the pump mode with<br> > >><br> > >> pump mk jkernel-jobs WITH_DISTCC=3Dyes<br> > >><br> > >> I am getting below waring<br> > >><br> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you f= orget to run<br> > >> under 'pump'?<br> > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get inc= ludes from<br> > >> include server, preprocessing locally<br> > >><br> > >><br> > >> When we start pump mode , is distcc not setting this variable= ?<br> > >><br> > >><br> > >><br> > >> Regards<br> > >> Yudhistir<br> > >><br> > >><br> > >><br> > >><br> > >> __<br> > >> distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://= distcc.samba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> > >> To unsubscribe or change options:<br> > >> <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" t= arget=3D"_blank">https://lists.samba.org/mailman/listinfo/distcc</a><br> > >><br> > ><br> <br> > __<br> > distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://distcc.sa= mba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> > To unsubscribe or change options:<br> > <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" target=3D"= _blank">https://lists.samba.org/mailman/listinfo/distcc</a><br> <br> <br> </div></div><span class=3D"HOEnZb"><font color=3D"#888888">--<br> Vanush "Misha" Paturyan<br> Senior Technical Officer<br> Room 1.37<br> Computer Science Department<br> NUI Maynooth<br> </font></span><div class=3D"HOEnZb"><div class=3D"h5">__<br> distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://distcc.samba.o= rg/" target=3D"_blank">http://distcc.samba.org/</a><br> To unsubscribe or change options:<br> <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" target=3D"_blan= k">https://lists.samba.org/mailman/listinfo/distcc</a><br> </div></div></blockquote></div><br></div> --001a1137e98607c54104f47a52aa-- --===============6841517929598590424== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline __ distcc mailing list http://distcc.samba.org/ To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/distcc --===============6841517929598590424==--