Re: Distcc pump mode
yudhistir reddy <[email protected]> Thu, 13 Mar 2014 16:24:32 +0530
| Newsgroups | gmane.comp.compilers.distcc |
|---|---|
| Message-ID | <CA+KcdAqEw-ETHh021bOxctEMOdd3XwVvGOs0vsb_FYx40XkM=w@mail.gmail.com> |
--===============6689552552741579382== Content-Type: multipart/alternative; boundary=089e013d1dd6347a1a04f47ac74c --089e013d1dd6347a1a04f47ac74c Content-Type: text/plain; charset=ISO-8859-1 Hi, I followed this 1.started pump mode like eval 'pump --startup' export INCLUDE_SERVER_PID='13821' export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' 2. didnot start mk command yet . I want to see the variable value echo $INCLUDE_SERVER_PORT . It is showing nothing . So all pump mode variables are not getting exported properly . I think something is wrong with exporting . I am using bash shell . Any suggestions , why its not exporting variables properly . P.s : mk didnot start yet . Regards Yudhistir On Thu, Mar 13, 2014 at 3:51 PM, yudhistir reddy <[email protected]>wrote: > sample output.. > > src >pump env > __________Using distcc-pump from > /shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin > __________Using 4 distcc servers in pump mode > LOGNAME= > _=/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump > BLOCKSIZE=K > INCLUDE_SERVER_PORT=/tmp/distcc-pump.iA44t8/socket > OSTYPE=linux > SSH_CONNECTION=<ip address> 58236 <ip address> 22 > DISTCC_HOSTS=s-server01/32,cpp,lzo s-server02/32,cpp,lzo > s-server03/32,cpp,lzo s-server04/32,cpp,lzo > HOSTTYPE=x86_64-linux > EDITOR=vi > __________Shutting down distcc-pump include server > > It is diplaying the INCLUDE_SERVER_PORT and its creating the file there in > /tmp directory . > > otherway: > eval 'pump --startup' > export INCLUDE_SERVER_PID='13821' > export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' > export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' > > > > > On Thu, Mar 13, 2014 at 2:48 PM, Vanush <[email protected]> wrote: > >> On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrote: >> > Thank you. Is there any way i can display the list of environment >> variables >> > it sets once pump script starts . mk is just the wrapper to call make . >> We >> > are not doing anything in that . But still i will dig into it more (mk) >> . >> > distcc normal mode is working fine and i see 10% build time reduction. >> >> I would suspect that whichever way mk is started by the shell it >> resets the environment. Can you show this "mk" script (or at least its >> first few lines)? >> >> Withouth looking at pump itself: is it possible to do someting like >> "pump env" (this should show the environment), and then add an env >> invocation into "mk" script, just before calling make, and compare >> outputs? >> >> Misha. >> >> > Is there any work around for this . I can export these variable for some >> > fixed port like 3632 for tcp . Pls let me know any other variables i >> need >> > to set to make this pump mode work . Actually i am running out of time >> > because i need to show my colleagues and friends , how distcc is working >> > and improving build time . For the time being , i need some work around >> for >> > pump mode to work , then later i will debug more on this . >> > >> > Any help on this much appreciated . >> > >> > Regards >> > Yudhistir >> > Any help on this much appreciated . >> > >> > Regards >> > Yudhistir >> > >> > >> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <[email protected]> >> wrote: >> > >> > > The pump script will set that environment variable before invoking >> "mk". >> > > But perhaps "mk" is resetting the environment? Or something else >> between >> > > "mk" and "distcc" might be unsetting it? >> > > On 11 Mar 2014 14:13, "yudhistir reddy" <[email protected]> >> wrote: >> > > >> > >> Hi, >> > >> >> > >> I am trying to build using distcc pump mode . >> > >> >> > >> I set DISTCC_HOSTS . >> > >> >> > >> i am starting the pump mode with >> > >> >> > >> pump mk jkernel-jobs WITH_DISTCC=yes >> > >> >> > >> I am getting below waring >> > >> >> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you forget >> to run >> > >> under 'pump'? >> > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get includes >> from >> > >> include server, preprocessing locally >> > >> >> > >> >> > >> When we start pump mode , is distcc not setting this variable ? >> > >> >> > >> >> > >> >> > >> Regards >> > >> Yudhistir >> > >> >> > >> >> > >> >> > >> >> > >> __ >> > >> distcc mailing list http://distcc.samba.org/ >> > >> To unsubscribe or change options: >> > >> https://lists.samba.org/mailman/listinfo/distcc >> > >> >> > > >> >> > __ >> > distcc mailing list http://distcc.samba.org/ >> > To unsubscribe or change options: >> > https://lists.samba.org/mailman/listinfo/distcc >> >> >> -- >> Vanush "Misha" Paturyan >> Senior Technical Officer >> Room 1.37 >> Computer Science Department >> NUI Maynooth >> __ >> distcc mailing list http://distcc.samba.org/ >> To unsubscribe or change options: >> https://lists.samba.org/mailman/listinfo/distcc >> > > --089e013d1dd6347a1a04f47ac74c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div><div>Hi,<br><br></div>I followed this <br><br></div>1= .started pump mode like<br>eval 'pump --startup'<br>export INCLUDE_= SERVER_PID=3D'13821'<br>export INCLUDE_SERVER_DIR=3D'/tmp/distc= c-pump.ygmgYX'<br> <div>export INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket'<= br><br></div><div>2.=A0 didnot start mk command yet .<br></div><div>I want = to see the variable value<br><br></div><div>echo $INCLUDE_SERVER_PORT .<br> <br></div><div>It is showing nothing . So all pump mode variables are not g= etting exported properly . I think something is wrong with exporting . I am= using bash shell . <br><br></div><div>Any suggestions , why its not export= ing variables properly .<br> <br></div><div>P.s : mk didnot start yet .<br><br></div><div>Regards<br></d= iv><div>Yudhistir<br></div><div><br><br></div><br><br></div><div class=3D"g= mail_extra"><br><br><div class=3D"gmail_quote">On Thu, Mar 13, 2014 at 3:51= PM, yudhistir reddy <span dir=3D"ltr"><<a href=3D"mailto:yudhistir.redd= [email protected]" target=3D"_blank">[email protected]</a>></span> wro= te:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p= x #ccc solid;padding-left:1ex"><div dir=3D"ltr"><div>sample output..<br></d= iv><div><br>src >pump env<br>__________Using distcc-pump from /shared_lo= cation/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin<br> __________Using 4 distcc servers in pump mode<br>LOGNAME=3D<br> _=3D/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump<br>BLOCK= SIZE=3DK<br>INCLUDE_SERVER_PORT=3D/tmp/distcc-pump.iA44t8/socket<br>OSTYPE= =3Dlinux<br>SSH_CONNECTION=3D<ip address> 58236 <ip address> 22= <br>DISTCC_HOSTS=3Ds-server01/32,cpp,lzo s-server02/32,cpp,lzo s-server03/3= 2,cpp,lzo s-server04/32,cpp,lzo<br> HOSTTYPE=3Dx86_64-linux<br>EDITOR=3Dvi<br>__________Shutting down distcc-pu= mp include server<br><br></div>It is diplaying the INCLUDE_SERVER_PORT and = its creating the file there in /tmp directory .<br><div><br></div><div>othe= rway:<br> eval 'pump --startup'<br>export INCLUDE_SERVER_PID=3D'13821'= ;<br>export INCLUDE_SERVER_DIR=3D'/tmp/distcc-pump.ygmgYX'<br>expor= t INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket'<br><br></d= iv> <div><br></div></div><div class=3D"HOEnZb"><div class=3D"h5"><div class=3D"= gmail_extra"><br><br><div class=3D"gmail_quote">On Thu, Mar 13, 2014 at 2:4= 8 PM, Vanush <span dir=3D"ltr"><<a href=3D"mailto:[email protected]" targ= et=3D"_blank">[email protected]</a>></span> wrote:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p= x #ccc solid;padding-left:1ex"><div>On Thu, Mar 13, 2014 at 12:10:24PM +053= 0, yudhistir reddy wrote:<br> > Thank you. Is there any way i can display the list of environment vari= ables<br> > it sets once pump script starts . mk is just the wrapper to call make = . We<br> > are not doing anything in that . But still i will dig into it more (mk= ) .<br> > distcc normal mode is working fine and i see 10% build time reduction.= <br> <br> </div>I would suspect that whichever way mk is started by the shell it<br> resets the environment. Can you show this "mk" script (or at leas= t its<br> first few lines)?<br> <br> Withouth looking at pump itself: is it possible to do someting like<br> "pump env" (this should show the environment), and then add an en= v<br> invocation into "mk" script, just before calling make, and compar= e<br> outputs?<br> <br> Misha.<br> <div><div><br> > Is there any work around for this . I can export these variable for so= me<br> > fixed port like 3632 for tcp . =A0Pls let me know any other variables = i need<br> > to set to make this pump mode work . Actually i am running out of time= <br> > because i need to show my colleagues and friends , how distcc is worki= ng<br> > and improving build time . For the time being , i need some work aroun= d for<br> > pump mode to work , then later i will debug more on this .<br> ><br> > Any help on this much appreciated .<br> ><br> > Regards<br> > Yudhistir<br> > Any help on this much appreciated .<br> ><br> > Regards<br> > Yudhistir<br> ><br> ><br> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <<a href=3D"mailt= o:[email protected]" target=3D"_blank">[email protected]</a>> wrote:<br> ><br> > > The pump script will set that environment variable before invokin= g "mk".<br> > > But perhaps "mk" is resetting the environment? Or somet= hing else between<br> > > "mk" and "distcc" might be unsetting it?<br> > > On 11 Mar 2014 14:13, "yudhistir reddy" <<a href=3D"= mailto:[email protected]" target=3D"_blank">[email protected]= om</a>> wrote:<br> > ><br> > >> Hi,<br> > >><br> > >> I am trying to build using distcc pump mode .<br> > >><br> > >> I set DISTCC_HOSTS .<br> > >><br> > >> i am starting the pump mode with<br> > >><br> > >> pump mk jkernel-jobs WITH_DISTCC=3Dyes<br> > >><br> > >> I am getting below waring<br> > >><br> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you f= orget to run<br> > >> under 'pump'?<br> > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get inc= ludes from<br> > >> include server, preprocessing locally<br> > >><br> > >><br> > >> When we start pump mode , is distcc not setting this variable= ?<br> > >><br> > >><br> > >><br> > >> Regards<br> > >> Yudhistir<br> > >><br> > >><br> > >><br> > >><br> > >> __<br> > >> distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://= distcc.samba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> > >> To unsubscribe or change options:<br> > >> <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" t= arget=3D"_blank">https://lists.samba.org/mailman/listinfo/distcc</a><br> > >><br> > ><br> <br> > __<br> > distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://distcc.sa= mba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> > To unsubscribe or change options:<br> > <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" target=3D"= _blank">https://lists.samba.org/mailman/listinfo/distcc</a><br> <br> <br> </div></div><span><font color=3D"#888888">--<br> Vanush "Misha" Paturyan<br> Senior Technical Officer<br> Room 1.37<br> Computer Science Department<br> NUI Maynooth<br> </font></span><div><div>__<br> distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://distcc.samba.o= rg/" target=3D"_blank">http://distcc.samba.org/</a><br> To unsubscribe or change options:<br> <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" target=3D"_blan= k">https://lists.samba.org/mailman/listinfo/distcc</a><br> </div></div></blockquote></div><br></div> </div></div></blockquote></div><br></div> --089e013d1dd6347a1a04f47ac74c-- --===============6689552552741579382== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline __ distcc mailing list http://distcc.samba.org/ To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/distcc --===============6689552552741579382==--