Re: Distcc pump mode
Fergus Henderson <[email protected]> Thu, 13 Mar 2014 11:04:10 +0000
| Newsgroups | gmane.comp.compilers.distcc |
|---|---|
| Message-ID | <CAPXkjd8SgBuoV8P_Z6jCex=a+yWPTJfgE-hwYyRELqzhxUHpPg@mail.gmail.com> |
--===============5259879297397034269== Content-Type: multipart/alternative; boundary=089e013c7136b70e4304f47ae988 --089e013c7136b70e4304f47ae988 Content-Type: text/plain; charset=UTF-8 On 13 Mar 2014 10:54, "yudhistir reddy" <[email protected]> wrote: > > Hi, > > I followed this > > 1.started pump mode like > > eval 'pump --startup' That should use back quotes: eval `pump --startup` NOT eval 'pump --startup' > export INCLUDE_SERVER_PID='13821' > export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' > export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' > > 2. didnot start mk command yet . > I want to see the variable value > > echo $INCLUDE_SERVER_PORT . > > It is showing nothing . So all pump mode variables are not getting exported properly . I think something is wrong with exporting . I am using bash shell . > > Any suggestions , why its not exporting variables properly . > > P.s : mk didnot start yet . > > Regards > Yudhistir > > > > > > > On Thu, Mar 13, 2014 at 3:51 PM, yudhistir reddy < [email protected]> wrote: >> >> sample output.. >> >> src >pump env >> __________Using distcc-pump from /shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin >> __________Using 4 distcc servers in pump mode >> LOGNAME= >> _=/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump >> BLOCKSIZE=K >> INCLUDE_SERVER_PORT=/tmp/distcc-pump.iA44t8/socket >> OSTYPE=linux >> SSH_CONNECTION=<ip address> 58236 <ip address> 22 >> DISTCC_HOSTS=s-server01/32,cpp,lzo s-server02/32,cpp,lzo s-server03/32,cpp,lzo s-server04/32,cpp,lzo >> HOSTTYPE=x86_64-linux >> EDITOR=vi >> __________Shutting down distcc-pump include server >> >> It is diplaying the INCLUDE_SERVER_PORT and its creating the file there in /tmp directory . >> >> otherway: >> eval 'pump --startup' >> export INCLUDE_SERVER_PID='13821' >> export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' >> export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' >> >> >> >> >> On Thu, Mar 13, 2014 at 2:48 PM, Vanush <[email protected]> wrote: >>> >>> On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrote: >>> > Thank you. Is there any way i can display the list of environment variables >>> > it sets once pump script starts . mk is just the wrapper to call make . We >>> > are not doing anything in that . But still i will dig into it more (mk) . >>> > distcc normal mode is working fine and i see 10% build time reduction. >>> >>> I would suspect that whichever way mk is started by the shell it >>> resets the environment. Can you show this "mk" script (or at least its >>> first few lines)? >>> >>> Withouth looking at pump itself: is it possible to do someting like >>> "pump env" (this should show the environment), and then add an env >>> invocation into "mk" script, just before calling make, and compare >>> outputs? >>> >>> Misha. >>> >>> > Is there any work around for this . I can export these variable for some >>> > fixed port like 3632 for tcp . Pls let me know any other variables i need >>> > to set to make this pump mode work . Actually i am running out of time >>> > because i need to show my colleagues and friends , how distcc is working >>> > and improving build time . For the time being , i need some work around for >>> > pump mode to work , then later i will debug more on this . >>> > >>> > Any help on this much appreciated . >>> > >>> > Regards >>> > Yudhistir >>> > Any help on this much appreciated . >>> > >>> > Regards >>> > Yudhistir >>> > >>> > >>> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <[email protected]> wrote: >>> > >>> > > The pump script will set that environment variable before invoking "mk". >>> > > But perhaps "mk" is resetting the environment? Or something else between >>> > > "mk" and "distcc" might be unsetting it? >>> > > On 11 Mar 2014 14:13, "yudhistir reddy" <[email protected]> wrote: >>> > > >>> > >> Hi, >>> > >> >>> > >> I am trying to build using distcc pump mode . >>> > >> >>> > >> I set DISTCC_HOSTS . >>> > >> >>> > >> i am starting the pump mode with >>> > >> >>> > >> pump mk jkernel-jobs WITH_DISTCC=yes >>> > >> >>> > >> I am getting below waring >>> > >> >>> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you forget to run >>> > >> under 'pump'? >>> > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get includes from >>> > >> include server, preprocessing locally >>> > >> >>> > >> >>> > >> When we start pump mode , is distcc not setting this variable ? >>> > >> >>> > >> >>> > >> >>> > >> Regards >>> > >> Yudhistir >>> > >> >>> > >> >>> > >> >>> > >> >>> > >> __ >>> > >> distcc mailing list http://distcc.samba.org/ >>> > >> To unsubscribe or change options: >>> > >> https://lists.samba.org/mailman/listinfo/distcc >>> > >> >>> > > >>> >>> > __ >>> > distcc mailing list http://distcc.samba.org/ >>> > To unsubscribe or change options: >>> > https://lists.samba.org/mailman/listinfo/distcc >>> >>> >>> -- >>> Vanush "Misha" Paturyan >>> Senior Technical Officer >>> Room 1.37 >>> Computer Science Department >>> NUI Maynooth >>> __ >>> distcc mailing list http://distcc.samba.org/ >>> To unsubscribe or change options: >>> https://lists.samba.org/mailman/listinfo/distcc >> >> > --089e013c7136b70e4304f47ae988 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <p dir=3D"ltr"><br> On 13 Mar 2014 10:54, "yudhistir reddy" <<a href=3D"mailto:yud= [email protected]">[email protected]</a>> wrote:<br> ><br> > Hi,<br> ><br> > I followed this <br> ><br> > 1.started pump mode like<br> ><br> > eval 'pump --startup'</p> <p dir=3D"ltr">That should use back quotes:<br> eval `pump --startup`<br> NOT<br> eval 'pump --startup'</p> <p dir=3D"ltr">> export INCLUDE_SERVER_PID=3D'13821'<br> > export INCLUDE_SERVER_DIR=3D'/tmp/distcc-pump.ygmgYX'<br> > export INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket'<= br> ><br> > 2.=C2=A0 didnot start mk command yet .<br> > I want to see the variable value<br> ><br> > echo $INCLUDE_SERVER_PORT .<br> ><br> > It is showing nothing . So all pump mode variables are not getting exp= orted properly . I think something is wrong with exporting . I am using bas= h shell . <br> ><br> > Any suggestions , why its not exporting variables properly .<br> ><br> > P.s : mk didnot start yet .<br> ><br> > Regards<br> > Yudhistir<br> ><br> ><br> ><br> ><br> ><br> ><br> > On Thu, Mar 13, 2014 at 3:51 PM, yudhistir reddy <<a href=3D"mailto= :[email protected]">[email protected]</a>> wrote:<br> >><br> >> sample output..<br> >><br> >> src >pump env<br> >> __________Using distcc-pump from /shared_location/Linux/Ubuntu-12.= 04/x86_64/distcc/3.1/bin<br> >> __________Using 4 distcc servers in pump mode<br> >> LOGNAME=3D<br> >> _=3D/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump= <br> >> BLOCKSIZE=3DK<br> >> INCLUDE_SERVER_PORT=3D/tmp/distcc-pump.iA44t8/socket<br> >> OSTYPE=3Dlinux<br> >> SSH_CONNECTION=3D<ip address> 58236 <ip address> 22<br= > >> DISTCC_HOSTS=3Ds-server01/32,cpp,lzo s-server02/32,cpp,lzo s-serve= r03/32,cpp,lzo s-server04/32,cpp,lzo<br> >> HOSTTYPE=3Dx86_64-linux<br> >> EDITOR=3Dvi<br> >> __________Shutting down distcc-pump include server<br> >><br> >> It is diplaying the INCLUDE_SERVER_PORT and its creating the file = there in /tmp directory .<br> >><br> >> otherway:<br> >> eval 'pump --startup'<br> >> export INCLUDE_SERVER_PID=3D'13821'<br> >> export INCLUDE_SERVER_DIR=3D'/tmp/distcc-pump.ygmgYX'<br> >> export INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket&#= 39;<br> >><br> >><br> >><br> >><br> >> On Thu, Mar 13, 2014 at 2:48 PM, Vanush <<a href=3D"mailto:mish= [email protected]">[email protected]</a>> wrote:<br> >>><br> >>> On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrot= e:<br> >>> > Thank you. Is there any way i can display the list of env= ironment variables<br> >>> > it sets once pump script starts . mk is just the wrapper = to call make . We<br> >>> > are not doing anything in that . But still i will dig int= o it more (mk) .<br> >>> > distcc normal mode is working fine and i see 10% build ti= me reduction.<br> >>><br> >>> I would suspect that whichever way mk is started by the shell = it<br> >>> resets the environment. Can you show this "mk" scrip= t (or at least its<br> >>> first few lines)?<br> >>><br> >>> Withouth looking at pump itself: is it possible to do someting= like<br> >>> "pump env" (this should show the environment), and t= hen add an env<br> >>> invocation into "mk" script, just before calling mak= e, and compare<br> >>> outputs?<br> >>><br> >>> Misha.<br> >>><br> >>> > Is there any work around for this . I can export these va= riable for some<br> >>> > fixed port like 3632 for tcp . =C2=A0Pls let me know any = other variables i need<br> >>> > to set to make this pump mode work . Actually i am runnin= g out of time<br> >>> > because i need to show my colleagues and friends , how di= stcc is working<br> >>> > and improving build time . For the time being , i need so= me work around for<br> >>> > pump mode to work , then later i will debug more on this = .<br> >>> ><br> >>> > Any help on this much appreciated .<br> >>> ><br> >>> > Regards<br> >>> > Yudhistir<br> >>> > Any help on this much appreciated .<br> >>> ><br> >>> > Regards<br> >>> > Yudhistir<br> >>> ><br> >>> ><br> >>> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <<a = href=3D"mailto:[email protected]">[email protected]</a>> wrote:<br> >>> ><br> >>> > > The pump script will set that environment variable b= efore invoking "mk".<br> >>> > > But perhaps "mk" is resetting the environm= ent? Or something else between<br> >>> > > "mk" and "distcc" might be unset= ting it?<br> >>> > > On 11 Mar 2014 14:13, "yudhistir reddy" &l= t;<a href=3D"mailto:[email protected]">[email protected]</a= >> wrote:<br> >>> > ><br> >>> > >> Hi,<br> >>> > >><br> >>> > >> I am trying to build using distcc pump mode .<br= > >>> > >><br> >>> > >> I set DISTCC_HOSTS .<br> >>> > >><br> >>> > >> i am starting the pump mode with<br> >>> > >><br> >>> > >> pump mk jkernel-jobs WITH_DISTCC=3Dyes<br> >>> > >><br> >>> > >> I am getting below waring<br> >>> > >><br> >>> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not se= t - did you forget to run<br> >>> > >> under 'pump'?<br> >>> > >> distcc[3342] (dcc_build_somewhere) Warning: fail= ed to get includes from<br> >>> > >> include server, preprocessing locally<br> >>> > >><br> >>> > >><br> >>> > >> When we start pump mode , is distcc not setting = this variable ?<br> >>> > >><br> >>> > >><br> >>> > >><br> >>> > >> Regards<br> >>> > >> Yudhistir<br> >>> > >><br> >>> > >><br> >>> > >><br> >>> > >><br> >>> > >> __<br> >>> > >> distcc mailing list =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0<a href=3D"http://distcc.samba.org/">http://distcc.samba.org/<= /a><br> >>> > >> To unsubscribe or change options:<br> >>> > >> <a href=3D"https://lists.samba.org/mailman/listi= nfo/distcc">https://lists.samba.org/mailman/listinfo/distcc</a><br> >>> > >><br> >>> > ><br> >>><br> >>> > __<br> >>> > distcc mailing list =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0<a href=3D"http://distcc.samba.org/">http://distcc.samba.org/</a><br> >>> > To unsubscribe or change options:<br> >>> > <a href=3D"https://lists.samba.org/mailman/listinfo/distc= c">https://lists.samba.org/mailman/listinfo/distcc</a><br> >>><br> >>><br> >>> --<br> >>> Vanush "Misha" Paturyan<br> >>> Senior Technical Officer<br> >>> Room 1.37<br> >>> Computer Science Department<br> >>> NUI Maynooth<br> >>> __<br> >>> distcc mailing list =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0<= a href=3D"http://distcc.samba.org/">http://distcc.samba.org/</a><br> >>> To unsubscribe or change options:<br> >>> <a href=3D"https://lists.samba.org/mailman/listinfo/distcc">ht= tps://lists.samba.org/mailman/listinfo/distcc</a><br> >><br> >><br> ><br> </p> --089e013c7136b70e4304f47ae988-- --===============5259879297397034269== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline __ distcc mailing list http://distcc.samba.org/ To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/distcc --===============5259879297397034269==--