Re: Distcc pump mode
yudhistir reddy <[email protected]> Thu, 13 Mar 2014 17:23:14 +0530
| Newsgroups | gmane.comp.compilers.distcc |
|---|---|
| Message-ID | <CA+KcdAojN1trV9rHyMCTTBuJF4TtsoSsW6Gu3a8+VGBhR+6XKg@mail.gmail.com> |
--===============0062218889799712178== Content-Type: multipart/alternative; boundary=001a1134635a2b72d704f47b99db --001a1134635a2b72d704f47b99db Content-Type: text/plain; charset=ISO-8859-1 Sorry for that , that was silly mistake by me . Here is the use case , i did : 1. eval `pump --startup` checked pump mode variables , i can see INCLUDE_SERVER_PORT set to /tmp/distcc-pump.LIlIcs/socket 2. started build mk kernel -j30 WITH_DISTCC=yes Build finished with pump mode ( But actually it is turing back to Normal mode ) . I see the warning messages in distcclog as like below distcc[12968] Warning: INCLUDE_SERVER_PORT not set - did you forget to run under 'pump'? distcc[12968] (dcc_build_somewhere) Warning: failed to get includes from include server, preprocessing locally 3. build finished 4. checked this variable INCLUDE_SERVER_PORT which is set to /tmp/distcc-pump.LIlIcs/socket . So through out build , INCLUDE_SERVER_PORT variable is set to /tmp/distcc-pump.LIlIcs/socket . But i donot know how , pump mode is not working and throwing those errors . Regards Yudhistir On Thu, Mar 13, 2014 at 4:34 PM, Fergus Henderson <[email protected]> wrote: > > On 13 Mar 2014 10:54, "yudhistir reddy" <[email protected]> wrote: > > > > Hi, > > > > I followed this > > > > 1.started pump mode like > > > > eval 'pump --startup' > > That should use back quotes: > eval `pump --startup` > NOT > eval 'pump --startup' > > > export INCLUDE_SERVER_PID='13821' > > export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' > > export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' > > > > 2. didnot start mk command yet . > > I want to see the variable value > > > > echo $INCLUDE_SERVER_PORT . > > > > It is showing nothing . So all pump mode variables are not getting > exported properly . I think something is wrong with exporting . I am using > bash shell . > > > > Any suggestions , why its not exporting variables properly . > > > > P.s : mk didnot start yet . > > > > Regards > > Yudhistir > > > > > > > > > > > > > > On Thu, Mar 13, 2014 at 3:51 PM, yudhistir reddy < > [email protected]> wrote: > >> > >> sample output.. > >> > >> src >pump env > >> __________Using distcc-pump from > /shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin > >> __________Using 4 distcc servers in pump mode > >> LOGNAME= > >> _=/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump > >> BLOCKSIZE=K > >> INCLUDE_SERVER_PORT=/tmp/distcc-pump.iA44t8/socket > >> OSTYPE=linux > >> SSH_CONNECTION=<ip address> 58236 <ip address> 22 > >> DISTCC_HOSTS=s-server01/32,cpp,lzo s-server02/32,cpp,lzo > s-server03/32,cpp,lzo s-server04/32,cpp,lzo > >> HOSTTYPE=x86_64-linux > >> EDITOR=vi > >> __________Shutting down distcc-pump include server > >> > >> It is diplaying the INCLUDE_SERVER_PORT and its creating the file there > in /tmp directory . > >> > >> otherway: > >> eval 'pump --startup' > >> export INCLUDE_SERVER_PID='13821' > >> export INCLUDE_SERVER_DIR='/tmp/distcc-pump.ygmgYX' > >> export INCLUDE_SERVER_PORT='/tmp/distcc-pump.ygmgYX/socket' > >> > >> > >> > >> > >> On Thu, Mar 13, 2014 at 2:48 PM, Vanush <[email protected]> wrote: > >>> > >>> On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrote: > >>> > Thank you. Is there any way i can display the list of environment > variables > >>> > it sets once pump script starts . mk is just the wrapper to call > make . We > >>> > are not doing anything in that . But still i will dig into it more > (mk) . > >>> > distcc normal mode is working fine and i see 10% build time > reduction. > >>> > >>> I would suspect that whichever way mk is started by the shell it > >>> resets the environment. Can you show this "mk" script (or at least its > >>> first few lines)? > >>> > >>> Withouth looking at pump itself: is it possible to do someting like > >>> "pump env" (this should show the environment), and then add an env > >>> invocation into "mk" script, just before calling make, and compare > >>> outputs? > >>> > >>> Misha. > >>> > >>> > Is there any work around for this . I can export these variable for > some > >>> > fixed port like 3632 for tcp . Pls let me know any other variables > i need > >>> > to set to make this pump mode work . Actually i am running out of > time > >>> > because i need to show my colleagues and friends , how distcc is > working > >>> > and improving build time . For the time being , i need some work > around for > >>> > pump mode to work , then later i will debug more on this . > >>> > > >>> > Any help on this much appreciated . > >>> > > >>> > Regards > >>> > Yudhistir > >>> > Any help on this much appreciated . > >>> > > >>> > Regards > >>> > Yudhistir > >>> > > >>> > > >>> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <[email protected]> > wrote: > >>> > > >>> > > The pump script will set that environment variable before invoking > "mk". > >>> > > But perhaps "mk" is resetting the environment? Or something else > between > >>> > > "mk" and "distcc" might be unsetting it? > >>> > > On 11 Mar 2014 14:13, "yudhistir reddy" <[email protected]> > wrote: > >>> > > > >>> > >> Hi, > >>> > >> > >>> > >> I am trying to build using distcc pump mode . > >>> > >> > >>> > >> I set DISTCC_HOSTS . > >>> > >> > >>> > >> i am starting the pump mode with > >>> > >> > >>> > >> pump mk jkernel-jobs WITH_DISTCC=yes > >>> > >> > >>> > >> I am getting below waring > >>> > >> > >>> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not set - did you > forget to run > >>> > >> under 'pump'? > >>> > >> distcc[3342] (dcc_build_somewhere) Warning: failed to get > includes from > >>> > >> include server, preprocessing locally > >>> > >> > >>> > >> > >>> > >> When we start pump mode , is distcc not setting this variable ? > >>> > >> > >>> > >> > >>> > >> > >>> > >> Regards > >>> > >> Yudhistir > >>> > >> > >>> > >> > >>> > >> > >>> > >> > >>> > >> __ > >>> > >> distcc mailing list http://distcc.samba.org/ > >>> > >> To unsubscribe or change options: > >>> > >> https://lists.samba.org/mailman/listinfo/distcc > >>> > >> > >>> > > > >>> > >>> > __ > >>> > distcc mailing list http://distcc.samba.org/ > >>> > To unsubscribe or change options: > >>> > https://lists.samba.org/mailman/listinfo/distcc > >>> > >>> > >>> -- > >>> Vanush "Misha" Paturyan > >>> Senior Technical Officer > >>> Room 1.37 > >>> Computer Science Department > >>> NUI Maynooth > >>> __ > >>> distcc mailing list http://distcc.samba.org/ > >>> To unsubscribe or change options: > >>> https://lists.samba.org/mailman/listinfo/distcc > >> > >> > > > --001a1134635a2b72d704f47b99db Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>Sorry for that , that was silly mistake by me . <br><= br>Here is the use case , i did :<br><br>1. eval `pump --startup`<br></div>= checked pump mode variables , i can see INCLUDE_SERVER_PORT set to <br>/tmp= /distcc-pump.LIlIcs/socket<br> <div><br><br></div><div>2. started build <br></div><div>mk kernel -j30 WITH= _DISTCC=3Dyes<br></div><div>Build finished with pump mode=A0 ( But actually= it is turing back to Normal mode ) .<br></div><div>I see the warning messa= ges in distcclog as like below<br> <br>distcc[12968] Warning: INCLUDE_SERVER_PORT not set - did you forget to = run under 'pump'?<br>distcc[12968] (dcc_build_somewhere) Warning: f= ailed to get includes from include server, preprocessing locally<br><br> </div><div>3. build finished <br></div><div>4. checked this variable INCLUD= E_SERVER_PORT which is set to <br>/tmp/distcc-pump.LIlIcs/socket .<br><br><= br></div><div>So through out build , INCLUDE_SERVER_PORT variable is set to= /tmp/distcc-pump.LIlIcs/socket .=A0 <br> <br><br></div><div>But i donot know how , pump mode is not working and thro= wing those errors .<br><br><br></div><div>Regards<br></div><div>Yudhistir<b= r></div><div><br><br><br></div><div><br><br></div><div><br><br></div><div> =A0<br></div></div><div class=3D"gmail_extra"><br><br><div class=3D"gmail_q= uote">On Thu, Mar 13, 2014 at 4:34 PM, Fergus Henderson <span dir=3D"ltr">&= lt;<a href=3D"mailto:[email protected]" target=3D"_blank">[email protected]= </a>></span> wrote:<br> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p= x #ccc solid;padding-left:1ex"><p dir=3D"ltr"></p><div class=3D""><br> On 13 Mar 2014 10:54, "yudhistir reddy" <<a href=3D"mailto:yud= [email protected]" target=3D"_blank">[email protected]</a>>= wrote:<br> ><br> > Hi,<br> ><br></div><div class=3D""> > I followed this <br> ><br> > 1.started pump mode like<br> ><br> > eval 'pump --startup'</div><p></p> <p dir=3D"ltr">That should use back quotes:<br> eval `pump --startup`<br> NOT<br> eval 'pump --startup'</p><div class=3D"HOEnZb"><div class=3D"h5"> <p dir=3D"ltr">> export INCLUDE_SERVER_PID=3D'13821'<br> > export INCLUDE_SERVER_DIR=3D'/tmp/distcc-pump.ygmgYX'<br> > export INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket'<= br> ><br> > 2.=A0 didnot start mk command yet .<br> > I want to see the variable value<br> ><br> > echo $INCLUDE_SERVER_PORT .<br> ><br> > It is showing nothing . So all pump mode variables are not getting exp= orted properly . I think something is wrong with exporting . I am using bas= h shell . <br> ><br> > Any suggestions , why its not exporting variables properly .<br> ><br> > P.s : mk didnot start yet .<br> ><br> > Regards<br> > Yudhistir<br> ><br> ><br> ><br> ><br> ><br> ><br> > On Thu, Mar 13, 2014 at 3:51 PM, yudhistir reddy <<a href=3D"mailto= :[email protected]" target=3D"_blank">[email protected]</a>= > wrote:<br> >><br> >> sample output..<br> >><br> >> src >pump env<br> >> __________Using distcc-pump from /shared_location/Linux/Ubuntu-12.= 04/x86_64/distcc/3.1/bin<br> >> __________Using 4 distcc servers in pump mode<br> >> LOGNAME=3D<br> >> _=3D/shared_location/Linux/Ubuntu-12.04/x86_64/distcc/3.1/bin/pump= <br> >> BLOCKSIZE=3DK<br> >> INCLUDE_SERVER_PORT=3D/tmp/distcc-pump.iA44t8/socket<br> >> OSTYPE=3Dlinux<br> >> SSH_CONNECTION=3D<ip address> 58236 <ip address> 22<br= > >> DISTCC_HOSTS=3Ds-server01/32,cpp,lzo s-server02/32,cpp,lzo s-serve= r03/32,cpp,lzo s-server04/32,cpp,lzo<br> >> HOSTTYPE=3Dx86_64-linux<br> >> EDITOR=3Dvi<br> >> __________Shutting down distcc-pump include server<br> >><br> >> It is diplaying the INCLUDE_SERVER_PORT and its creating the file = there in /tmp directory .<br> >><br> >> otherway:<br> >> eval 'pump --startup'<br> >> export INCLUDE_SERVER_PID=3D'13821'<br> >> export INCLUDE_SERVER_DIR=3D'/tmp/distcc-pump.ygmgYX'<br> >> export INCLUDE_SERVER_PORT=3D'/tmp/distcc-pump.ygmgYX/socket&#= 39;<br> >><br> >><br> >><br> >><br> >> On Thu, Mar 13, 2014 at 2:48 PM, Vanush <<a href=3D"mailto:mish= [email protected]" target=3D"_blank">[email protected]</a>> wrote:<br> >>><br> >>> On Thu, Mar 13, 2014 at 12:10:24PM +0530, yudhistir reddy wrot= e:<br> >>> > Thank you. Is there any way i can display the list of env= ironment variables<br> >>> > it sets once pump script starts . mk is just the wrapper = to call make . We<br> >>> > are not doing anything in that . But still i will dig int= o it more (mk) .<br> >>> > distcc normal mode is working fine and i see 10% build ti= me reduction.<br> >>><br> >>> I would suspect that whichever way mk is started by the shell = it<br> >>> resets the environment. Can you show this "mk" scrip= t (or at least its<br> >>> first few lines)?<br> >>><br> >>> Withouth looking at pump itself: is it possible to do someting= like<br> >>> "pump env" (this should show the environment), and t= hen add an env<br> >>> invocation into "mk" script, just before calling mak= e, and compare<br> >>> outputs?<br> >>><br> >>> Misha.<br> >>><br> >>> > Is there any work around for this . I can export these va= riable for some<br> >>> > fixed port like 3632 for tcp . =A0Pls let me know any oth= er variables i need<br> >>> > to set to make this pump mode work . Actually i am runnin= g out of time<br> >>> > because i need to show my colleagues and friends , how di= stcc is working<br> >>> > and improving build time . For the time being , i need so= me work around for<br> >>> > pump mode to work , then later i will debug more on this = .<br> >>> ><br> >>> > Any help on this much appreciated .<br> >>> ><br> >>> > Regards<br> >>> > Yudhistir<br> >>> > Any help on this much appreciated .<br> >>> ><br> >>> > Regards<br> >>> > Yudhistir<br> >>> ><br> >>> ><br> >>> > On Thu, Mar 13, 2014 at 3:04 AM, Fergus Henderson <<a = href=3D"mailto:[email protected]" target=3D"_blank">[email protected]</a>&g= t; wrote:<br> >>> ><br> >>> > > The pump script will set that environment variable b= efore invoking "mk".<br> >>> > > But perhaps "mk" is resetting the environm= ent? Or something else between<br> >>> > > "mk" and "distcc" might be unset= ting it?<br> >>> > > On 11 Mar 2014 14:13, "yudhistir reddy" &l= t;<a href=3D"mailto:[email protected]" target=3D"_blank">yudhistir.= [email protected]</a>> wrote:<br> >>> > ><br> >>> > >> Hi,<br> >>> > >><br> >>> > >> I am trying to build using distcc pump mode .<br= > >>> > >><br> >>> > >> I set DISTCC_HOSTS .<br> >>> > >><br> >>> > >> i am starting the pump mode with<br> >>> > >><br> >>> > >> pump mk jkernel-jobs WITH_DISTCC=3Dyes<br> >>> > >><br> >>> > >> I am getting below waring<br> >>> > >><br> >>> > >> distcc[3342] Warning: INCLUDE_SERVER_PORT not se= t - did you forget to run<br> >>> > >> under 'pump'?<br> >>> > >> distcc[3342] (dcc_build_somewhere) Warning: fail= ed to get includes from<br> >>> > >> include server, preprocessing locally<br> >>> > >><br> >>> > >><br> >>> > >> When we start pump mode , is distcc not setting = this variable ?<br> >>> > >><br> >>> > >><br> >>> > >><br> >>> > >> Regards<br> >>> > >> Yudhistir<br> >>> > >><br> >>> > >><br> >>> > >><br> >>> > >><br> >>> > >> __<br> >>> > >> distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a hr= ef=3D"http://distcc.samba.org/" target=3D"_blank">http://distcc.samba.org/<= /a><br> >>> > >> To unsubscribe or change options:<br> >>> > >> <a href=3D"https://lists.samba.org/mailman/listi= nfo/distcc" target=3D"_blank">https://lists.samba.org/mailman/listinfo/dist= cc</a><br> >>> > >><br> >>> > ><br> >>><br> >>> > __<br> >>> > distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"htt= p://distcc.samba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> >>> > To unsubscribe or change options:<br> >>> > <a href=3D"https://lists.samba.org/mailman/listinfo/distc= c" target=3D"_blank">https://lists.samba.org/mailman/listinfo/distcc</a><br= > >>><br> >>><br> >>> --<br> >>> Vanush "Misha" Paturyan<br> >>> Senior Technical Officer<br> >>> Room 1.37<br> >>> Computer Science Department<br> >>> NUI Maynooth<br> >>> __<br> >>> distcc mailing list =A0 =A0 =A0 =A0 =A0 =A0<a href=3D"http://d= istcc.samba.org/" target=3D"_blank">http://distcc.samba.org/</a><br> >>> To unsubscribe or change options:<br> >>> <a href=3D"https://lists.samba.org/mailman/listinfo/distcc" ta= rget=3D"_blank">https://lists.samba.org/mailman/listinfo/distcc</a><br> >><br> >><br> ><br> </p> </div></div></blockquote></div><br></div> --001a1134635a2b72d704f47b99db-- --===============0062218889799712178== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline __ distcc mailing list http://distcc.samba.org/ To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/distcc --===============0062218889799712178==--