Re: linking and running tests in parallel

RenĂ© Ferdinand Rivera Morell via Boost-build <[email protected]> Fri, 28 Aug 2020 22:08:20 -0500
Newsgroups gmane.comp.lib.boost.build
Message-ID <CAHEh_GjDFR-iq8AFLPTbjdM-LSuk7zEvB9t12W8DVmiPcFUxWA@mail.gmail.com>
--===============5750295486816392105==
Content-Type: multipart/alternative; boundary="000000000000f658a605adfb7b65"

--000000000000f658a605adfb7b65
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Fri, Aug 28, 2020 at 10:23 AM Ren=C3=A9 Ferdinand Rivera Morell <
[email protected]> wrote:

> On Fri, Aug 28, 2020 at 9:52 AM John Maddock via Boost-build <
> [email protected]> wrote:
>
>>
>> On 28/08/2020 11:46, Arvid Norberg via Boost-build wrote:
>> > On Sat, Mar 30, 2019 at 4:45 PM Steven Watanabe via Boost-build
>> > <[email protected] <mailto:[email protected]>>
>> wrote:
>> >
>> >     On 3/29/19 2:57 AM, Arvid Norberg via Boost-build wrote:
>> >     > <snip>
>> >     > In the gcc toolset, there's mentioning of JAM_SEMAPHORE, in the
>> >     link rules.
>> >     > I don't fully understand how this affect the linking, but I
>> >     suspect it
>> >     > means only one target can be linked at a time.
>> >     >
>> >     >
>> >
>> https://github.com/boostorg/build/blob/develop/src/tools/gcc.jam#L1064
>> >     <
>> https://github.com/boostorg/build/blob/develop/src/tools/gcc.jam#L1064>
>> >     > [...]
>> >
>> >     This is a very old optimization which is almost
>> >     certainly out-dated.  If no one objects, I'm
>> >     just going to remove it.
>> >
>> >
>>
>> Yes please!!!
>>
>> I've complained about this before, it's a huge bottleneck building for
>> MIngw - basically the obj files get built first, and then it sits doing
>> pretty much nothing linking one test at a time :(
>>
>
> Is there an issue or PR for this? I'll fix it regardless :-) Just
> wondering if I missed something.
>

Anyway... Here it is <
https://github.com/boostorg/build/commit/54f811b7593dc751ec1b306cad27f32cfc=
e81f36
>.


--=20
-- Ren=C3=A9 Ferdinand Rivera Morell
-- Don't Assume Anything  -- No Supone Nada
-- Robot Dreams - http://robot-dreams.net

--000000000000f658a605adfb7b65
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr">On Fri, Aug 28, 2020 at 10:23 AM Ren=C3=
=A9 Ferdinand Rivera Morell &lt;<a href=3D"mailto:[email protected]">gr=
[email protected]</a>&gt; wrote:<br></div><div class=3D"gmail_quote"><blo=
ckquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left=
:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div dir=3D"=
ltr">On Fri, Aug 28, 2020 at 9:52 AM John Maddock via Boost-build &lt;<a hr=
ef=3D"mailto:[email protected]" target=3D"_blank">boost-build@lis=
ts.boost.org</a>&gt; wrote:<br></div><div class=3D"gmail_quote"><blockquote=
 class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px so=
lid rgb(204,204,204);padding-left:1ex"><br>
On 28/08/2020 11:46, Arvid Norberg via Boost-build wrote:<br>
&gt; On Sat, Mar 30, 2019 at 4:45 PM Steven Watanabe via Boost-build <br>
&gt; &lt;<a href=3D"mailto:[email protected]" target=3D"_blank">b=
[email protected]</a> &lt;mailto:<a href=3D"mailto:boost-build@lis=
ts.boost.org" target=3D"_blank">[email protected]</a>&gt;&gt; wro=
te:<br>
&gt;<br>
&gt;=C2=A0 =C2=A0 =C2=A0On 3/29/19 2:57 AM, Arvid Norberg via Boost-build w=
rote:<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt; &lt;snip&gt;<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt; In the gcc toolset, there&#39;s mentioning of =
JAM_SEMAPHORE, in the<br>
&gt;=C2=A0 =C2=A0 =C2=A0link rules.<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt; I don&#39;t fully understand how this affect t=
he linking, but I<br>
&gt;=C2=A0 =C2=A0 =C2=A0suspect it<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt; means only one target can be linked at a time.=
<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt;<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt;<br>
&gt;=C2=A0 =C2=A0 =C2=A0<a href=3D"https://github.com/boostorg/build/blob/d=
evelop/src/tools/gcc.jam#L1064" rel=3D"noreferrer" target=3D"_blank">https:=
//github.com/boostorg/build/blob/develop/src/tools/gcc.jam#L1064</a><br>
&gt;=C2=A0 =C2=A0 =C2=A0&lt;<a href=3D"https://github.com/boostorg/build/bl=
ob/develop/src/tools/gcc.jam#L1064" rel=3D"noreferrer" target=3D"_blank">ht=
tps://github.com/boostorg/build/blob/develop/src/tools/gcc.jam#L1064</a>&gt=
;<br>
&gt;=C2=A0 =C2=A0 =C2=A0&gt; [...]<br>
&gt;<br>
&gt;=C2=A0 =C2=A0 =C2=A0This is a very old optimization which is almost<br>
&gt;=C2=A0 =C2=A0 =C2=A0certainly out-dated.=C2=A0 If no one objects, I&#39=
;m<br>
&gt;=C2=A0 =C2=A0 =C2=A0just going to remove it.<br>
&gt;<br>
&gt;<br>
<br>
Yes please!!!<br>
<br>
I&#39;ve complained about this before, it&#39;s a huge bottleneck building =
for <br>
MIngw - basically the obj files get built first, and then it sits doing <br=
>
pretty much nothing linking one test at a time :(<br></blockquote><div><br>=
</div><div>Is there an issue or PR for this? I&#39;ll fix it regardless :-)=
 Just wondering if I missed something.<br clear=3D"all"></div></div></div><=
/blockquote><div><br></div><div>Anyway... Here it is &lt;<a href=3D"https:/=
/github.com/boostorg/build/commit/54f811b7593dc751ec1b306cad27f32cfce81f36"=
>https://github.com/boostorg/build/commit/54f811b7593dc751ec1b306cad27f32cf=
ce81f36</a>&gt;.</div><div><br clear=3D"all"></div></div><br>-- <br><div di=
r=3D"ltr" class=3D"gmail_signature"><div dir=3D"ltr"><div><div dir=3D"ltr">=
-- Ren=C3=A9 Ferdinand Rivera Morell<br>-- Don&#39;t Assume Anything=C2=A0 =
-- No Supone Nada<br>-- Robot Dreams -=C2=A0<a href=3D"http://robot-dreams.=
net/" target=3D"_blank">http://robot-dreams.net</a><br><br></div></div></di=
v></div></div>

--000000000000f658a605adfb7b65--

--===============5750295486816392105==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Unsubscribe & other changes: https://lists.boost.org/mailman/listinfo.cgi/boost-build

--===============5750295486816392105==--