Re: SCons very slow on GitHub actions

Leonard de Ruijter <[email protected]> Fri, 2 May 2025 15:51:14 +0200
Newsgroups gmane.comp.programming.tools.scons.user
Message-ID <[email protected]> 
This is a multi-part message in MIME format.
--===============8374186610861050303==
Content-Type: multipart/alternative;
 boundary="------------V8a7TPPxkIRGwPzw5uBs2fzF"
Content-Language: nl, en-US

This is a multi-part message in MIME format.
--------------V8a7TPPxkIRGwPzw5uBs2fzF
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

I have just updated the pull request against scons_examples to implement 
caching:

https://github.com/SCons/scons-examples/pull/7

I'm not sure why the action doesn't run on the pr, but a run on my fork 
seems promising, see 
https://github.com/LeonarddeR/scons-examples/actions/runs/14796395909


On 5/1/2025 8:33 PM, Joseph C. Brill wrote:
>
> I’ll take a look at the log posted shortly.
>
> Are you running vcvars64.bat directly in the same environment that 
> SCons is being run at roughly the same time?
>
> See my earlier post for the skeleton processing of the vcvars64.bat.
>
> Vcvars64.bat directly calls about 16 child batch files which are 
> interrogating the windows registry, checking for directory and file 
> existence, calling vswhere, possibly calling powershell, using the 
> “where” command to search the system path for programs and libraries.  
> It is “read” intensive of the OS drive (assuming MSVC installed on the 
> OS drive). SCons itself also verifies that some of the files exist 
> which is again interrogating the OS drive file system for existence 
> and execution.  Non-trivial file system latency is going to be 
> problematic.
>
> I will run a couple of experiments here with two physical boxes (amd64 
> and an old arm64) and a couple of VMWare virtual machines. I expect 
> the physical amd64 to be the fastest, the VMWare vms to be the next 
> fastest, and the physical arm64 box to be significantly slower due to 
> the limited hardware and disk. At present, I’ m not sure of the 
> magnitude of the differences.
>
> Regards,
>
> Joe
>
>
> _______________________________________________
> Scons-users mailing list
> [email protected]
> https://pairlist4.pair.net/mailman/listinfo/scons-users
--------------V8a7TPPxkIRGwPzw5uBs2fzF
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>I have just updated the pull request against scons_examples to
      implement caching:</p>
    <p><a class="moz-txt-link-freetext" href="https://github.com/SCons/scons-examples/pull/7">https://github.com/SCons/scons-examples/pull/7</a></p>
    <p>I'm not sure why the action doesn't run on the pr, but a run on
      my fork seems promising, see
      <a class="moz-txt-link-freetext" href="https://github.com/LeonarddeR/scons-examples/actions/runs/14796395909">https://github.com/LeonarddeR/scons-examples/actions/runs/14796395909</a></p>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 5/1/2025 8:33 PM, Joseph C. Brill
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:[email protected]">
      <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
      <meta name="Generator"
        content="Microsoft Word 15 (filtered medium)">
      <style>@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
	{font-family:Aptos;}p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	font-size:12.0pt;
	font-family:"Aptos",sans-serif;
	mso-ligatures:standardcontextual;}span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Aptos",sans-serif;
	color:windowtext;}.MsoChpDefault
	{mso-style-type:export-only;}div.WordSection1
	{page:WordSection1;}</style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
      <div class="WordSection1">
        <p class="MsoNormal"><span style="font-size:11.0pt">I’ll take a
            look at the log posted shortly.<o:p></o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt">Are you
            running vcvars64.bat directly in the same environment that
            SCons is being run at roughly the same time?<o:p></o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt">See my
            earlier post for the skeleton processing of the
            vcvars64.bat.<o:p></o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt">Vcvars64.bat
            directly calls about 16 child batch files which are
            interrogating the windows registry, checking for directory
            and file existence, calling vswhere, possibly calling
            powershell, using the “where” command to search the system
            path for programs and libraries.  It is “read” intensive of
            the OS drive (assuming MSVC installed on the OS drive). 
            SCons itself also verifies that some of the files exist
            which is again interrogating the OS drive file system for
            existence and execution.  Non-trivial file system latency is
            going to be problematic.<o:p></o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt">I will run a
            couple of experiments here with two physical boxes (amd64
            and an old arm64) and a couple of VMWare virtual machines. 
            I expect the physical amd64 to be the fastest, the VMWare
            vms to be the next fastest, and the physical arm64 box to be
            significantly slower due to the limited hardware and disk. 
            At present, I’ m not sure of the magnitude of the
            differences.<o:p></o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt">Regards,<o:p></o:p></span></p>
        <p class="MsoNormal"><span style="font-size:11.0pt">Joe<o:p></o:p></span></p>
      </div>
      <br>
      <fieldset class="moz-mime-attachment-header"></fieldset>
      <pre wrap="" class="moz-quote-pre">_______________________________________________
Scons-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a>
<a class="moz-txt-link-freetext" href="https://pairlist4.pair.net/mailman/listinfo/scons-users">https://pairlist4.pair.net/mailman/listinfo/scons-users</a>
</pre>
    </blockquote>
  </body>
</html>

--------------V8a7TPPxkIRGwPzw5uBs2fzF--

--===============8374186610861050303==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Scons-users mailing list
[email protected]
https://pairlist4.pair.net/mailman/listinfo/scons-users

--===============8374186610861050303==--