Re: SCons very slow on GitHub actions
"Joseph C. Brill" <[email protected]> Thu, 1 May 2025 14:33:15 -0400
| Newsgroups | gmane.comp.programming.tools.scons.user |
|---|---|
| Message-ID | <[email protected]> |
This is a multipart message in MIME format.
--===============8517404693051800117==
Content-Type: multipart/alternative;
boundary="----=_NextPart_000_003F_01DBBAA5.FA0F52C0"
Content-Language: en-us
This is a multipart message in MIME format.
------=_NextPart_000_003F_01DBBAA5.FA0F52C0
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: 7bit
I'll take a look at the log posted shortly.
Are you running vcvars64.bat directly in the same environment that SCons is
being run at roughly the same time?
See my earlier post for the skeleton processing of the vcvars64.bat.
Vcvars64.bat directly calls about 16 child batch files which are
interrogating the windows registry, checking for directory and file
existence, calling vswhere, possibly calling powershell, using the "where"
command to search the system path for programs and libraries. It is "read"
intensive of the OS drive (assuming MSVC installed on the OS drive). SCons
itself also verifies that some of the files exist which is again
interrogating the OS drive file system for existence and execution.
Non-trivial file system latency is going to be problematic.
I will run a couple of experiments here with two physical boxes (amd64 and
an old arm64) and a couple of VMWare virtual machines. I expect the
physical amd64 to be the fastest, the VMWare vms to be the next fastest, and
the physical arm64 box to be significantly slower due to the limited
hardware and disk. At present, I' m not sure of the magnitude of the
differences.
Regards,
Joe
------=_NextPart_000_003F_01DBBAA5.FA0F52C0
Content-Type: text/html;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><META =
HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 15 =
(filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US =
link=3D"#467886" vlink=3D"#96607D" style=3D'word-wrap:break-word'><div =
class=3DWordSection1><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt'>I’ll take a look at the log posted =
shortly.<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt'><o:p> </o:p></span></p><p =
class=3DMsoNormal><span style=3D'font-size:11.0pt'>Are you running =
vcvars64.bat directly in the same environment that SCons is being run at =
roughly the same time?<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt'><o:p> </o:p></span></p><p =
class=3DMsoNormal><span style=3D'font-size:11.0pt'>See my earlier post =
for the skeleton processing of the vcvars64.bat.<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt'><o:p> </o:p></span></p><p =
class=3DMsoNormal><span style=3D'font-size:11.0pt'>Vcvars64.bat directly =
calls about 16 child batch files which are interrogating the windows =
registry, checking for directory and file existence, calling vswhere, =
possibly calling powershell, using the “where” command to =
search the system path for programs and libraries. It is =
“read” intensive of the OS drive (assuming MSVC installed on =
the OS drive). SCons itself also verifies that some of the files =
exist which is again interrogating the OS drive file system for =
existence and execution. Non-trivial file system latency is going =
to be problematic.<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt'><o:p> </o:p></span></p><p =
class=3DMsoNormal><span style=3D'font-size:11.0pt'>I will run a couple =
of experiments here with two physical boxes (amd64 and an old arm64) and =
a couple of VMWare virtual machines. I expect the physical amd64 =
to be the fastest, the VMWare vms to be the next fastest, and the =
physical arm64 box to be significantly slower due to the limited =
hardware and disk. At present, I’ m not sure of the =
magnitude of the differences.<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt'><o:p> </o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt'>Regards,<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt'>Joe<o:p></o:p></span></p></div></body></html>
------=_NextPart_000_003F_01DBBAA5.FA0F52C0--
--===============8517404693051800117==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline
_______________________________________________
Scons-users mailing list
[email protected]
https://pairlist4.pair.net/mailman/listinfo/scons-users
--===============8517404693051800117==--