Re: Not able to make full use of CPUs for processing speed

Bill Deegan <[email protected]>
Newsgroups gmane.comp.programming.tools.scons.user
Message-ID <CAEyG4CEd7abAOd7jd1S1K7S5-GUbsGkTVaCWo8EEH_RZyWgU8g@mail.gmail.com>
Markus,

Any chance you'd contribute such via a PR?

-Bill
SCons Project Co-Manager

On Mon, Sep 27, 2021 at 8:57 AM Markus B. Schenkel <[email protected]>
wrote:

> Hi Don,
>
> A colleague of mine (Edo) has implemented the debug option
> --action_timestamps with 3.1.2.
> It prints time-stamps for each build step and we post-processed this (with
> some proprietary scripts) to analyze parallelism issues.
> Maybe that helps...
>
> Regards,
> Markus
>
>
> Mats Wichmann <[email protected]> schrieb am Do., 16. Sept. 2021, 21:51:
>
>>
>> On 9/16/21 10:08, Bill Deegan wrote:
>> > you can also use the --taskmastertrace=FILE scons option and look at
>> the
>> > output file, that may give you hints why you're not getting the
>> > parallelism you suspect, though that's a deeper dive.
>>
>>
>> I guess a question to answer is if there's enough parallelism available
>> in your setup that a larger jobs pool helps.  If there rarely are
>> situations when more than five builds are ready to run at once,
>> increasing the jobs pool way beyond five is unlikely to help much.  Not
>> sure there's a really good way to get SCons to tell you that... a lot of
>> the information is in the taskmaster trace, sure, but my experience is
>> using it is kind of like trying to drink from a firehose most times.
>>
>> There should probably be some kind of sampling profile setup to help
>> figure out if things aren't being kept busy just because there's not
>> unblocked work available, or if SCons is blowing too much time
>> calculating things... it's my impression (don't shoot me, Bill!) that
>> the performance characterizations that were made of SCons and its
>> taskmaster/jobs setup were done on computing technologies several
>> generations removed from today's and could stand a revisit.
>> _______________________________________________
>> Scons-users mailing list
>> [email protected]
>> https://pairlist4.pair.net/mailman/listinfo/scons-users
>>
> _______________________________________________
> Scons-users mailing list
> [email protected]
> https://pairlist4.pair.net/mailman/listinfo/scons-users
>

_______________________________________________
Scons-users mailing list
[email protected]
https://pairlist4.pair.net/mailman/listinfo/scons-users
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.