Re: gdb builder status (Was: Adding binutils to the GNU Toolchain buildbot on sourceware)

Hi gdb hackers,

On Fri, 2022-04-29 at 22:04 +0200, Mark Wielaard wrote:
> https://builder.sourceware.org now has 6 build only builders.
> centos-x86_64, fedora-x86_64, debian-armhf, debian-arm64, fedora-s390x and debian-ppc64.
> I like to add a fedora-ppc64le one once that one has enough disk space.
> 
> These builders are fairly quick, a few minutes at most. And all except
> the fedora-s390x one build fine. They should sent email once a new
> failure occurs.
> [...]
> There is also one build and check everything builder
> https://builder.sourceware.org/buildbot/#/builders/binutils-gdb-fedrawhide-x86_64
> I haven't looked at the test results yet, but they are all stored in
> the bunsendb.git for later analysis. This builder doesn't sent emails
> on bad builds.
> 
> One issue with the build-check-everything builder might be the widely
> varying build times which range from 1 to 7 hours.

There are now 7 "quick" CI builders:
https://builder.sourceware.org/buildbot/#/builders?tags=gdb
gdb-fedora-ppc64le has been added, which failed to compile at first,
but that has been fixed now. Also it does a very minimal make gdb-check 
now:

# Only a small subset of tests that are fast and known to PASS.
gdb_factory.addStep(steps.Test(
        workdir='gdb-build',
        command=['make',
                 util.Interpolate('-j%(prop:ncpus)s'),
                 'check-gdb',
                 ("TESTS= "
                  "gdb.gdb/selftest.exp "
                  "gdb.gdb/unittest.exp "
                  "gdb.server/unittest.exp ")],
        name='make check-gdb',
        logfiles={ "gdb.sum": "gdb/testsuite/gdb.sum",
                   "gdb.log": "gdb/testsuite/gdb.log" },
        haltOnFailure=True))

There was some skepticism on irc that this could ever be expanded to a
set of tests that was really useful. But I am keeping some hope. And
even the compile only part already caught bad commits, so I do think it
is useful. My goal is to turn these builders into try-builders at some
point so people can submit patches and see they at least pass a compile
and test for a reasonable (fast) subset without having to go through
known failing or flaky testcases.

Also Frank seems to have gotten a handle on the widely varying full
tests builds. They seem to take about ~1 hour each now. And he added a
full "clang" builder so you can more easily compare test results with
an alternative compiler:
https://builder.sourceware.org/buildbot/#/builders/binutils-gdb-fedrawhide-x86_64
https://builder.sourceware.org/buildbot/#/builders/binutils-gdb-clang-fedrawhide-x86_64

The sum and log files are put into the bunsendb.git repository. Only
the stdio output is available in the builder itself for now.

Cheers,

Mark