Re: Adding binutils to the GNU Toolchain buildbot on sourceware

Hi -

> I agree with the quick build idea. That's why I suggested only making sure
> gdb/gdbserver/sim builds properly. That's reasonably reliable.

OK, so looking for build-breaking regressions.

> Unfortunately gdb's testsuite is not too reliable. It's been improved over
> the years, but still gives quite a bit of non-deterministic results based on
> distro version/compiler version etc. So I'd leave those out in favor of just
> making sure things build properly.

This problem is why we're building out a gadget called bunsen, which
is a tool to absorb histories of testsuites, and draw statistical
conclusions.  Still early days, but noisy testsuites are not a
problem.

> > If the is a make check-something that can be executed quickly, < 5
> > minutes runtime, and that should always be green please include
> > it. But please exclude anything that takes too long, isn't known
> > all-green or contains flaky tests.
> 
> Some tests should always work, no matter what. We could hand-pick some tests
> from the GDB testsuite that we consider critical. [...]

Bunsen should help -identify- such tests.

- FChE