Re: Bugs reported because of failing tests more likely to be reopened?

Jiri Skrivanek <[email protected]> Fri, 22 Nov 2013 09:44:15 +0100
Newsgroups gmane.comp.java.netbeans.general
Organization Oracle Corporation
Message-ID <[email protected]>
One possible reason can be that responsible developers fix failing test 
on their primary platform/JDK and when you run test on multiple 
operating systems and JDKs it fails again.

Jiri

On 22.11.2013 0:54, Rodrigo Rocha Gomes e Souza wrote:
> Hello again,
>
> I was doing some statistical analyses with NetBeans Platform's bug
> reports and concluded that...
>
> ... bugs related to failing, unfinishing or errors in the test (i.e.,
> bugs with keyword TEST) are 2.5x more likely to be reopened after being
> fixed.
>
> Do you have any theories that explain this result?
>
> The result was surprising for me, because I thought it would be the
> other way around: bugs reported because of a failing test would be
> *less* likely to be reopened because they should be easier to reproduce.
> After all, in this case the developer himself can verify if the fix was
> appropriate just by running the failing test. What do you think?
>
> []s
> Rodrigo
> Federal University of Bahia