Re: Bugs reported because of failing tests more likely to be reopened?

+1

Best regards,
-Jirka

On 22.11.2013 09:44, Jiri Skrivanek wrote:

> One possible reason can be that responsible developers fix failing test
> on their primary platform/JDK and when you run test on multiple
> operating systems and JDKs it fails again.
>
> Jiri
>
> On 22.11.2013 0:54, Rodrigo Rocha Gomes e Souza wrote:
>> Hello again,
>>
>> I was doing some statistical analyses with NetBeans Platform's bug
>> reports and concluded that...
>>
>> ... bugs related to failing, unfinishing or errors in the test (i.e.,
>> bugs with keyword TEST) are 2.5x more likely to be reopened after being
>> fixed.
>>
>> Do you have any theories that explain this result?
>>
>> The result was surprising for me, because I thought it would be the
>> other way around: bugs reported because of a failing test would be
>> *less* likely to be reopened because they should be easier to reproduce.
>> After all, in this case the developer himself can verify if the fix was
>> appropriate just by running the failing test. What do you think?
>>
>> []s
>> Rodrigo
>> Federal University of Bahia