Re: Bugs reported because of failing tests more likely to be reopened?
Jiri Skrivanek <[email protected]> Fri, 22 Nov 2013 09:44:15 +0100
| Newsgroups | gmane.comp.java.netbeans.general |
|---|---|
| Organization | Oracle Corporation |
| Message-ID | <[email protected]> |
One possible reason can be that responsible developers fix failing test on their primary platform/JDK and when you run test on multiple operating systems and JDKs it fails again. Jiri On 22.11.2013 0:54, Rodrigo Rocha Gomes e Souza wrote: > Hello again, > > I was doing some statistical analyses with NetBeans Platform's bug > reports and concluded that... > > ... bugs related to failing, unfinishing or errors in the test (i.e., > bugs with keyword TEST) are 2.5x more likely to be reopened after being > fixed. > > Do you have any theories that explain this result? > > The result was surprising for me, because I thought it would be the > other way around: bugs reported because of a failing test would be > *less* likely to be reopened because they should be easier to reproduce. > After all, in this case the developer himself can verify if the fix was > appropriate just by running the failing test. What do you think? > > []s > Rodrigo > Federal University of Bahia