Bugs reported because of failing tests more likely to be reopened?

Rodrigo Rocha Gomes e Souza <[email protected]> Thu, 21 Nov 2013 21:54:48 -0200
Newsgroups gmane.comp.java.netbeans.general
Message-ID <CABve3ZyO9QkmRTwpWQ4LY6XCp5-qLY19hEMg87AHkKxRQP70Xg@mail.gmail.com>
--001a11c35300a5a6b204ebb8a0e1
Content-Type: text/plain; charset=ISO-8859-1

Hello again,

I was doing some statistical analyses with NetBeans Platform's bug reports
and concluded that...

... bugs related to failing, unfinishing or errors in the test (i.e., bugs
with keyword TEST) are 2.5x more likely to be reopened after being fixed.

Do you have any theories that explain this result?

The result was surprising for me, because I thought it would be the other
way around: bugs reported because of a failing test would be *less* likely
to be reopened because they should be easier to reproduce. After all, in
this case the developer himself can verify if the fix was appropriate just
by running the failing test. What do you think?

[]s
Rodrigo
Federal University of Bahia

--001a11c35300a5a6b204ebb8a0e1
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hello again,<div><br></div><div>I was doing some statistic=
al analyses with NetBeans Platform&#39;s bug reports and concluded that...<=
/div><div><br></div><div>... bugs related to failing, unfinishing or errors=
 in the test (i.e., bugs with keyword TEST) are 2.5x more likely to be reop=
ened after being fixed.</div>

<div><br></div><div>Do you have any theories that explain this result?</div=
><div><br></div><div>The result was surprising for me, because I thought it=
 would be the other way around: bugs reported because of a failing test wou=
ld be *less* likely to be reopened because they should be easier to reprodu=
ce. After all, in this case the developer himself can verify if the fix was=
 appropriate just by running the failing test. What do you think?</div>

<div><br></div><div>[]s</div><div>Rodrigo</div><div>Federal University of B=
ahia</div></div>

--001a11c35300a5a6b204ebb8a0e1--