Bug#1133156: RFS: avocado/113.0-1 [ITP] -- Set of tools and libraries to help with automated testing

Arif Ali <[email protected]> Fri, 17 Jul 2026 18:04:57 +0100
Newsgroups gmane.linux.debian.devel.mentors
Message-ID <CAJsN21DQmTDWZ2Em2O-QW7QbhhLgx=-+57Cmuwy43g6NpU-f9w__45115.4467811406$1784308055$gmane$org@mail.gmail.com>
--00000000000095913d0656d190ab
Content-Type: text/plain; charset="UTF-8"

Thanks for your review, your email somehow turned up in spam

I did run these tests before uploading, but more than happy to run them
again, and will report back

regards,
Arif

---
Arif Ali

IRC: arif-ali
Matrix: @arif-ali:ubuntu.com



On Wed, 15 Jul 2026 at 20:59, Simon Quigley <[email protected]> wrote:

> Control: tags -1 +moreinfo
>
> Hello,
>
> Thank you for your work on this package.
>
> I'm getting some test failures on build, can you reproduce this?
>
> RESULTS    : PASS 897 | ERROR 0 | FAIL 5 | SKIP 32 | WARN 0 | INTERRUPT 0
> | CANCEL 0
> JOB TIME   : 160.48 s
> Log file "debug.log" content for test
> "unit-129-selftests/unit/runner_package.py:ActionTests.test_success_remove"
> (FAIL):
> [stdout]
> ======================================================================
> [stdout] FAIL: test_success_remove
> (runner_package.ActionTests.test_success_remove)
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Traceback (most recent call last):
> [stdout]   File
> "/build/reproducible-path/avocado-113.0/selftests/unit/runner_package.py",
> line 133, in test_success_remove
> [stdout]     self.assertIn(stdout, messages[-3]["log"])
> [stdout]     ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> [stdout] AssertionError: b'Package(s) foo removed successfully' not found
> in b'Package foo not installed'
> [stdout]
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Ran 1 test in 0.576s
> [stdout]
> [stdout] FAILED (failures=1)
>
> Log file "debug.log" content for test
> "unit-127-selftests/unit/runner_package.py:ActionTests.test_already_installed"
> (FAIL):
> [stdout]
> ======================================================================
> [stdout] FAIL: test_already_installed
> (runner_package.ActionTests.test_already_installed)
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Traceback (most recent call last):
> [stdout]   File
> "/build/reproducible-path/avocado-113.0/selftests/unit/runner_package.py",
> line 93, in test_already_installed
> [stdout]     self.assertEqual(messages[-1]["result"], "pass")
> [stdout]     ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> [stdout] AssertionError: 'error' != 'pass'
> [stdout] - error
> [stdout] + pass
> [stdout]
> [stdout]
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Ran 1 test in 0.627s
> [stdout]
> [stdout] FAILED (failures=1)
>
> Log file "debug.log" content for test
> "unit-131-selftests/unit/runner_package.py:ActionTests.test_fail_remove"
> (FAIL):
> [stdout]
> ======================================================================
> [stdout] FAIL: test_fail_remove
> (runner_package.ActionTests.test_fail_remove)
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Traceback (most recent call last):
> [stdout]   File
> "/build/reproducible-path/avocado-113.0/selftests/unit/runner_package.py",
> line 168, in test_fail_remove
> [stdout]     self.assertEqual(messages[-1]["result"], "error")
> [stdout]     ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> [stdout] AssertionError: 'pass' != 'error'
> [stdout] - pass
> [stdout] + error
> [stdout]
> [stdout]
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Ran 1 test in 0.582s
> [stdout]
> [stdout] FAILED (failures=1)
>
> Log file "debug.log" content for test
> "unit-126-selftests/unit/runner_package.py:ActionTests.test_success_install"
> (FAIL):
> [stdout]
> ======================================================================
> [stdout] FAIL: test_success_install
> (runner_package.ActionTests.test_success_install)
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Traceback (most recent call last):
> [stdout]   File
> "/build/reproducible-path/avocado-113.0/selftests/unit/runner_package.py",
> line 75, in test_success_install
> [stdout]     self.assertEqual(messages[-1]["result"], "pass")
> [stdout]     ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> [stdout] AssertionError: 'error' != 'pass'
> [stdout] - error
> [stdout] + pass
> [stdout]
> [stdout]
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Ran 1 test in 1.183s
> [stdout]
> [stdout] FAILED (failures=1)
>
> Log file "debug.log" content for test
> "unit-132-selftests/unit/runner_package.py:ActionTests.test_success_check"
> (FAIL):
> [stdout]
> ======================================================================
> [stdout] FAIL: test_success_check
> (runner_package.ActionTests.test_success_check)
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Traceback (most recent call last):
> [stdout]   File
> "/build/reproducible-path/avocado-113.0/selftests/unit/runner_package.py",
> line 186, in test_success_check
> [stdout]     self.assertEqual(messages[-1]["result"], "pass")
> [stdout]     ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> [stdout] AssertionError: 'error' != 'pass'
> [stdout] - error
> [stdout] + pass
> [stdout]
> [stdout]
> [stdout]
> ----------------------------------------------------------------------
> [stdout] Ran 1 test in 0.605s
> [stdout]
> [stdout] FAILED (failures=1)
>
>
> Test summary:
> unit-126-selftests/unit/runner_package.py:ActionTests.test_success_install:
> FAIL
> unit-127-selftests/unit/runner_package.py:ActionTests.test_already_installed:
> FAIL
> unit-129-selftests/unit/runner_package.py:ActionTests.test_success_remove:
> FAIL
> unit-131-selftests/unit/runner_package.py:ActionTests.test_fail_remove:
> FAIL
> unit-132-selftests/unit/runner_package.py:ActionTests.test_success_check:
> FAIL
> make[1]: *** [debian/rules:13: override_dh_auto_test] Error 1
> make[1]: Leaving directory '/build/reproducible-path/avocado-113.0'
> make: *** [debian/rules:7: binary] Error 2
> dpkg-buildpackage: error: debian/rules binary subprocess failed with exit
> status 2
> ------------------------------
> Build finished at 2026-07-15T19:55:11Z
>
> Please remove the moreinfo tag once you're ready for another review. Feel
> free to CC me, if I'm available I can take another look.
>
> Best regards,
> Simon Quigley
> [email protected]
>

--00000000000095913d0656d190ab
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div>Thanks for your review, your email s=
omehow turned up in spam</div><div><br></div><div>I did run these tests bef=
ore uploading, but more than happy to run them again, and will report back<=
/div><div><br></div><div>regards,</div><div>Arif<div><br clear=3D"all"></di=
v><div><div dir=3D"ltr" class=3D"gmail_signature" data-smartmail=3D"gmail_s=
ignature"><div dir=3D"ltr">---<div>Arif Ali</div><div><br></div><div>IRC: a=
rif-ali</div><div>Matrix: @arif-ali:<a href=3D"http://ubuntu.com" target=3D=
"_blank">ubuntu.com</a></div></div></div></div><p></p></div></div><br></div=
><br><div class=3D"gmail_quote gmail_quote_container"><div dir=3D"ltr" clas=
s=3D"gmail_attr">On Wed, 15 Jul 2026 at 20:59, Simon Quigley &lt;<a href=3D=
"mailto:[email protected]">[email protected]</a>&gt; wrote:<br></div><blo=
ckquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left=
:1px solid rgb(204,204,204);padding-left:1ex"><u></u><div><div dir=3D"auto"=
>Control: tags -1 +moreinfo<br><br>Hello,<br><br>Thank you for your work on=
 this package.<br><br>I&#39;m getting some test failures on build, can you =
reproduce this?<br><br>RESULTS=C2=A0=C2=A0=C2=A0 : PASS 897 | ERROR 0 | FAI=
L 5 | SKIP 32 | WARN 0 | INTERRUPT 0 | CANCEL 0<br>JOB TIME=C2=A0=C2=A0 : 1=
60.48 s<br>Log file &quot;debug.log&quot; content for test &quot;unit-129-s=
elftests/unit/runner_package.py:ActionTests.test_success_remove&quot; (FAIL=
):<br>[stdout] =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
<br>[stdout] FAIL: test_success_remove (runner_package.ActionTests.test_suc=
cess_remove)<br>[stdout] --------------------------------------------------=
--------------------<br>[stdout] Traceback (most recent call last):<br>[std=
out]=C2=A0=C2=A0 File &quot;/build/reproducible-path/avocado-113.0/selftest=
s/unit/runner_package.py&quot;, line 133, in test_success_remove<br>[stdout=
]=C2=A0=C2=A0=C2=A0=C2=A0 self.assertIn(stdout, messages[-3][&quot;log&quot=
;])<br>[stdout]=C2=A0=C2=A0=C2=A0=C2=A0 ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^=
^^^^^^^<br>[stdout] AssertionError: b&#39;Package(s) foo removed successful=
ly&#39; not found in b&#39;Package foo not installed&#39;<br>[stdout] <br>[=
stdout] -------------------------------------------------------------------=
---<br>[stdout] Ran 1 test in 0.576s<br>[stdout] <br>[stdout] FAILED (failu=
res=3D1)<br><br>Log file &quot;debug.log&quot; content for test &quot;unit-=
127-selftests/unit/runner_package.py:ActionTests.test_already_installed&quo=
t; (FAIL):<br>[stdout] =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D<br>[stdout] FAIL: test_already_installed (runner_package.ActionTe=
sts.test_already_installed)<br>[stdout] -----------------------------------=
-----------------------------------<br>[stdout] Traceback (most recent call=
 last):<br>[stdout]=C2=A0=C2=A0 File &quot;/build/reproducible-path/avocado=
-113.0/selftests/unit/runner_package.py&quot;, line 93, in test_already_ins=
talled<br>[stdout]=C2=A0=C2=A0=C2=A0=C2=A0 self.assertEqual(messages[-1][&q=
uot;result&quot;], &quot;pass&quot;)<br>[stdout]=C2=A0=C2=A0=C2=A0=C2=A0 ~~=
~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<br>[stdout] AssertionError: =
&#39;error&#39; !=3D &#39;pass&#39;<br>[stdout] - error<br>[stdout] + pass<=
br>[stdout] <br>[stdout] <br>[stdout] -------------------------------------=
---------------------------------<br>[stdout] Ran 1 test in 0.627s<br>[stdo=
ut] <br>[stdout] FAILED (failures=3D1)<br><br>Log file &quot;debug.log&quot=
; content for test &quot;unit-131-selftests/unit/runner_package.py:ActionTe=
sts.test_fail_remove&quot; (FAIL):<br>[stdout] =3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>[stdout] FAIL: test_fail_remove (runne=
r_package.ActionTests.test_fail_remove)<br>[stdout] -----------------------=
-----------------------------------------------<br>[stdout] Traceback (most=
 recent call last):<br>[stdout]=C2=A0=C2=A0 File &quot;/build/reproducible-=
path/avocado-113.0/selftests/unit/runner_package.py&quot;, line 168, in tes=
t_fail_remove<br>[stdout]=C2=A0=C2=A0=C2=A0=C2=A0 self.assertEqual(messages=
[-1][&quot;result&quot;], &quot;error&quot;)<br>[stdout]=C2=A0=C2=A0=C2=A0=
=C2=A0 ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^<br>[stdout] Assert=
ionError: &#39;pass&#39; !=3D &#39;error&#39;<br>[stdout] - pass<br>[stdout=
] + error<br>[stdout] <br>[stdout] <br>[stdout] ---------------------------=
-------------------------------------------<br>[stdout] Ran 1 test in 0.582=
s<br>[stdout] <br>[stdout] FAILED (failures=3D1)<br><br>Log file &quot;debu=
g.log&quot; content for test &quot;unit-126-selftests/unit/runner_package.p=
y:ActionTests.test_success_install&quot; (FAIL):<br>[stdout] =3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>[stdout] FAIL: test_suc=
cess_install (runner_package.ActionTests.test_success_install)<br>[stdout] =
----------------------------------------------------------------------<br>[=
stdout] Traceback (most recent call last):<br>[stdout]=C2=A0=C2=A0 File &qu=
ot;/build/reproducible-path/avocado-113.0/selftests/unit/runner_package.py&=
quot;, line 75, in test_success_install<br>[stdout]=C2=A0=C2=A0=C2=A0=C2=A0=
 self.assertEqual(messages[-1][&quot;result&quot;], &quot;pass&quot;)<br>[s=
tdout]=C2=A0=C2=A0=C2=A0=C2=A0 ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^=
^^^^<br>[stdout] AssertionError: &#39;error&#39; !=3D &#39;pass&#39;<br>[st=
dout] - error<br>[stdout] + pass<br>[stdout] <br>[stdout] <br>[stdout] ----=
------------------------------------------------------------------<br>[stdo=
ut] Ran 1 test in 1.183s<br>[stdout] <br>[stdout] FAILED (failures=3D1)<br>=
<br>Log file &quot;debug.log&quot; content for test &quot;unit-132-selftest=
s/unit/runner_package.py:ActionTests.test_success_check&quot; (FAIL):<br>[s=
tdout] =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br>[s=
tdout] FAIL: test_success_check (runner_package.ActionTests.test_success_ch=
eck)<br>[stdout] ----------------------------------------------------------=
------------<br>[stdout] Traceback (most recent call last):<br>[stdout]=C2=
=A0=C2=A0 File &quot;/build/reproducible-path/avocado-113.0/selftests/unit/=
runner_package.py&quot;, line 186, in test_success_check<br>[stdout]=C2=A0=
=C2=A0=C2=A0=C2=A0 self.assertEqual(messages[-1][&quot;result&quot;], &quot=
;pass&quot;)<br>[stdout]=C2=A0=C2=A0=C2=A0=C2=A0 ~~~~~~~~~~~~~~~~^^^^^^^^^^=
^^^^^^^^^^^^^^^^^^^^^^<br>[stdout] AssertionError: &#39;error&#39; !=3D &#3=
9;pass&#39;<br>[stdout] - error<br>[stdout] + pass<br>[stdout] <br>[stdout]=
 <br>[stdout] -------------------------------------------------------------=
---------<br>[stdout] Ran 1 test in 0.605s<br>[stdout] <br>[stdout] FAILED =
(failures=3D1)<br><br><br>Test summary:<br>unit-126-selftests/unit/runner_p=
ackage.py:ActionTests.test_success_install: FAIL<br>unit-127-selftests/unit=
/runner_package.py:ActionTests.test_already_installed: FAIL<br>unit-129-sel=
ftests/unit/runner_package.py:ActionTests.test_success_remove: FAIL<br>unit=
-131-selftests/unit/runner_package.py:ActionTests.test_fail_remove: FAIL<br=
>unit-132-selftests/unit/runner_package.py:ActionTests.test_success_check: =
FAIL<br>make[1]: *** [debian/rules:13: override_dh_auto_test] Error 1<br>ma=
ke[1]: Leaving directory &#39;/build/reproducible-path/avocado-113.0&#39;<b=
r>make: *** [debian/rules:7: binary] Error 2<br>dpkg-buildpackage: error: d=
ebian/rules binary subprocess failed with exit status 2<hr>Build finished a=
t 2026-07-15T19:55:11Z<br><br>Please remove the moreinfo tag once you&#39;r=
e ready for another review. Feel free to CC me, if I&#39;m available I can =
take another look.<br><br>Best regards,<br>Simon Quigley<br><a href=3D"mail=
to:[email protected]" target=3D"_blank">[email protected]</a></div></di=
v></blockquote></div>

--00000000000095913d0656d190ab--