Re: [TEST] google runner needs nested cases

Jakub Kicinski <[email protected]> Tue, 4 Aug 2026 07:25:22 -0700
Newsgroups gmane.linux.network
Message-ID <[email protected]>
On Tue, 28 Jul 2026 10:07:15 -0700 Sheena Mohan wrote:
> The recent updates have been merged, and the tests should now report
> sub-case results.
> Please let us know if any further improvements are needed.

It doesn't look right.

https://gve-netdev-nipa.static.usercontent.goog/json/results-202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a.json

test	"napi-threaded-py"
group	"selftests-drivers-net"
result	"pass"
^^^^^^^^^^^^^
link	"https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/napi-threaded-py/logs.html"
time	20.788391

# selftests: drivers/net: napi_threaded.py
not ok 1 selftests: drivers/net: napi_threaded.py # exit=1
# Totals: pass:0 fail:1 xfail:0 xpass:0 skip:0 error:0
# not ok 1 napi_threaded.napi_init
# not ok 2 napi_threaded.change_num_queues
# not ok 3 napi_threaded.enable_dev_threaded_disable_napi_threaded

Does not look like a pass at all. Subcases not in JSON.
Not sure why the subcases are listed under the main return 
in the output, I've never seen that.


test	"psp-py"
group	"selftests-drivers-net"
result	"pass"
link	"https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/psp-py/logs.html"
time	341.833939

# selftests: drivers/net: psp.py
not ok 1 selftests: drivers/net: psp.py # exit=1
# Totals: pass:0 fail:1 xfail:0 xpass:0 skip:0 error:0

Again, doesn't seem to be a pass??


test	"queues-py"
group	"selftests-drivers-net"
result	"pass"
link	"https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/queues-py/logs.html"
time	686.483495
results	
	test	"queues-check-xsk"
	result	"pass"

Okay, here we have a subcase..

# selftests: drivers/net: queues.py
ok 1 selftests: drivers/net: queues.py
# Totals: pass:1 fail:0 xfail:0 xpass:0 skip:0 error:0
check_down
# ok 4 queues.check_xsk
# # Totals: pass:4 fail:0 xfail:0 xpass:0 skip:0 error:0

But why only one? What happened to the other 3 that ksft clearly saw
since it enumerated check_xsk as the fourth??


Something is mangling the output on your runner, it seems.
And the parsing seems off.