Re: [TEST] google runner needs nested cases

On Tue, Aug 4, 2026 at 7:25 AM Jakub Kicinski <[email protected]> wrote:
>
> On Tue, 28 Jul 2026 10:07:15 -0700 Sheena Mohan wrote:
> > The recent updates have been merged, and the tests should now report
> > sub-case results.
> > Please let us know if any further improvements are needed.
>
> It doesn't look right.
>
> https://gve-netdev-nipa.static.usercontent.goog/json/results-202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a.json
>
> test    "napi-threaded-py"
> group   "selftests-drivers-net"
> result  "pass"
> ^^^^^^^^^^^^^
> link    "https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/napi-threaded-py/logs.html"
> time    20.788391
>
> # selftests: drivers/net: napi_threaded.py
> not ok 1 selftests: drivers/net: napi_threaded.py # exit=1
> # Totals: pass:0 fail:1 xfail:0 xpass:0 skip:0 error:0
> # not ok 1 napi_threaded.napi_init
> # not ok 2 napi_threaded.change_num_queues
> # not ok 3 napi_threaded.enable_dev_threaded_disable_napi_threaded
>
> Does not look like a pass at all. Subcases not in JSON.
> Not sure why the subcases are listed under the main return
> in the output, I've never seen that.
>
>
> test    "psp-py"
> group   "selftests-drivers-net"
> result  "pass"
> link    "https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/psp-py/logs.html"
> time    341.833939
>
> # selftests: drivers/net: psp.py
> not ok 1 selftests: drivers/net: psp.py # exit=1
> # Totals: pass:0 fail:1 xfail:0 xpass:0 skip:0 error:0
>
> Again, doesn't seem to be a pass??
>
>
> test    "queues-py"
> group   "selftests-drivers-net"
> result  "pass"
> link    "https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/queues-py/logs.html"
> time    686.483495
> results
>         test    "queues-check-xsk"
>         result  "pass"
>
> Okay, here we have a subcase..
>
> # selftests: drivers/net: queues.py
> ok 1 selftests: drivers/net: queues.py
> # Totals: pass:1 fail:0 xfail:0 xpass:0 skip:0 error:0
> check_down
> # ok 4 queues.check_xsk
> # # Totals: pass:4 fail:0 xfail:0 xpass:0 skip:0 error:0
>
> But why only one? What happened to the other 3 that ksft clearly saw
> since it enumerated check_xsk as the fourth??
>
>
> Something is mangling the output on your runner, it seems.
> And the parsing seems off.
Thanks for bringing this to our attention. We will look into the
parsing issues and work on getting this fixed.