Re: [linux-next:master] [selftests] a3f88d89f6: kernel-selftests-bpf.net.test_bridge_neigh_suppress.sh.arping.fail

hi, Danielle,

On Thu, Jun 11, 2026 at 11:44:39AM +0000, Danielle Ratson wrote:
> Hi Oliver,
> 
> Thank you for the report.
> 
> The failures appear to be caused by an arping tool version mismatch.
> The test was written assuming iputils arping semantics, but not all distributions ship that version. Different arping implementations have incompatible behavior for the flags used throughout test_bridge_neigh_suppress.sh.
> 
> Looking at the added log, the 56 failures are not limited to the neigh_suppress_arp_probe section.
> The other arping-based test cases in the file are also affected, which is consistent with a tool version issue rather than a kernel regression.
> 
> To confirm the root cause on your end, please share the results for running the below:
> $ arping -V
> $ ./test_bridge_neigh_suppress.sh -t neigh_suppress_arp -v

sorry for late.

our tests run in a auto framework, I had to add some code to print above
information, but so far, it just generates below output.
before we try further, want to seek your advice if these information are
enough?

KERNEL SELFTESTS: linux_headers_dir is /usr/src/linux-headers-x86_64-rhel-9.4-bpf-a3f88d89f698743a8cd91fb43f997e2d292a168d
### arping -V
arping: option requires an argument -- 'V'
ARPing 2.25, by Thomas Habets <[email protected]>
usage: arping [ -0aAbdDeFpPqrRuUvzZ ] [ -w <sec> ] [ -W <sec> ] [ -S <host/ip> ]
              [ -T <host/ip ] [ -s <MAC> ] [ -t <MAC> ] [ -c <count> ]
              [ -C <count> ] [ -i <interface> ] [ -m <type> ] [ -g <group> ]
              [ -V <vlan> ] [ -Q <priority> ] <host/ip/MAC | -B>
For complete usage info, use --help or check the manpage.
### ./test_bridge_neigh_suppress.sh -t neigh_suppress_arp -v
                                                <-------- seems there is no output here
Per-port ARP suppression - VLAN 10              <-------- seems already start the tests
----------------------------------
COMMAND: tc -n sw1-U1mYwE qdisc replace dev vx0 clsact


> 
> Thanks,
> Danielle
> 
> > -----Original Message-----
> > From: kernel test robot <[email protected]>
> > Sent: Thursday, 11 June 2026 10:23
> > To: Danielle Ratson <[email protected]>
> > Cc: [email protected]; [email protected]; Jakub Kicinski <[email protected]>;
> > Nikolay Aleksandrov <[email protected]>; [email protected];
> > [email protected]
> > Subject: [linux-next:master] [selftests] a3f88d89f6: kernel-selftests-
> > bpf.net.test_bridge_neigh_suppress.sh.arping.fail
> > 
> > 
> > hi, Danielle Ratson,
> > 
> > for new added tests, we still found some failures in our tests, not sure if any
> > dependencies we missed? thanks
> > 
> > 
> > Hello,
> > 
> > kernel test robot noticed "kernel-selftests-
> > bpf.net.test_bridge_neigh_suppress.sh.arping.fail" on:
> > 
> > commit: a3f88d89f698743a8cd91fb43f997e2d292a168d ("selftests: net:
> > Add tests for ARP probe and DAD NS handling")
> > https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
> > 
> > in testcase: kernel-selftests-bpf
> > version:
> > with following parameters:
> > 
> > 	group: net
> > 
> > 
> > config: x86_64-rhel-9.4-bpf
> > compiler: gcc-14
> > test machine: 16 threads Intel(R) Core(TM) i7-13620H (Raptor Lake) with 32G
> > memory
> > 
> > (please refer to attached dmesg/kmsg for entire log/backtrace)
> > 
> > 
> > 
> > If you fix the issue in a separate patch/commit (i.e. not just a new version of
> > the same patch/commit), kindly add following tags
> > | Reported-by: kernel test robot <[email protected]>
> > | Closes:
> > | https://lore.kernel.org/oe-lkp/[email protected]
> > 
> > 
> > # timeout set to 3600
> > # selftests: net: test_bridge_neigh_suppress.sh #
> > 
> > [...]
> > 
> > #
> > # Per-port ARP probe suppression
> > # ------------------------------
> > # TEST: ARP probe suppression                                         [FAIL]
> > # TEST: "neigh_suppress" is on                                        [ OK ]
> > # TEST: ARP probe suppression                                         [FAIL]
> > # TEST: FDB and neighbor entry installation                           [ OK ]
> > # TEST: arping                                                        [FAIL]
> > # TEST: ARP probe suppression                                         [FAIL]
> > # TEST: neighbor removal                                              [ OK ]
> > # TEST: ARP probe suppression                                         [FAIL]
> > # TEST: "neigh_suppress" is off                                       [ OK ]
> > # TEST: ARP probe suppression                                         [FAIL]
> > #
> > # Per-port DAD NS suppression
> > # ---------------------------
> > # TEST: DAD NS suppression                                            [ OK ]
> > # TEST: "neigh_suppress" is on                                        [ OK ]
> > # TEST: DAD NS suppression                                            [ OK ]
> > # TEST: FDB and neighbor entry installation                           [ OK ]
> > # TEST: DAD NS suppression                                            [ OK ]
> > # TEST: DAD NS proxy NA reply                                         [ OK ]
> > # TEST: neighbor removal                                              [ OK ]
> > # TEST: DAD NS suppression                                            [ OK ]
> > # TEST: "neigh_suppress" is off                                       [ OK ]
> > # TEST: DAD NS suppression                                            [ OK ]
> > #
> > # Tests passed: 124
> > # Tests failed:  56
> > not ok 110 selftests: net: test_bridge_neigh_suppress.sh # exit=1
> > 
> > 
> > 
> > The kernel config and materials to reproduce are available at:
> > https://download.01.org/0day-
> > ci/archive/20260611/[email protected]
> > 
> > 
> > 
> > --
> > 0-DAY CI Kernel Test Service
> > https://github.com/intel/lkp-tests/wiki
>