[SPDK] Re: EAL: set_mempolicy failed: Invalid argument

Andrey Kuzmin <andrey.v.kuzmin at gmail.com>
Newsgroups dev.linux.lists.spdk
Message-ID <CANvN+ekwyNUo6xaMhVRhT6UkCmLrpM-2c8jK-20dC1SAQ_O7XA@mail.gmail.com> 
On Wed, Feb 19, 2020, 00:11 Harris, James R <james.r.harris(a)intel.com>
wrote:

> Hi Andrey,
>
> I've never seen that issue on any of the Xeon platforms I've tested with.
> Not sure about Epyc though.
>
> I can't figure out where "set_mempolicy failed" gets printed by DPDK
> though.  I see where DPDK prints messages when set_mempolicy fails, but
> it's in a different format.


Hi Jim,

I have also spent some time scratching my head on this until I realized
that DPDK overrides numa_error with its own  logging, and that's exactly
where it gets printed.

As to the cause, it appears that the kernel is unhappy with the mode/nodes
combination DPDK tries to give it. The kernel is 3.10, BTW.

Do you by chance have any local edits in your DPDK submodule?
>

No, I'm running stock SPDK/DPDK.

Regards,
Andrey


> -Jim
>
>
> On 2/18/20, 8:28 AM, "Andrey Kuzmin" <andrey.v.kuzmin(a)gmail.com> wrote:
>
>     Hi guys,
>
>     I'm running 20.01 (default configuration) on a CentOS 7 Epyc-based
>     system, and getting a lot of subj warnings like in the below example.
>     Does that point to a system configuration issue that needs to be
>     fixed?
>
>     Thanks,
>     Andrey
>
>     Starting SPDK v20.01 git sha1 5ffffe9 / DPDK 19.11.0 initialization...
>     [ DPDK EAL parameters: hotplug --no-shconf -c 0x1
>     --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6
>     --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations
>     --file-prefix=spdk_pid109760 ]
>     EAL: No available hugepages reported in hugepages-1048576kB
>     EAL: VFIO support initialized
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Initializing NVMe Controllers
>     EAL: set_mempolicy failed: Invalid argument
>     EAL:   using IOMMU type 1 (Type 1)
>     EAL: set_mempolicy failed: Invalid argument
>     Attaching to 0000:45:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attaching to 0000:46:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attaching to 0000:4b:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attaching to 0000:4c:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attaching to 0000:4d:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attaching to 0000:4e:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attached to 0000:45:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attached to 0000:46:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attached to 0000:4b:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attached to 0000:4c:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attached to 0000:4d:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Attached to 0000:4e:00.0
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     EAL: set_mempolicy failed: Invalid argument
>     Initialization complete. Starting I/O...
>     _______________________________________________
>     SPDK mailing list -- spdk(a)lists.01.org
>     To unsubscribe send an email to spdk-leave(a)lists.01.org
>
>
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.