[SPDK] Re: EAL: set_mempolicy failed: Invalid argument

Andrey Kuzmin <andrey.v.kuzmin at gmail.com>
Newsgroups dev.linux.lists.spdk
Message-ID <CANvN+e=k==Pnz6aYHc72SY-NYZthnaMSzE5be8A=WsJwq9hYRw@mail.gmail.com> 
Just FYI, turned out to be a memory configuration issue where we ended up
with memoryless numa nodes. Not that eal messages were very helpful in
resolving the issue, though.

Regards,
Andrey

On Wed, Feb 19, 2020, 00:27 Harris, James R <james.r.harris(a)intel.com>
wrote:

>
>
> On 2/18/20, 1:19 PM, "Andrey Kuzmin" <andrey.v.kuzmin(a)gmail.com> wrote:
>
>     On Wed, Feb 19, 2020, 00:11 Harris, James R <james.r.harris(a)intel.com>
>     wrote:
>
>     > Hi Andrey,
>     >
>     > I've never seen that issue on any of the Xeon platforms I've tested
> with.
>     > Not sure about Epyc though.
>     >
>     > I can't figure out where "set_mempolicy failed" gets printed by DPDK
>     > though.  I see where DPDK prints messages when set_mempolicy fails,
> but
>     > it's in a different format.
>
>
>     Hi Jim,
>
>     I have also spent some time scratching my head on this until I realized
>     that DPDK overrides numa_error with its own  logging, and that's
> exactly
>     where it gets printed.
>
> Ah - thanks for teaching me something new today.  Now I understand why my
> simple grep failed to find it!
>
>     As to the cause, it appears that the kernel is unhappy with the
> mode/nodes
>     combination DPDK tries to give it. The kernel is 3.10, BTW.
>
>     Do you by chance have any local edits in your DPDK submodule?
>     >
>
>     No, I'm running stock SPDK/DPDK.
>
>     Regards,
>     Andrey
>
>
>     > -Jim
>     >
>     >
>     > On 2/18/20, 8:28 AM, "Andrey Kuzmin" <andrey.v.kuzmin(a)gmail.com>
> wrote:
>     >
>     >     Hi guys,
>     >
>     >     I'm running 20.01 (default configuration) on a CentOS 7
> Epyc-based
>     >     system, and getting a lot of subj warnings like in the below
> example.
>     >     Does that point to a system configuration issue that needs to be
>     >     fixed?
>     >
>     >     Thanks,
>     >     Andrey
>     >
>     >     Starting SPDK v20.01 git sha1 5ffffe9 / DPDK 19.11.0
> initialization...
>     >     [ DPDK EAL parameters: hotplug --no-shconf -c 0x1
>     >     --log-level=lib.eal:6 --log-level=lib.cryptodev:5
> --log-level=user1:6
>     >     --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations
>     >     --file-prefix=spdk_pid109760 ]
>     >     EAL: No available hugepages reported in hugepages-1048576kB
>     >     EAL: VFIO support initialized
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Initializing NVMe Controllers
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL:   using IOMMU type 1 (Type 1)
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attaching to 0000:45:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attaching to 0000:46:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attaching to 0000:4b:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attaching to 0000:4c:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attaching to 0000:4d:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attaching to 0000:4e:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attached to 0000:45:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attached to 0000:46:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attached to 0000:4b:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attached to 0000:4c:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attached to 0000:4d:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Attached to 0000:4e:00.0
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     EAL: set_mempolicy failed: Invalid argument
>     >     Initialization complete. Starting I/O...
>     >     _______________________________________________
>     >     SPDK mailing list -- spdk(a)lists.01.org
>     >     To unsubscribe send an email to spdk-leave(a)lists.01.org
>     >
>     >
>     > _______________________________________________
>     > SPDK mailing list -- spdk(a)lists.01.org
>     > To unsubscribe send an email to spdk-leave(a)lists.01.org
>     >
>     _______________________________________________
>     SPDK mailing list -- spdk(a)lists.01.org
>     To unsubscribe send an email to spdk-leave(a)lists.01.org
>
>
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.