[SPDK] Re: The power consumption of spdk framework.

Hi Vincent, Jesse, and all,

SPDK community has many nice communication tools and I have talked about this topic on each tool,
but mailinig list is the broadest. So I share the latest update  here too 🙂

Thanks to the great improvements about CPU stats, DPDK like CPU power saving was simpler than I thought.

https://review.spdk.io/gerrit/c/spdk/spdk/+/1049 is the patch to save CPU power when SPDK reactor is idle.

I enabled the feature by default but optionalizing may be better. Any feedback is very appreciated.
Please take a look at or try using it.
I will update the patch by myself too if I find any bug.

Thanks,
Shuhei

________________________________
差出人: Vincent <cockroach1136(a)gmail.com>
送信日時: 2020年3月6日 11:10
宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
件名: [!][SPDK] Re: The power consumption of spdk framework.

Hello  MATSUMOTO,
    Thanks for your information.
   I will spend sometime to investigate the material.
  Thank you

松本周平 / MATSUMOTO，SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月6日 週五
上午5:33寫道：

> Hi Vincent,
>
> I want to add a comment.
>
> As we had a few talks on Slack, the current idea is not automatic and
> covers only configuration changes.
> We may need to use something like
> https://clicktime.symantec.com/323dHAnuiG4A3bphtxuCUZW7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fprog_guide%2Fpower_man.html
> 43. Power Management — Data Plane Development Kit 20.02.0 documentation -
> DPDK<https://clicktime.symantec.com/323dHAnuiG4A3bphtxuCUZW7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fprog_guide%2Fpower_man.html>
> 43.2. Core-load Throttling through C-States. Core state can be altered by
> speculative sleeps whenever the specified lcore has nothing to do. In the
> DPDK, if no packet is received after polling, speculative sleeps can be
> triggered according the strategies defined by the user space application.
> doc.dpdk.org
> https://clicktime.symantec.com/325xhCXULjJBcRD7JUcshtx7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fsample_app_ug%2Fl3_forward_power_man.html
> 22. L3 Forwarding with Power Management Sample Application — Data Plane
> Development Kit 20.02.0-rc1 documentation - DPDK<
> https://clicktime.symantec.com/325xhCXULjJBcRD7JUcshtx7Vc?u=https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fsample_app_ug%2Fl3_forward_power_man.html>
> 22.1. Introduction. The L3 Forwarding with Power Management application is
> an example of power-aware packet processing using the DPDK. The application
> is based on existing L3 Forwarding sample application, with the power
> management algorithms to control the P-states and C-states of the Intel
> processor via a power management library.
> doc.dpdk.org
>
> I have not investigated in detail yet though.
>
> I have just started and so your any interest and input are very
> appreciated.
>
> Thanks,
> Shuhei
>
>
> ________________________________
> 差出人: Vincent <cockroach1136(a)gmail.com>
> 送信日時: 2020年3月5日 18:45
> 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> 件名: [!][SPDK] Re: The power consumption of spdk framework.
>
> Thank you so much for your response.
>
> 松本周平 / MATSUMOTO，SHUUHEI <shuhei.matsumoto.xt(a)hitachi.com> 於 2020年3月5日 週四
> 上午10:51寫道：
>
> > Hi Vincent,
> >
> > An idea is out there now.
> >
> > The current idea is to migrate SPDK threads among CPU cores and create
> > idle reactor.
> > Idle reactor sleeps until any thread runs on it.
> >
> > Related patche is
> https://clicktime.symantec.com/3Mv6ymv82pF8Qpw7hh4N1Su7Vc?u=https%3A%2F%2Freview.spdk.io%2Fgerrit%2Fc%2Fspdk%2Fspdk%2F%2B%2F1049
> to
> > sleep idle reactors.
> > The recently added thread_set_cpumask can migrate SPDK thread among CPU
> > cores.
> >
> > We discussed this topic in the last community meeting. Please check this
> > together if you have interest.
> >
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > Trello<
> >
> https://clicktime.symantec.com/3KHNFPYa6mHB2GUnEnMXU3X7Vc?u=https%3A%2F%2Ftrello.com%2Fc%2FJndSGRoW%2F277-simple-cpu-core-parking-when-reactor-has-no-threads
> > >
> > Organize anything, together. Trello is a collaboration tool that
> organizes
> > your projects into boards. In one glance, know what's being worked on,
> > who's working on what, and where something is in a process.
> > trello.com
> >
> >
> > Thanks,
> > Shuhei
> >
> >
> >
> > ________________________________
> > 差出人: Vincent <cockroach1136(a)gmail.com>
> > 送信日時: 2020年3月5日 11:38
> > 宛先: Storage Performance Development Kit <spdk(a)lists.01.org>
> > 件名: [SPDK] The power consumption of spdk framework.
> >
> > Hello all,
> >    We know when spdk start, The cpu-core used by spdk usage will become
> > 100% due to busy loop of reactor.  I remember this topic has been
> discussed
> > before. But I forget the conclusion. I cannot find out the conclusion in
> > the internet and maillist too.
> >
> >     Does anyone can provide me the information about this topic ??
> > Can spdk avoid the cpu usage 100% when idle now??
> >
> > Thank you so much.
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> > _______________________________________________
> > SPDK mailing list -- spdk(a)lists.01.org
> > To unsubscribe send an email to spdk-leave(a)lists.01.org
> >
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
> _______________________________________________
> SPDK mailing list -- spdk(a)lists.01.org
> To unsubscribe send an email to spdk-leave(a)lists.01.org
>
_______________________________________________
SPDK mailing list -- spdk(a)lists.01.org
To unsubscribe send an email to spdk-leave(a)lists.01.org