Re: [lustre-devel] New contributor inquiry – statu s of LU-1643 (“reserved space” in stat fs/df) and guidance requested
GEORGE ZHAO <[email protected]> Tue, 6 May 2025 19:48:41 -0400
| Newsgroups | org.lustre.lists.lustre-devel |
|---|---|
| Message-ID | <CAFhHJgmyHMBY8bha2eAP1QRGvcBumgLViusKy-NNxoDeLQQt6A@mail.gmail.com> |
--===============7619570289454798224== Content-Type: multipart/alternative; boundary="00000000000064a3d60634804255" --00000000000064a3d60634804255 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Andreas, Could you or Simmons send me an invitation to this channel? https://lustreupstreamclient.slack.com/messages/CAV4QF0ER/ An invitation from the workspace admin is required (James Simmons) I have a question about how to retrieve data from /proc. And I'd like to clarify the behavior of "lfs df --stats". Thanks, George On Thu, May 1, 2025 at 1:52=E2=80=AFAM Andreas Dilger <[email protected]> wro= te: > There is a Slack channel, which is linked from wiki.lustre.org "lists" > page that you can use for simple discussions. Email is probably better fo= r > complex questions. > > Cheers, Andreas > > On Apr 30, 2025, at 20:18, GEORGE ZHAO <[email protected]> wrote: > > =EF=BB=BF > Thank you, Andreas! > I'm currently looking into LU-7880. Will follow up if I have an > implementation plan or run into any questions (quite likely). > > By the way, should I reach out to the lustre-devel for questions like > this, or is there a more specific channel? > > Thanks! > George > > On Wed, Apr 30, 2025 at 4:44=E2=80=AFAM Andreas Dilger <[email protected]> = wrote: > >> Hi George, >> thanks for your interest. There are definitely a number of open tickets >> in the "easy" (and "medium") categories that you could work on, though >> there have been a number of interns and new hires working on those ticke= ts >> recently and fewer are now available. >> >> LU-1643 happens to be the oldest "easy" ticket, but don't let that guide >> your selection. I would suggest you take a look through the whole list = and >> pick something that is of interest to you and/or matches your experience >> level. >> >> - LU-16738 <https://jira.whamcloud.com/browse/LU-16738> - Improve >> mount.lustre with many MGS NIDs >> <https://jira.whamcloud.com/browse/LU-16738>: this is partly a userspace >> (mount.lustre) change and partly in the kernel (though not incredibly >> complex). This is actually in the "useful" category that provides impro= ved >> functionality for something that is seen regularly. >> >> >> If you are feeling more adventurous, you might look at one of the >> "medium" tickets, which may not be too difficult: >> - LU-7880 <https://jira.whamcloud.com/browse/LU-7880> - add OST/MDT >> performance statistics to obd_statfs >> <https://jira.whamcloud.com/browse/LU-7880>: this is a very useful >> feature that would allow clients/user applications to probe the IO load = on >> OSTs, and self-optimize checkpoint IO to times when the OSTs are less bu= sy >> - LU-13123 <https://jira.whamcloud.com/browse/LU-13123> - Add list of >> client NIDs to job_stats output >> <https://jira.whamcloud.com/browse/LU-13123>: this would associate all >> of the clients that are contributing to the job_stats for a specific Job= ID, >> and would be useful for debugging and monitoring/ >> >> On Apr 29, 2025, at 17:41, GEORGE ZHAO <[email protected]> wrote: >> >> >> I'm a storage engineer and a Lustre beginner who just figured out how to >> deploy it. Did read a lot about it though. >> My goal is using Lustre to support HPC/ML workload. And I believe doing >> some tasks would help me proceed better. >> >> As wiki suggested, I found an "easy" ticket LU-1643: =E2=80=9CRequest to= remove >> display of reserved space from statfs (df) total space.=E2=80=9D >> Is it still unclaimed? >> If it's already in progress, or there's a higher priority issue that >> could use help, please point me in the right direction. >> >> Thanks in advance for any advice. >> >> Best regards, >> George >> _______________________________________________ >> lustre-devel mailing list >> [email protected] >> http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org >> >> >> Cheers, Andreas >> =E2=80=94 >> Andreas Dilger >> Lustre Principal Architect >> Whamcloud/DDN >> >> >> >> >> --00000000000064a3d60634804255 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">Hi Andreas,<div><br></div><div><div>Could you or Simmons s= end me an invitation=C2=A0to this channel?</div><div><a href=3D"https://lus= treupstreamclient.slack.com/messages/CAV4QF0ER/">https://lustreupstreamclie= nt.slack.com/messages/CAV4QF0ER/</a><br>An invitation from the workspace ad= min is required (James Simmons)</div><div><br></div><div>I have a question= =C2=A0about how to retrieve=C2=A0data from /proc.</div><div>And I'd lik= e to clarify the behavior of "lfs df --stats".</div><div><br></di= v><div>Thanks,</div><div>George</div></div></div><br><div class=3D"gmail_qu= ote gmail_quote_container"><div dir=3D"ltr" class=3D"gmail_attr">On Thu, Ma= y 1, 2025 at 1:52=E2=80=AFAM Andreas Dilger <<a href=3D"mailto:adilger@d= dn.com">[email protected]</a>> wrote:<br></div><blockquote class=3D"gmail_= quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,= 204);padding-left:1ex"> <div dir=3D"auto"> There is a Slack channel, which is linked from <a href=3D"http://wiki.lustr= e.org" target=3D"_blank">wiki.lustre.org</a> "lists" page that yo= u can use for simple discussions. Email is probably better for complex ques= tions.=C2=A0 <div><br id=3D"m_-4661364368212878897lineBreakAtBeginningOfSignature"> <div dir=3D"ltr">Cheers, Andreas</div> <div dir=3D"ltr"><br> <blockquote type=3D"cite">On Apr 30, 2025, at 20:18, GEORGE ZHAO <<a hre= f=3D"mailto:[email protected]" target=3D"_blank">georgezhaojobs@gmai= l.com</a>> wrote:<br> <br> </blockquote> </div> <blockquote type=3D"cite"> <div dir=3D"ltr">=EF=BB=BF <div dir=3D"ltr"> <div dir=3D"ltr">Thank you, Andreas!<br> I'm currently looking into LU-7880. Will follow up if I have an impleme= ntation plan or run into any questions (quite likely).<br> <br> By the way, should I reach out to the lustre-devel for questions like this,= or is there a more specific channel?<br> <div><br> </div> <div>Thanks!</div> <div>George</div> </div> <br> <div class=3D"gmail_quote"> <div dir=3D"ltr" class=3D"gmail_attr">On Wed, Apr 30, 2025 at 4:44=E2=80=AF= AM Andreas Dilger <<a href=3D"mailto:[email protected]" target=3D"_blank">= [email protected]</a>> wrote:<br> </div> <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left:1px solid rgb(204,204,204);padding-left:1ex"> <div>Hi George, <div>thanks for your interest.=C2=A0 There are definitely a number of open = tickets in the "easy" (and "medium") categories that yo= u could work on, though there have been a number of interns and new hires w= orking on those tickets recently and fewer are now available.</div> <div><br> </div> <div>LU-1643 happens to be the oldest "easy" ticket, but don'= t let that guide your selection.=C2=A0 I would suggest you take a look thro= ugh the whole list and pick something that is of interest to you and/or mat= ches your experience level.</div> <div><br> </div> <div>-=C2=A0<a href=3D"https://jira.whamcloud.com/browse/LU-16738" id=3D"m_= -4661364368212878897m_1429994837881312626key-val" rel=3D"75582" target=3D"_= blank">LU-16738</a>=C2=A0-=C2=A0<a href=3D"https://jira.whamcloud.com/brows= e/LU-16738" target=3D"_blank">Improve mount.lustre with many MGS NIDs</a>: = this is partly a userspace (mount.lustre) change and partly in the kernel (though = not incredibly complex).=C2=A0 This is actually in the "useful" c= ategory that provides improved functionality for something that is seen reg= ularly.</div> <div><br> </div> <div><br> </div> <div>If you are feeling more adventurous, you might look at one of the &quo= t;medium" tickets, which may not be too difficult:</div> <div>-=C2=A0<a href=3D"https://jira.whamcloud.com/browse/LU-7880" target=3D= "_blank">LU-7880</a>=C2=A0-=C2=A0<a href=3D"https://jira.whamcloud.com/brow= se/LU-7880" target=3D"_blank">add OST/MDT performance statistics to obd_sta= tfs</a>: =C2=A0this is a very useful feature that would allow clients/user applications to probe the IO load on OSTs, and self-optimize = checkpoint IO to times when the OSTs are less busy</div> <div>-=C2=A0<a href=3D"https://jira.whamcloud.com/browse/LU-13123" target= =3D"_blank">LU-13123</a>=C2=A0-=C2=A0<a href=3D"https://jira.whamcloud.com/= browse/LU-13123" target=3D"_blank">Add list of client NIDs to job_stats out= put</a>: this would associate all of the clients that are contributing to the job_stats for a specific JobID, and would be useful fo= r debugging and monitoring/<br id=3D"m_-4661364368212878897m_14299948378813= 12626lineBreakAtBeginningOfMessage"> <div><br> <div> <div>On Apr 29, 2025, at 17:41, GEORGE ZHAO <<a href=3D"mailto:georgezha= [email protected]" target=3D"_blank">[email protected]</a>> wrote:<= /div> </div> <blockquote type=3D"cite"> <div> <div> <div> <div dir=3D"ltr"> <div><br> </div> <div>I'm a storage engineer and a Lustre=C2=A0beginner who just figured= out how to deploy it. Did read a lot about it though.</div> <div>My goal is using Lustre to support=C2=A0HPC/ML workload. And I believe= doing some tasks would help me proceed better.</div> <div><br> </div> <div>As wiki suggested, I found an "easy" ticket LU-1643: =E2=80= =9CRequest to remove display of reserved space from statfs (df) total space= .=E2=80=9D</div> <div>Is it still unclaimed?=C2=A0</div> <div>If it's already in progress, or there's a higher priority issu= e that could use help, please point me in the right direction.</div> <div><br> </div> <div>Thanks in advance for any advice.<br> <br> Best regards,</div> <div>George</div> </div> </div> </div> _______________________________________________<br> lustre-devel mailing list<br> <a href=3D"mailto:[email protected]" target=3D"_blank">lustre-d= [email protected]</a><br> <a href=3D"http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org" ta= rget=3D"_blank">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.or= g</a><br> </div> </blockquote> </div> <br> <div> <div dir=3D"auto" style=3D"color:rgb(0,0,0);letter-spacing:normal;text-alig= n:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing= :0px;text-decoration:none"> <div dir=3D"auto" style=3D"color:rgb(0,0,0);letter-spacing:normal;text-alig= n:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing= :0px;text-decoration:none"> <div>Cheers, Andreas</div> <div>=E2=80=94</div> <div>Andreas Dilger</div> <div>Lustre Principal Architect</div> <div>Whamcloud/DDN</div> </div> <br> </div> <br> <br> </div> <br> </div> </div> </blockquote> </div> </div> </div> </blockquote> </div> </div> </blockquote></div> --00000000000064a3d60634804255-- --===============7619570289454798224== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ lustre-devel mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org --===============7619570289454798224==--