Re: [lustre-devel] New contributor inquiry – statu s of LU-1643 (“reserved space” in stat fs/df) and guidance requested

GEORGE ZHAO <[email protected]> Tue, 6 May 2025 19:48:41 -0400
Newsgroups org.lustre.lists.lustre-devel
Message-ID <CAFhHJgmyHMBY8bha2eAP1QRGvcBumgLViusKy-NNxoDeLQQt6A@mail.gmail.com>
--===============7619570289454798224==
Content-Type: multipart/alternative; boundary="00000000000064a3d60634804255"

--00000000000064a3d60634804255
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi Andreas,

Could you or Simmons send me an invitation to this channel?
https://lustreupstreamclient.slack.com/messages/CAV4QF0ER/
An invitation from the workspace admin is required (James Simmons)

I have a question about how to retrieve data from /proc.
And I'd like to clarify the behavior of "lfs df --stats".

Thanks,
George

On Thu, May 1, 2025 at 1:52=E2=80=AFAM Andreas Dilger <[email protected]> wro=
te:

> There is a Slack channel, which is linked from wiki.lustre.org "lists"
> page that you can use for simple discussions. Email is probably better fo=
r
> complex questions.
>
> Cheers, Andreas
>
> On Apr 30, 2025, at 20:18, GEORGE ZHAO <[email protected]> wrote:
>
> =EF=BB=BF
> Thank you, Andreas!
> I'm currently looking into LU-7880. Will follow up if I have an
> implementation plan or run into any questions (quite likely).
>
> By the way, should I reach out to the lustre-devel for questions like
> this, or is there a more specific channel?
>
> Thanks!
> George
>
> On Wed, Apr 30, 2025 at 4:44=E2=80=AFAM Andreas Dilger <[email protected]> =
wrote:
>
>> Hi George,
>> thanks for your interest.  There are definitely a number of open tickets
>> in the "easy" (and "medium") categories that you could work on, though
>> there have been a number of interns and new hires working on those ticke=
ts
>> recently and fewer are now available.
>>
>> LU-1643 happens to be the oldest "easy" ticket, but don't let that guide
>> your selection.  I would suggest you take a look through the whole list =
and
>> pick something that is of interest to you and/or matches your experience
>> level.
>>
>> - LU-16738 <https://jira.whamcloud.com/browse/LU-16738> - Improve
>> mount.lustre with many MGS NIDs
>> <https://jira.whamcloud.com/browse/LU-16738>: this is partly a userspace
>> (mount.lustre) change and partly in the kernel (though not incredibly
>> complex).  This is actually in the "useful" category that provides impro=
ved
>> functionality for something that is seen regularly.
>>
>>
>> If you are feeling more adventurous, you might look at one of the
>> "medium" tickets, which may not be too difficult:
>> - LU-7880 <https://jira.whamcloud.com/browse/LU-7880> - add OST/MDT
>> performance statistics to obd_statfs
>> <https://jira.whamcloud.com/browse/LU-7880>:  this is a very useful
>> feature that would allow clients/user applications to probe the IO load =
on
>> OSTs, and self-optimize checkpoint IO to times when the OSTs are less bu=
sy
>> - LU-13123 <https://jira.whamcloud.com/browse/LU-13123> - Add list of
>> client NIDs to job_stats output
>> <https://jira.whamcloud.com/browse/LU-13123>: this would associate all
>> of the clients that are contributing to the job_stats for a specific Job=
ID,
>> and would be useful for debugging and monitoring/
>>
>> On Apr 29, 2025, at 17:41, GEORGE ZHAO <[email protected]> wrote:
>>
>>
>> I'm a storage engineer and a Lustre beginner who just figured out how to
>> deploy it. Did read a lot about it though.
>> My goal is using Lustre to support HPC/ML workload. And I believe doing
>> some tasks would help me proceed better.
>>
>> As wiki suggested, I found an "easy" ticket LU-1643: =E2=80=9CRequest to=
 remove
>> display of reserved space from statfs (df) total space.=E2=80=9D
>> Is it still unclaimed?
>> If it's already in progress, or there's a higher priority issue that
>> could use help, please point me in the right direction.
>>
>> Thanks in advance for any advice.
>>
>> Best regards,
>> George
>> _______________________________________________
>> lustre-devel mailing list
>> [email protected]
>> http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org
>>
>>
>> Cheers, Andreas
>> =E2=80=94
>> Andreas Dilger
>> Lustre Principal Architect
>> Whamcloud/DDN
>>
>>
>>
>>
>>

--00000000000064a3d60634804255
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Andreas,<div><br></div><div><div>Could you or Simmons s=
end me an invitation=C2=A0to this channel?</div><div><a href=3D"https://lus=
treupstreamclient.slack.com/messages/CAV4QF0ER/">https://lustreupstreamclie=
nt.slack.com/messages/CAV4QF0ER/</a><br>An invitation from the workspace ad=
min is required (James Simmons)</div><div><br></div><div>I have a question=
=C2=A0about how to retrieve=C2=A0data from /proc.</div><div>And I&#39;d lik=
e to clarify the behavior of &quot;lfs df --stats&quot;.</div><div><br></di=
v><div>Thanks,</div><div>George</div></div></div><br><div class=3D"gmail_qu=
ote gmail_quote_container"><div dir=3D"ltr" class=3D"gmail_attr">On Thu, Ma=
y 1, 2025 at 1:52=E2=80=AFAM Andreas Dilger &lt;<a href=3D"mailto:adilger@d=
dn.com">[email protected]</a>&gt; wrote:<br></div><blockquote class=3D"gmail_=
quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,=
204);padding-left:1ex">



<div dir=3D"auto">
There is a Slack channel, which is linked from <a href=3D"http://wiki.lustr=
e.org" target=3D"_blank">wiki.lustre.org</a> &quot;lists&quot; page that yo=
u can use for simple discussions. Email is probably better for complex ques=
tions.=C2=A0
<div><br id=3D"m_-4661364368212878897lineBreakAtBeginningOfSignature">
<div dir=3D"ltr">Cheers, Andreas</div>
<div dir=3D"ltr"><br>
<blockquote type=3D"cite">On Apr 30, 2025, at 20:18, GEORGE ZHAO &lt;<a hre=
f=3D"mailto:[email protected]" target=3D"_blank">georgezhaojobs@gmai=
l.com</a>&gt; wrote:<br>
<br>
</blockquote>
</div>
<blockquote type=3D"cite">
<div dir=3D"ltr">=EF=BB=BF
<div dir=3D"ltr">
<div dir=3D"ltr">Thank you, Andreas!<br>
I&#39;m currently looking into LU-7880. Will follow up if I have an impleme=
ntation plan or run into any questions (quite likely).<br>
<br>
By the way, should I reach out to the lustre-devel for questions like this,=
 or is there a more specific channel?<br>
<div><br>
</div>
<div>Thanks!</div>
<div>George</div>
</div>
<br>
<div class=3D"gmail_quote">
<div dir=3D"ltr" class=3D"gmail_attr">On Wed, Apr 30, 2025 at 4:44=E2=80=AF=
AM Andreas Dilger &lt;<a href=3D"mailto:[email protected]" target=3D"_blank">=
[email protected]</a>&gt; wrote:<br>
</div>
<blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-=
left:1px solid rgb(204,204,204);padding-left:1ex">
<div>Hi George,
<div>thanks for your interest.=C2=A0 There are definitely a number of open =
tickets in the &quot;easy&quot; (and &quot;medium&quot;) categories that yo=
u could work on, though there have been a number of interns and new hires w=
orking on those tickets recently and fewer are now available.</div>
<div><br>
</div>
<div>LU-1643 happens to be the oldest &quot;easy&quot; ticket, but don&#39;=
t let that guide your selection.=C2=A0 I would suggest you take a look thro=
ugh the whole list and pick something that is of interest to you and/or mat=
ches your experience level.</div>
<div><br>
</div>
<div>-=C2=A0<a href=3D"https://jira.whamcloud.com/browse/LU-16738" id=3D"m_=
-4661364368212878897m_1429994837881312626key-val" rel=3D"75582" target=3D"_=
blank">LU-16738</a>=C2=A0-=C2=A0<a href=3D"https://jira.whamcloud.com/brows=
e/LU-16738" target=3D"_blank">Improve mount.lustre with many MGS NIDs</a>: =
this is
 partly a userspace (mount.lustre) change and partly in the kernel (though =
not incredibly complex).=C2=A0 This is actually in the &quot;useful&quot; c=
ategory that provides improved functionality for something that is seen reg=
ularly.</div>
<div><br>
</div>
<div><br>
</div>
<div>If you are feeling more adventurous, you might look at one of the &quo=
t;medium&quot; tickets, which may not be too difficult:</div>
<div>-=C2=A0<a href=3D"https://jira.whamcloud.com/browse/LU-7880" target=3D=
"_blank">LU-7880</a>=C2=A0-=C2=A0<a href=3D"https://jira.whamcloud.com/brow=
se/LU-7880" target=3D"_blank">add OST/MDT performance statistics to obd_sta=
tfs</a>: =C2=A0this is a very useful feature that would allow
 clients/user applications to probe the IO load on OSTs, and self-optimize =
checkpoint IO to times when the OSTs are less busy</div>
<div>-=C2=A0<a href=3D"https://jira.whamcloud.com/browse/LU-13123" target=
=3D"_blank">LU-13123</a>=C2=A0-=C2=A0<a href=3D"https://jira.whamcloud.com/=
browse/LU-13123" target=3D"_blank">Add list of client NIDs to job_stats out=
put</a>: this would associate all of the clients that are
 contributing to the job_stats for a specific JobID, and would be useful fo=
r debugging and monitoring/<br id=3D"m_-4661364368212878897m_14299948378813=
12626lineBreakAtBeginningOfMessage">
<div><br>
<div>
<div>On Apr 29, 2025, at 17:41, GEORGE ZHAO &lt;<a href=3D"mailto:georgezha=
[email protected]" target=3D"_blank">[email protected]</a>&gt; wrote:<=
/div>
</div>
<blockquote type=3D"cite">
<div>
<div>
<div>
<div dir=3D"ltr">
<div><br>
</div>
<div>I&#39;m a storage engineer and a Lustre=C2=A0beginner who just figured=
 out how to deploy it. Did read a lot about it though.</div>
<div>My goal is using Lustre to support=C2=A0HPC/ML workload. And I believe=
 doing some tasks would help me proceed better.</div>
<div><br>
</div>
<div>As wiki suggested, I found an &quot;easy&quot; ticket LU-1643: =E2=80=
=9CRequest to remove display of reserved space from statfs (df) total space=
.=E2=80=9D</div>
<div>Is it still unclaimed?=C2=A0</div>
<div>If it&#39;s already in progress, or there&#39;s a higher priority issu=
e that could use help, please point me in the right direction.</div>
<div><br>
</div>
<div>Thanks in advance for any advice.<br>
<br>
Best regards,</div>
<div>George</div>
</div>
</div>
</div>
_______________________________________________<br>
lustre-devel mailing list<br>
<a href=3D"mailto:[email protected]" target=3D"_blank">lustre-d=
[email protected]</a><br>
<a href=3D"http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org" ta=
rget=3D"_blank">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.or=
g</a><br>
</div>
</blockquote>
</div>
<br>
<div>
<div dir=3D"auto" style=3D"color:rgb(0,0,0);letter-spacing:normal;text-alig=
n:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing=
:0px;text-decoration:none">
<div dir=3D"auto" style=3D"color:rgb(0,0,0);letter-spacing:normal;text-alig=
n:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing=
:0px;text-decoration:none">
<div>Cheers, Andreas</div>
<div>=E2=80=94</div>
<div>Andreas Dilger</div>
<div>Lustre Principal Architect</div>
<div>Whamcloud/DDN</div>
</div>
<br>
</div>
<br>
<br>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>

</blockquote></div>

--00000000000064a3d60634804255--

--===============7619570289454798224==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
lustre-devel mailing list
[email protected]
http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org

--===============7619570289454798224==--