Re: Dealing with LLMs in IETF discussions draft
Nathanael Ritz <[email protected]> Fri, 31 Jul 2026 08:31:43 -0600
| Newsgroups | gmane.ietf.general |
|---|---|
| Message-ID | <CAHxYnaPSdZSbEO06nwp16orraeb+QAnwFuKCjAMvUt2kE3KFbg@mail.gmail.com> |
--000000000000e26ead0657e90cdb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Fri, Jul 31, 2026 at 6:43=E2=80=AFAM Orie <[email protected]> wrote: > What do you mean by "know how to interpret"? > > Do you mean: > > 1. That you can't understand the point they are making? > 2. That you don't believe they are actually aware of the point they are > making? > 3. That you don't want to deal with this problem? > > 3 is not something the IETF can help with imo. > 2 is not actually a new problem, but its scale has been massively > amplified. > 1 is also not a new problem, but it is one that AI can help with : ) > > I have an even more cynical answer for 2: who cares? > Not speaking for Stephen, of course but I have my own pov separate from these 3 that I touched on earlier: I don=E2=80=99t think the problem is so much about if the person on the oth= er end fully understands the point they are making if the solution is sound and makes sense. The real friction comes from when you can=E2=80=99t tell if a participant=E2=80=99s apparently obvious misunderstanding of a technical pr= oblem is simply a lack of teachable context and framing, or if it=E2=80=99s just a m= achine that can never actually properly absorb corrective input in the first place. This matters because a determined human aiming to make the internet better may still disagree with you, but will absorb your input. They are unlikely to repeat confused arguments the same way 2 days from now in basically the same way. I=E2=80=99ve interacted with a few participants where the latter = happens and it makes all the time and effort feel like a waste. Or that I wish I spent more time speaking to the room rather than the participant, which is sometimes what I do after reaching a certain conclusion. Which in itself creates what might otherwise be avoidable noise. Being able to tell how much real human attention is =E2=80=9Cin the loop=E2= =80=9D is what I imagine Stephen may be hoping to achieve. In any case, the above is an example of the challenges I=E2=80=99ve personally encountered on list. Cheers, Nathanael > > On Fri, Jul 31, 2026 at 6:37=E2=80=AFAM Stephen Farrell <stephen.farrell@= cs.tcd.ie> > wrote: > >> >> Hiya, >> >> On 31/07/2026 12:31, Orie wrote: >> > It sounds like the goal is more effective use of AI in IETF >> > discussions. >> >> Yes, that is my co-author Frank's goal. It is not mine. My >> high level goal in this is to know how to interpret messages >> emitted by others in IETF discussions, despite use of AI. >> >> Cheers, >> S. >> >> --000000000000e26ead0657e90cdb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"auto">On Fri, Jul 31, 2026 at 6:43=E2=80=AFAM Orie <<a href= =3D"mailto:[email protected]">[email protected]</a>> wrote:<br></div><div dir=3D"a= uto"><div class=3D"gmail_quote gmail_quote_container"><blockquote class=3D"= gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(20= 4,204,204);padding-left:1ex"><div dir=3D"ltr">What do you mean by "kno= w how to interpret"?<br><br>Do you mean:<br><br>1. That you=C2=A0can&#= 39;t understand the point they are making?<br>2. That you don't believe= they are actually aware of the point they are making?<br>3. That you don&#= 39;t want to deal with this problem?<br><br>3 is not something the IETF can= help with imo.<br>2 is not actually a new problem, but its scale has been = massively amplified.<br>1 is also not a new problem, but it is one that AI = can help with : )<br><br>I have an even more cynical answer for 2: who care= s?<br></div></blockquote><div dir=3D"auto"><br></div><blockquote class=3D"g= mail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204= ,204,204);padding-left:1ex"><div dir=3D"ltr"></div></blockquote><div dir=3D= "auto">Not speaking for Stephen, of course but I have my own pov separate f= rom these 3 that I touched on earlier:</div><div dir=3D"auto"><br></div><di= v dir=3D"auto">I don=E2=80=99t think the problem is so much about if the pe= rson on the other end fully understands the point they are making if the so= lution is sound and makes sense. The real friction comes from when you can= =E2=80=99t tell if a participant=E2=80=99s apparently obvious misunderstand= ing of a technical problem is simply a lack of teachable context and framin= g, or if it=E2=80=99s just a machine that can never actually properly absor= b corrective input in the first place.=C2=A0</div><div dir=3D"auto"><br></d= iv><div dir=3D"auto">This matters because a determined human aiming to make= the internet better may still disagree with you, but will absorb your inpu= t. They are unlikely to repeat confused arguments the same way 2 days from = now in basically the same way. I=E2=80=99ve interacted with a few participa= nts where the latter happens and it makes all the time and effort feel like= a waste.=C2=A0</div><div dir=3D"auto"><br></div><div dir=3D"auto">Or that = I wish I spent more time speaking to the room rather than the participant, = which is sometimes what I do after reaching a certain conclusion. Which in = itself creates what might otherwise be avoidable noise.=C2=A0</div><div dir= =3D"auto"><br></div><div dir=3D"auto">Being able to tell=C2=A0how much real= human attention is =E2=80=9Cin the loop=E2=80=9D is what I imagine Stephen= may be hoping to achieve. In any case, the above is an example of the chal= lenges I=E2=80=99ve personally encountered on list.=C2=A0</div><div dir=3D"= auto"><br></div><div dir=3D"auto">Cheers,</div><div dir=3D"auto">Nathanael<= /div><div dir=3D"auto"><br></div><div dir=3D"auto"><br></div><blockquote cl= ass=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid= rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><br></div></blockquote= ><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border= -left:1px solid rgb(204,204,204);padding-left:1ex"><br><div class=3D"gmail_= quote"><div dir=3D"ltr" class=3D"gmail_attr">On Fri, Jul 31, 2026 at 6:37= =E2=80=AFAM Stephen Farrell <<a href=3D"mailto:[email protected]= " target=3D"_blank">[email protected]</a>> wrote:<br></div><bloc= kquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:= 1px solid rgb(204,204,204);padding-left:1ex"><br> Hiya,<br> <br> On 31/07/2026 12:31, Orie wrote:<br> > It sounds like the goal is more effective use of AI in IETF<br> > discussions.<br> <br> Yes, that is my co-author Frank's goal. It is not mine. My<br> high level goal in this is to know how to interpret messages<br> emitted by others in IETF discussions, despite use of AI.<br> <br> Cheers,<br> S.<br> <br> </blockquote></div> </blockquote></div></div> --000000000000e26ead0657e90cdb--