I-D Action: draft-reilly-aimed-eval-01.txt

Internet-Draft draft-reilly-aimed-eval-01.txt is now available.

   Title:   Evaluation Methodology for AI Machine-Readable Ethics Directives
   Author:  Lawrence J. Reilly Jr.
   Name:    draft-reilly-aimed-eval-01.txt
   Pages:   24
   Dates:   2026-08-25

Abstract:

   This document defines a repeatable evaluation methodology for
   measuring the influence of AI Machine-Readable Ethics Directive
   (AIMED) blocks, as specified in draft-reilly-aimed-01, on the
   outputs of AI systems that process IETF Internet-Drafts and related
   standards documentation.

   The methodology establishes a controlled test protocol, a set of
   canonical test queries, a scoring scheme, and a results framework
   suitable for independent replication.  This revision separates two
   effects that the initial revision conflated: retrieval propagation,
   which measures whether an AI system reached a document and
   reproduced its self-description, and directive compliance, which
   measures whether the AI system exhibited behavior the document's
   directives specify and that it would not otherwise exhibit.  Only
   the second is evidence that an AIMED block did anything.

   The revision adds a no-block control condition, identifies four
   confounders that affect any evaluation of this kind, and restates
   the initial evaluation of April 8-9, 2026 at the evidentiary
   strength the observations actually support.

The IETF datatracker status page for this Internet-Draft is:
https://datatracker.ietf.org/doc/draft-reilly-aimed-eval/

There is also an HTMLized version available at:
https://datatracker.ietf.org/doc/html/draft-reilly-aimed-eval-01

A diff from the previous version is available at:
https://author-tools.ietf.org/iddiff?url2=draft-reilly-aimed-eval-01

Internet-Drafts are also available by rsync at:
rsync.ietf.org::internet-drafts


_______________________________________________
I-D-Announce mailing list -- [email protected]
To unsubscribe send an email to [email protected]