Internet-Draft draft-wang-cats-odsi-01.txt is now available.
Title: An Architecture for Open, Decentralized, and Scalable Large Language Model Inference
Authors: Hanling Wang
Qing Li
Yong Jiang
Mingwei Xu
Gabriel-Miro Muntean
Name: draft-wang-cats-odsi-01.txt
Pages: 32
Dates: 2026-08-27
Abstract:
Large Language Model (LLM) inference is normally operated by one
provider, even when the provider distributes execution across many
sites. This document describes a different system model in which
independently operated and mutually untrusted participants contribute
compute, memory, model storage, and network capacity to one inference
service. No single administrative entity is required to admit
participants, select every execution path, hold the complete model,
verify all results, or settle all resource contributions.
This document defines the Open, Decentralized, and Scalable Inference
(ODSI) architecture. It specifies the architectural roles, trust
boundaries, named objects, protocol-independent interfaces, execution
workflow, verification choices, timing model, and security and
privacy requirements needed to construct a multi-operator inference
overlay. It also identifies the protocol and operational choices
that each ODSI deployment must specify so that independently
developed participants can interoperate.
ODSI is related to Computing-Aware Traffic Steering (CATS), but it
does not extend the CATS single-provider model across trust domains.
CATS mechanisms can be used within a participating domain or as an
input to local path selection. Cross-domain membership, model
governance, execution verification, and settlement are separate ODSI
functions. This document is Informational and does not define a wire
format, consensus algorithm, payment system, or new CATS metric.
The IETF datatracker status page for this Internet-Draft is:
https://datatracker.ietf.org/doc/draft-wang-cats-odsi/
There is also an HTML version available at:
https://www.ietf.org/archive/id/draft-wang-cats-odsi-01.html
A diff from the previous version is available at:
https://author-tools.ietf.org/iddiff?url2=draft-wang-cats-odsi-01
Internet-Drafts are also available by rsync at:
rsync.ietf.org::internet-drafts
_______________________________________________
I-D-Announce mailing list -- [email protected]
To unsubscribe send an email to [email protected]
lmpx.com only provides a reader for public news (NNTP) servers. It is not
affiliated with the servers or forums shown here and is not responsible for
the content of articles, which is written by their respective authors.