Endpoint Identity

April 12, 2026 ยท View on GitHub

Routing and benchmarking operate on concrete endpoints, not abstract model names.

An EndpointIdentity captures:

  • endpoint/provider/serving-source identity,
  • model/package/variant identifiers,
  • runtime version, quantization, and precision,
  • host, device, region, and organizational scope.

This makes it possible to distinguish two endpoints serving the same base model under different runtime, quantization, or deployment conditions.