KServe Design Docs

March 6, 2023 ยท View on GitHub

2023

  • KServe v1.0 plan
  • KServe Async Inference
  • KServe/TorchServe v2 Inference Protocol Benchmark tests

2022

  • KServe Serving Runtime
  • KServe Inference Graph
  • ModelMesh Multi Namespaces Support

2021

  • KFServing Transiton Plan
  • KServe Kubernetes Native Deployment
  • KServe v1beta1 RFC

2020

  • Multi Model Serving Sharing
  • Model Serving Storage Caching
  • Inference Batcher
  • KFServing Pre/Post Processing

Contents

  1. 12023
  2. 22022
  3. 32021
  4. 42020