Deploy Model Server {#ovmsdocsdeploying_server}

October 30, 2025 ยท View on GitHub

---
maxdepth: 1
hidden:
---
ovms_docs_deploying_server_docker
ovms_docs_deploying_server_baremetal
ovms_docs_deploying_server_service
ovms_docs_deploying_server_kubernetes
ovms_docs_serving_model
ovms_docs_parameters
ovms_docs_target_devices
ovms_docs_security

There are multiple options for deploying OpenVINO Model Server

  1. With Docker - use pre-built container images available on Docker Hub and Red Hat Ecosystem Catalog or build your own image from source.
  2. On baremetal Linux or Windows - download packaged binary and run it directly on your system.
  3. In Kubernetes - use helm chart, Kubernetes Operator or OpenShift Operator.

Starting and configuring Model Server

  1. Startup modes
  2. Startup parameters
  3. Using AI Accelerators
  4. Security Considerations