AI DevOps Quick Start Guide
August 31, 2026 ยท View on GitHub
Not sure where to start? This guide maps the landscape and recommends tools by role.
AI DevOps Landscape at a Glance
| Layer | Open Source | Commercial | CNCF Projects |
|---|---|---|---|
| Coding Agents | Aider, Cline, Continue | Claude Code, Cursor, Copilot | - |
| Kubernetes | K8sGPT, kubectl-ai, Headlamp | Komodor, Robusta | K8sGPT, Kagent, KAITO |
| IaC and Terraform | OpenTofu, Infracost, Checkov | Spacelift, Env0, Firefly | - |
| Incident Response | HolmesGPT, IncidentFox, OpenSRE | AWS DevOps Agent, PagerDuty SRE Agent, Rootly | HolmesGPT |
| Monitoring | Grafana, Prometheus | Datadog, Dynatrace, Splunk | Prometheus |
| Security | Trivy, Falco, Checkov, Semgrep | Snyk, Wiz, Prisma Cloud | Falco |
| Cost and FinOps | OpenCost, Kubecost | CAST AI, Vantage, CloudZero | OpenCost |
| MCP Servers | MCP Reference, Kubernetes MCP | AWS MCP, GitHub MCP | - |
| CI/CD | ArgoCD, Tekton, Dagger | GitLab Duo, Harness | ArgoCD, Tekton |
| Platform Engineering | Backstage, Kratix | Port, Humanitec, Cortex | Backstage |
| GitOps | Flux, Kustomize, Helm | Weave GitOps, Codefresh | Flux, Helm |
| Chaos Engineering | Chaos Mesh, Litmus | Gremlin, Steadybit | Chaos Mesh, Litmus |
Quick Start by Role
DevOps Engineer Starting with AI
- Daily IaC work: Start with Claude Code or GitHub Copilot for writing Terraform, Kubernetes manifests, and Dockerfiles.
- Cluster troubleshooting: Add K8sGPT to scan clusters and explain issues in plain English.
- Cost visibility: Use Infracost for cost estimates in Terraform PRs.
SRE Focused on Reliability
- Incident investigation: HolmesGPT combines observability telemetry with LLM reasoning for root cause analysis.
- Observability: Grafana Assistant provides AI-assisted query generation, dashboards, and investigations in Grafana Cloud.
- Resilience testing: Chaos Mesh for fault injection in Kubernetes.
- Autonomous operations: AWS DevOps Agent or Azure SRE Agent as always-on ops teammates that investigate and remediate with approval gates.
Platform Engineer Building Self-Service
- Developer portal: Backstage for service catalogs and templates.
- GitOps delivery: ArgoCD for continuous deployment to Kubernetes.
- Continuous reconciliation: Flux for automated image updates and Helm releases.
Security Engineer
- Vulnerability scanning: Trivy for containers, IaC, and code.
- Runtime security: Falco for threat detection in containers.
- Supply chain: Docker Scout for image analysis and CVE remediation.
FinOps and Cost Optimization
- Kubernetes costs: OpenCost for vendor-neutral cost monitoring.
- Terraform costs: Infracost for cost estimates in pull requests.
- Multi-cloud visibility: Vantage for recommendations across cloud providers.
Building AI Agents for Infrastructure
- Agent framework: LangChain or CrewAI for building custom DevOps agents, or Kagent for Kubernetes-native agents.
- Tool integrations: Explore MCP Servers for connecting AI to infrastructure tools.
- Orchestration: Temporal for durable execution of long-running workflows.