Overview of AI Toolkit

What's AI Toolkit for Visual Studio Code?

AI Toolkit for Visual Studio Code is an extension to help developers and AI engineers to easily build AI apps through developing and testing with generative AI models locally or in the cloud. AI Toolkit supports most genAI models on the market.

Who shall use AI Toolkit?

Any developer who wants to explore, test, evaluate, and finetune generative AI models when building AI apps.

Install and setup

Search the Visual Studio Code extension marketplace for "AI Toolkit", install either the formal released version to stable features, or pre-released version for early access of new features. Check What's New during the installation for detailed feature list of each version.

Key features

• Get started guide
• Model catalog with rich generative AI models sources (GitHub, ONNX, OpenAI, Anthropic, Google, ...)
• Bring Your Own Models from remotely hosted model, or Ollama models that are runing locally
• Playground model inference or chat test
• Attachment support for Multi-modal Language Models
• Many new features coming soon: evaluation, dataset, batch run, finetune, prompt...

Follow Get started guide or find docs on models and playground