LmScript

Controllable Language Model Interactions in TypeScript

• A suite of tools for easy, fast, and controllable interactions with language models.
• Open models and open source.
• Supports SGLang and vLLM (Outlines).

Documentation, Tutorial, Examples

Check out the LmScript Docs

Projects

Project	Description
Typescript Client	Dependency-free client that creates and executes LmScript programs with different backends.
GUI	Desktop Application that creates and executes LmScript programs.
Runpod Serverless SGLang	Docker image that runs SGLang on Runpod Serverless.
Docker SGLang	Docker image that runs SGLang
Runpod Serverless vLLM	Docker image that runs vLLM (Outlines) on Runpod Serverless.