Braintrust JavaScript SDKs

Braintrust is a platform for evaluating and shipping AI products. Learn more at braintrust.dev and in the docs.

This repository contains Braintrust's JavaScript/TypeScript SDKs and integrations, including:

• The main braintrust SDK package (./js)
• Integration packages under ./integrations
• Shared tooling and smoke tests for JavaScript SDK development

Quickstart

Install the main SDK and autoeval scorers:

npm install braintrust autoevals

Create tutorial.eval.ts:

import { Eval } from "braintrust";
import { LevenshteinScorer } from "autoevals";

Eval("Say Hi Bot", {
  data: () => [
    { input: "Foo", expected: "Hi Foo" },
    { input: "Bar", expected: "Hello Bar" },
  ],
  task: (input) => "Hi " + input,
  scores: [LevenshteinScorer],
});

Run it:

BRAINTRUST_API_KEY=<YOUR_API_KEY> npx braintrust eval tutorial.eval.ts

Packages

Package	Purpose	npm	Docs
braintrust	Core JavaScript/TypeScript SDK for logging, tracing, evals, and CLI.		js/README.md
@braintrust/browser	Browser-focused SDK integration with AsyncLocalStorage polyfill support.		integrations/browser-js/README.md
@braintrust/langchain-js	Deprecated; use the LangChain integration in braintrust instead.		integrations/langchain-js/README.md
@braintrust/openai-agents	Deprecated; use the OpenAI Agents integration in braintrust instead.		integrations/openai-agents-js/README.md
@braintrust/otel	OpenTelemetry span processor and compatibility helpers for Braintrust tracing.		integrations/otel-js/README.md
@braintrust/temporal	Temporal client/worker plugin and workflow interceptors for Braintrust tracing.		integrations/temporal-js/README.md

CLI bt

The bt cli is installed alongside braintrust, use it with npx bt or pnpm exec bt. See the documentation.

Documentation

• Publishing packages: PUBLISHING.md
• TypeScript SDK docs: https://www.braintrust.dev/docs/reference/sdks/typescript
• Release notes: https://www.braintrust.dev/docs/reference/release-notes

License

Apache-2.0

Repository History

This repository was previously named braintrust-sdk and was renamed to braintrust-sdk-javascript. The rename happened when Python SDK code was split out of this repository. The Python code now lives in a dedicated Braintrust Python SDK repository.

Contributors

Thanks to everyone who contributed to the Braintrust JavaScript SDK!