Chapter 1: Getting Started with Langfuse

April 13, 2026 ยท View on GitHub

Welcome to Chapter 1: Getting Started with Langfuse. In this part of Langfuse Tutorial: LLM Observability, Evaluation, and Prompt Operations, you will build an intuitive mental model first, then move into concrete implementation details and practical production tradeoffs.

Install Langfuse, connect your first app, and capture the first trace.

Overview

Langfuse gives you tracing and analytics for LLM apps. Think of it as the observability layer that sits between your application code and the insights you need to ship reliable AI features. In this chapter you will:

  • Understand how Langfuse fits into your stack.
  • Create a Langfuse project (Cloud or self-host).
  • Install the SDK in Python and TypeScript/JavaScript.
  • Send your first trace with minimal code.
  • Navigate the Langfuse UI with confidence.

How Langfuse Works

Before writing any code, it helps to see the big picture. Langfuse has four main layers:

graph LR
    A[Your App + SDK] -->|HTTPS / Batch| B[Langfuse API]
    B --> C[PostgreSQL Database]
    C --> D[Langfuse Web UI]
    D -->|Dashboards & Traces| E[You / Your Team]

    style A fill:#e0f2fe,stroke:#0284c7
    style B fill:#fef3c7,stroke:#d97706
    style C fill:#f3e8ff,stroke:#9333ea
    style D fill:#dcfce7,stroke:#16a34a
    style E fill:#fce7f3,stroke:#db2777
  1. SDK -- lightweight client in your application that batches events and sends them asynchronously.
  2. API -- ingestion endpoint that validates, enriches, and writes events.
  3. Database -- PostgreSQL stores traces, spans, scores, prompts, and project metadata.
  4. Web UI -- Next.js dashboard where you browse traces, manage prompts, view analytics, and configure evaluations.

Because the SDK sends data asynchronously, your application's latency is virtually unaffected.

Prerequisites

  • Python 3.9+ or Node.js 18+ (examples cover both).
  • A provider API key (OpenAI, Anthropic, etc.) for the LLM your app calls.
  • Langfuse API keys -- a Public Key and a Secret Key -- obtained from the Cloud dashboard or your self-hosted instance.

Option A: Langfuse Cloud (Fastest Start)

The managed cloud service is the quickest way to get going:

  1. Sign up at https://cloud.langfuse.com.
  2. Create a new Project (e.g., "my-chatbot").
  3. Open Settings > API Keys and copy your Public Key (pk-...) and Secret Key (sk-...).
  4. Note your host URL: https://cloud.langfuse.com.

That is all you need. Skip ahead to Install the SDK below.

Option B: Self-Host with Docker Compose

Self-hosting gives you full data control. The minimal setup requires Docker and Docker Compose.

Minimal Docker Compose File

# docker-compose.yml
version: "3.9"
services:
  langfuse:
    image: ghcr.io/langfuse/langfuse:latest
    depends_on:
      - db
    environment:
      - DATABASE_URL=postgresql://langfuse:langfuse@db:5432/langfuse
      - NEXTAUTH_SECRET=change-me-to-a-random-string
      - SALT=change-me-to-another-random-string
      - NEXTAUTH_URL=http://localhost:3000
    ports:
      - "3000:3000"
  db:
    image: postgres:15
    environment:
      - POSTGRES_DB=langfuse
      - POSTGRES_USER=langfuse
      - POSTGRES_PASSWORD=langfuse
    volumes:
      - pgdata:/var/lib/postgresql/data
volumes:
  pgdata: {}

Start everything:

docker compose up -d

Open http://localhost:3000, create your admin account, and generate API keys under Settings > API Keys.

Full Environment Variable Reference

Below is a reference of the most important environment variables you can set on the langfuse container. Only DATABASE_URL, NEXTAUTH_SECRET, and SALT are strictly required.

VariableRequiredDescription
DATABASE_URLYesPostgreSQL connection string.
NEXTAUTH_SECRETYesRandom string used to encrypt session tokens. Generate with openssl rand -base64 32.
SALTYesRandom string used for hashing API keys. Generate with openssl rand -base64 32.
NEXTAUTH_URLRecommendedThe canonical URL of your Langfuse instance (e.g., https://langfuse.mycompany.com).
PORTNoPort the server listens on (default 3000).
LANGFUSE_ENABLE_EXPERIMENTAL_FEATURESNoSet to true to opt into beta features.
SMTP_CONNECTION_URLNoSMTP connection string for email invitations (e.g., smtps://user:pass@smtp.example.com:465).
EMAIL_FROM_ADDRESSNoSender address for emails (e.g., langfuse@mycompany.com).
AUTH_DISABLE_SIGNUPNoSet to true to prevent new user sign-ups after initial setup.
LANGFUSE_DEFAULT_PROJECT_ROLENoDefault role assigned to new project members (ADMIN, MEMBER, VIEWER).
LANGFUSE_LOG_LEVELNoLogging verbosity: debug, info, warn, error.
LANGFUSE_S3_EVENT_UPLOAD_BUCKETNoS3 bucket for large event payloads (optional, for high-volume setups).

Production Hardening Tips

  • Put Langfuse behind a reverse proxy (NGINX / Caddy) with TLS.
  • Use a managed PostgreSQL instance (AWS RDS, Supabase, Neon) for durability.
  • Set AUTH_DISABLE_SIGNUP=true after creating your team accounts.
  • Store secrets (NEXTAUTH_SECRET, SALT, database password) in a vault or secrets manager rather than plain-text environment files.

Install the SDK

Python

pip install langfuse

TypeScript / JavaScript

npm install langfuse
# or
yarn add langfuse
# or
pnpm add langfuse

Environment Setup Best Practices

Rather than hard-coding keys in source files, export them as environment variables. Both SDKs will pick them up automatically.

# .env  (add to .gitignore!)
LANGFUSE_PUBLIC_KEY=pk-lf-...
LANGFUSE_SECRET_KEY=sk-lf-...
LANGFUSE_HOST=https://cloud.langfuse.com   # or http://localhost:3000

In Python, the SDK reads these automatically when you call Langfuse() with no arguments. In Node.js, pass them explicitly or use a library like dotenv:

# Node.js -- load .env at startup
node -r dotenv/config app.js

Key rules to live by:

  • Never commit .env files to version control.
  • Use separate projects (and separate keys) for development, staging, and production.
  • Enable LANGFUSE_DEBUG=true locally to see SDK log output in your terminal.

Your First Trace -- Python

# app.py
import os
from langfuse import Langfuse
from openai import OpenAI

# SDK reads LANGFUSE_PUBLIC_KEY, LANGFUSE_SECRET_KEY, LANGFUSE_HOST from env
langfuse = Langfuse()
client = OpenAI()

# 1. Start a trace
trace = langfuse.trace(name="hello-world")

# 2. Create a span for the LLM call
span = trace.span(name="llm-call", input="Say hi to Langfuse")

# 3. Call your model
resp = client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Introduce Langfuse in one sentence."}],
)

# 4. Record the output
span.end(output=resp.choices[0].message.content)
trace.end()

# 5. Flush to make sure all events are sent before the process exits
langfuse.flush()

print("Trace sent! Check the Langfuse UI.")

Run the script:

python app.py

Your First Trace -- TypeScript / JavaScript

// app.ts
import Langfuse from "langfuse";
import OpenAI from "openai";

const langfuse = new Langfuse({
  publicKey: process.env.LANGFUSE_PUBLIC_KEY!,
  secretKey: process.env.LANGFUSE_SECRET_KEY!,
  baseUrl: process.env.LANGFUSE_HOST ?? "https://cloud.langfuse.com",
});

const openai = new OpenAI();

async function main() {
  // 1. Start a trace
  const trace = langfuse.trace({ name: "hello-world" });

  // 2. Create a span
  const span = trace.span({ name: "llm-call", input: "Say hi to Langfuse" });

  // 3. Call your model
  const resp = await openai.chat.completions.create({
    model: "gpt-4o-mini",
    messages: [{ role: "user", content: "Introduce Langfuse in one sentence." }],
  });

  // 4. Record the output
  span.end({ output: resp.choices[0].message.content });
  trace.update({ output: resp.choices[0].message.content });

  // 5. Flush before exit
  await langfuse.flushAsync();

  console.log("Trace sent! Check the Langfuse UI.");
}

main();

Run with:

npx ts-node app.ts
# or compile and run
npx tsc && node dist/app.js

Understanding the Langfuse UI

Once your first trace arrives, take a few minutes to explore the dashboard. Here are the key areas you will use throughout this tutorial series:

Traces View

The Traces page is your home base. Each row represents one end-to-end request. You can click any trace to drill into its spans, see inputs and outputs, and check attached scores. Use the search bar and tag filters to narrow down results.

Sessions View

If you set a session_id on your traces, Langfuse groups them into Sessions -- handy for multi-turn conversations or user journeys.

Prompts Page

The Prompts page is where you create, version, and label prompts. We will cover this in detail in Chapter 3.

Scores and Evaluation

The Scores tab gives you an overview of all numeric and categorical scores attached to traces. You can filter by score name, time range, and tags.

Settings

Under Settings you manage API keys, team members, project configuration, and integrations.

Quick Navigation Shortcuts

ActionWhere to find it
Search traces by name or tagTraces page -- search bar at top
View a specific user's tracesTraces page -- filter by user_id
Compare prompt versionsPrompts page -- version history sidebar
Check cost and latencyDashboard -- overview charts
Manage API keysSettings > API Keys

Troubleshooting

SymptomLikely CauseFix
401 UnauthorizedWrong keys or host URL; Cloud vs self-host mismatch.Double-check LANGFUSE_PUBLIC_KEY, LANGFUSE_SECRET_KEY, and LANGFUSE_HOST.
No traces visibleEvents not flushed before process exit.Call langfuse.flush() (Python) or await langfuse.flushAsync() (TS).
CORS errors (JS)Secret key exposed in browser code.Always trace from the server side; never send the secret key to the client.
Connection refused (self-host)Container not ready or wrong port mapping.Run docker compose logs langfuse and verify port 3000 is mapped.
Database migration errorsLangfuse version upgraded but DB schema outdated.Langfuse runs migrations automatically on startup. Check logs for errors and ensure your PostgreSQL version is compatible.

What You Learned

  • Langfuse architecture: SDK, API, Database, and UI.
  • How to set up Langfuse via Cloud or Docker Compose with a full environment variable reference.
  • How to install the SDK in both Python and TypeScript.
  • How to send and view your first trace.
  • How to navigate the Langfuse dashboard.

| Previous: Tutorial Overview | Next: Chapter 2 -- Tracing Fundamentals |

Depth Expansion Playbook

Source Code Walkthrough

package.json

The package module in package.json handles a key part of this chapter's functionality:

{
  "name": "langfuse",
  "version": "3.163.0",
  "author": "engineering@langfuse.com",
  "license": "MIT",
  "private": true,
  "engines": {
    "node": "24"
  },
  "scripts": {
    "agents:check": "node scripts/agents/sync-agent-shims.mjs --check",
    "agents:sync": "node scripts/agents/sync-agent-shims.mjs",
    "postinstall": "node -e \"const fs = require('node:fs'); const cp = require('node:child_process'); if (!fs.existsSync('scripts/postinstall.sh')) { console.log('Skipping repo postinstall helper: scripts/postinstall.sh is not present in this install context.'); process.exit(0); } cp.execSync('bash scripts/postinstall.sh', { stdio: 'inherit' });\"",
    "preinstall": "npx only-allow pnpm",
    "infra:dev:up": "docker compose -f ./docker-compose.dev.yml up -d --wait",
    "infra:dev:down": "docker compose -f ./docker-compose.dev.yml down",
    "infra:dev:prune": "docker compose -f ./docker-compose.dev.yml down -v",
    "db:generate": "turbo run db:generate",
    "db:migrate": "turbo run db:migrate",
    "db:seed": "turbo run db:seed",
    "db:seed:examples": "turbo run db:seed:examples",
    "nuke": "bash ./scripts/nuke.sh",
    "dx": "pnpm i && pnpm run infra:dev:prune && pnpm run infra:dev:up --pull always && pnpm --filter=shared run db:reset:test && pnpm --filter=shared run db:reset && pnpm --filter=shared run ch:reset && pnpm --filter=shared run db:seed:examples && pnpm run dev",
    "dx-f": "pnpm i && pnpm run infra:dev:prune && pnpm run infra:dev:up --pull always && pnpm --filter=shared run db:reset:test && pnpm --filter=shared run db:reset -f && SKIP_CONFIRM=1 pnpm --filter=shared run ch:reset && pnpm --filter=shared run db:seed:examples && pnpm run dev",
    "dx:skip-infra": "pnpm i && pnpm --filter=shared run db:reset:test && pnpm --filter=shared run db:reset && pnpm --filter=shared run ch:reset && pnpm --filter=shared run db:seed:examples && pnpm run dev",
    "build": "turbo run build",
    "build:check": "turbo run build:check",
    "typecheck": "turbo run typecheck",
    "tc": "turbo run typecheck",
    "start": "turbo run start",
    "dev": "turbo run dev",
    "dev:worker": "turbo run dev --filter=worker",
    "dev:web": "turbo run dev --filter=web",
    "dev:web-webpack": "turbo run dev --filter=web -- --webpack",
    "lint": "turbo run lint",

This module is important because it defines how Langfuse Tutorial: LLM Observability, Evaluation, and Prompt Operations implements the patterns covered in this chapter.

docker-compose.dev-azure.yml

The docker-compose.dev-azure module in docker-compose.dev-azure.yml handles a key part of this chapter's functionality:

services:
  clickhouse:
    image: docker.io/clickhouse/clickhouse-server:24.3
    user: "101:101"
    environment:
      CLICKHOUSE_DB: default
      CLICKHOUSE_USER: ${CLICKHOUSE_USER:-clickhouse}
      CLICKHOUSE_PASSWORD: ${CLICKHOUSE_PASSWORD:-clickhouse}
    volumes:
      - langfuse_clickhouse_data:/var/lib/clickhouse
      - langfuse_clickhouse_logs:/var/log/clickhouse-server
    ports:
      - "8123:8123"
      - "9000:9000"
    healthcheck:
      test: wget --no-verbose --tries=1 --spider http://localhost:8123/ping || exit 1
      interval: 5s
      timeout: 5s
      retries: 10
      start_period: 1s
    depends_on:
      - postgres

  azurite:
    image: mcr.microsoft.com/azure-storage/azurite
    command: azurite-blob --blobHost 0.0.0.0
    ports:
      - "10000:10000"
    volumes:
      - langfuse_azurite_data:/data

  minio:
    image: cgr.dev/chainguard/minio
    container_name: ${MINIO_CONTAINER_NAME:-langfuse-minio}
    entrypoint: sh

This module is important because it defines how Langfuse Tutorial: LLM Observability, Evaluation, and Prompt Operations implements the patterns covered in this chapter.

docker-compose.yml

The docker-compose module in docker-compose.yml handles a key part of this chapter's functionality:

# Make sure to update the credential placeholders with your own secrets.
# We mark them with # CHANGEME in the file below.
# In addition, we recommend to restrict inbound traffic on the host to langfuse-web (port 3000) and minio (port 9090) only.
# All other components are bound to localhost (127.0.0.1) to only accept connections from the local machine.
# External connections from other machines will not be able to reach these services directly.
services:
  langfuse-worker:
    image: docker.io/langfuse/langfuse-worker:3
    restart: always
    depends_on: &langfuse-depends-on
      postgres:
        condition: service_healthy
      minio:
        condition: service_healthy
      redis:
        condition: service_healthy
      clickhouse:
        condition: service_healthy
    ports:
      - 127.0.0.1:3030:3030
    environment: &langfuse-worker-env
      NEXTAUTH_URL: ${NEXTAUTH_URL:-http://localhost:3000}
      DATABASE_URL: ${DATABASE_URL:-postgresql://postgres:postgres@postgres:5432/postgres} # CHANGEME
      SALT: ${SALT:-mysalt} # CHANGEME
      ENCRYPTION_KEY: ${ENCRYPTION_KEY:-0000000000000000000000000000000000000000000000000000000000000000} # CHANGEME: generate via `openssl rand -hex 32`
      TELEMETRY_ENABLED: ${TELEMETRY_ENABLED:-true}
      LANGFUSE_ENABLE_EXPERIMENTAL_FEATURES: ${LANGFUSE_ENABLE_EXPERIMENTAL_FEATURES:-false}
      CLICKHOUSE_MIGRATION_URL: ${CLICKHOUSE_MIGRATION_URL:-clickhouse://clickhouse:9000}
      CLICKHOUSE_URL: ${CLICKHOUSE_URL:-http://clickhouse:8123}
      CLICKHOUSE_USER: ${CLICKHOUSE_USER:-clickhouse}
      CLICKHOUSE_PASSWORD: ${CLICKHOUSE_PASSWORD:-clickhouse} # CHANGEME
      CLICKHOUSE_CLUSTER_ENABLED: ${CLICKHOUSE_CLUSTER_ENABLED:-false}
      LANGFUSE_USE_AZURE_BLOB: ${LANGFUSE_USE_AZURE_BLOB:-false}
      LANGFUSE_S3_EVENT_UPLOAD_BUCKET: ${LANGFUSE_S3_EVENT_UPLOAD_BUCKET:-langfuse}
      LANGFUSE_S3_EVENT_UPLOAD_REGION: ${LANGFUSE_S3_EVENT_UPLOAD_REGION:-auto}

This module is important because it defines how Langfuse Tutorial: LLM Observability, Evaluation, and Prompt Operations implements the patterns covered in this chapter.

How These Components Connect

flowchart TD
    A[package]
    B[docker-compose.dev-azure]
    C[docker-compose]
    A --> B
    B --> C