Integrations

May 14, 2026 ยท View on GitHub

This folder contains example scripts that integrate third-party tools and SDKs with the Metaculus forecasting bot template.

Install

Integration dependencies are in an optional poetry group. Install them with:

poetry install --with integrations

Available integrations

LightningRod SDK

main_lightningrod_eval.py - Uses the LightningRod SDK to generate forecasting questions from news.

The Lightning Rod SDK is a Python library for generating custom forecasting datasets. It transforms real-world data sources into labeled forecasting samples automatically, using built-in integrations like Google News, or your own documents.

The output is an exportable dataset you can use to benchmark LLMs, or train on to improve calibration and sharpen reasoning. The SDK covers the full pipeline: ingesting sources, generating questions, labeling questions, and scoring against real outcomes.

Data generation pipelines are fully customizable: including date ranges, question format (e.g. binary, multiple choice), and custom instructions to shape the output.

Create an account at lightningrod.ai and explore the SDK examples to get started. Check the LightningRod site or reach out to them for any promotions available to the Metaculus community.

  1. Get a LIGHTNINGROD_API_KEY at dashboard.lightningrod.ai
  2. Add it to your .env file
  3. Run:
poetry run python integrations/main_lightningrod_eval.py

Add your own

Have a tool or SDK that could help with forecasting? Add it here and open a PR!