Install Eval Guardrails

September 20, 2026 ยท View on GitHub

Eval Guardrails is a paid guardrail service at eval.seanbehan.ca. Every installation puts a real hook in front of each tool call, so a dangerous action is evaluated before it executes, not just exposed as an MCP tool the model can ignore.

HarnessInterception seamInstall
OpenCodeplugin tool.execute.beforeeval-jev install opencode
Hermes Agentplugin pre_tool_call hookeval-jev install hermes
DeepSeek Harnessbundle tools/pre-execute listenereval-jev install dsh
Any MCP clientremote/stdio MCP toolsMCP-only fallback (no automatic interception)

Common steps

# 1. sign in and store the API key (or paste an existing eval_ key)
npx -y @codebam/eval-jev-guardrails login

# 2. install the hook for your harness
npx -y @codebam/eval-jev-guardrails install opencode
npx -y @codebam/eval-jev-guardrails install hermes
npx -y @codebam/eval-jev-guardrails install dsh --profile web

# 3. add credits when needed
npx -y @codebam/eval-jev-guardrails buy --pack p5000 --open

# 4. prove the hook is live
npx -y @codebam/eval-jev-guardrails doctor opencode

install prints the files and config it changed. Every command is idempotent; --uninstall reverses an install.

Decision mapping

Jev verdictHook behavior
allowexecute normally
reviewdeny by default (EVAL_REVIEW_MODE=allow to warn and continue)
blockdeny, return the Jev reason to the model
supportdeny, return the Jev reason to the model

One tool call costs one credit. Failed provider calls are refunded by the service. See pricing and the threat model for packs and limits.