Live verification: September 20, 2026

September 20, 2026 ยท View on GitHub

Fetched 180 recent warning/error log entries from Loki. Reduced them to reviewed diagnostic templates before sending anything to Jev: generated source labels, no real hosts, addresses, paths, image digests, headers, or credentials. Unrelated entries were excluded.

The retained snapshot had 156 entries across seven sources. It was served through a local Loki-format HTTP endpoint so all three runs saw identical input. The CLI used the real TypeSafe SDK and API; jev-latest resolved to jev-1.13.0.

RunAPI callsInput tokensElapsed
Empty cache78,7891.005 s
Warm cache000.010 s
Cache disabled78,7891.009 s

All runs exited successfully with no batch errors. Warm-cache decisions matched the cold run exactly. Uncached decision labels also matched:

  • Endpoint deprecation: suppress.
  • RSS 304 responses: watch.
  • Registry lookup, image-signature, release-schema, scrape-configuration, and notification-delivery failures: notify.

These are observed model judgments, not verified accuracy labels. Each time is one in-process CLI invocation, excluding initial log capture and Python startup. This is an operation check, not a general performance benchmark. Nothing was remediated or notified externally.

Public sample

logtriage/fixtures/observed.json contains 16 representative lines, with duplicates capped at two. Diagnostic status codes and timeout values are retained; identifying context is not. The private raw capture was deleted. The reduced fixture is not enough to reproduce the exact timing or count-dependent judgments above.

The offline batching tests load both this fixture and the original demo. They do not call Jev or assert model predictions. To inspect the additional sample locally:

from logtriage.batch import build_batches, demo_fixture_path, load_demo_streams

streams = load_demo_streams(demo_fixture_path().with_name("observed.json"))
batches = build_batches(streams)

For repeatable cold/warm/uncached timing with the original bundled demo, use scripts/bench-cache.sh.