Jev Research

September 20, 2026 · View on GitHub

Jev Research · Evidence & Reproduction

Follow the claim. Inspect the evidence. Replay the result.

Research: Empirical_study Evidence: Frozen_archive

Manuscript · Claim map · Graph research · Reproduction


A research package connecting a Jev decision study with source-bound graph-synthesis experiments. It includes manuscript drafts, recorded model responses, methods, figures, and executable verification.

Paired effects in the recorded Jev decision study

What the original study found

TaskHeld-out evidenceInterpretation
Entity matching413 DBLP–ACM pairs; macro-F1 0.9605 → 0.9859; false merges 8 → 2A narrow improvement on the fixed split, with one additional missed match
Relation verification339 SciFact examples; paired macro-F1 interval includes zeroNo resolved improvement

The intervention combines question formulation and demonstrations. These findings do not establish general model superiority or independently attribute the effect to either component. See the methods and submission-readiness checklist.

Choose a reading path

GoalStart here
Read the original decision studyManuscript and tables
Audit an empirical claimClaim-to-evidence map and frozen run
Explore graph synthesisExtension guide, illustrated paper, and figure gallery
Understand data provenanceSource and data notes
Inspect the original packageArchival README and reproduction notes

Reproduce and verify

From the repository root, use Python 3.12 and an isolated environment:

python -m pip install -r graph_synthesis/requirements-verification.txt
python -B scripts/download_datasets.py
python -B -m graph_synthesis.verify --replay --tests

Dependency installation and the pinned dataset download need network access. The subsequent replay and original tests use a temporary runtime with network connections blocked and make no live model calls. The extension guide explains cross-platform numerical tolerances and further experiments.

Use the extension verifier for this expanded repository. The original scripts/verify_package.py expects the original closed inventory and rejects the additional extension files.

Archive integrity

This GitHub landing page is separate from the original root README: that file and the baseline MANIFEST.json are immutable inputs to the research verifier. The archived evidence remains byte-exact.

Public datasets are downloaded and hash-checked on demand. Dataset rights, attribution, and research limitations remain documented in the source supplement; this landing page grants no additional license.