Models and Benchmarks Environment Set Up

This guide provides environment setup instructions for supported models and benchmarks. Please install the relevant dependencies before running inference and evaluation.

Note: While we follow official specifications from the original repositories, other versions of the dependencies may also be compatible.

Supported Models

• Janus / JanusFlow / Janus-Pro: envs/paper
• Bagel: envs/paper
• Show-o: envs/paper
• OmniGen2: envs/paper
• Flux / Flux-Kontext: paper
• T2I-R1: envs/paper
• QwenImage: envs/paper
• SANA1.5: paper
• HiDream: envs/paper

More models coming soon...

Supported Datasets

• GenEval: envs/paper
• DPGBench: envs/paper
• T2ICompBench: envs/paper
• GenAI-Bench: envs/paper
• GenEval++: paper
• ImagineBench: paper
• OmniContext: paper
• WISE: paper

More datasets coming soon...