V-IRL: Grounding Virtual Intelligence in Real Life

Jihan Yang¹, Runyu Ding¹, Ellis Brown², Xiaojuan Qi¹, Saining Xie²,

¹The University of Hong Kong  ²New York University

project page | arXiv

Changelog

• [2024-04-18] NEW!! Release code for benchmark along with installation & curation & evaluation guideline.

• [2024-04-09] NEW!! Release code for agents and installation & deployment & running guideline.

• [2024-02-06] Release basic platform code.

Release Checklist

• Basic Platform Code
• Agents
  • Peng
  • Aria
  • Vivek
  • RX-399
  • Imani
  • Hiro
  • Ling
  • Local
  • Diego
• Benchmarks
• Install & Deployment guideline
• Platform Document

Installation

Please refer to INSTALL.md for installation of V-IRL

Getting Started

Please refer to GETTING_STARTED.md to learn more usage about this project.

FQA

Please refer to FQA.md to learn solution for some potential issues.

Citation

If you find this project useful in your research, please consider cite:

@inproceedings{yang2024virl,
  title={V-irl: Grounding virtual intelligence in real life},
  author={Yang, Jihan and Ding, Runyu and Brown, Ellis and Qi, Xiaojuan and Xie, Saining},
  booktitle={European conference on computer vision},
  year={2024}
}