📌  Introduction

This repository is based on the very good Lightning-Hydra-Template, which is a template for PyTorch Lightning projects with Hydra configuration.

It is the official implementation of the Audio-JEPA: Joint-Embedding Predictive Architecture for Audio Representation Learning paper, presented at ICME 2025.

A checkpoint is available here: .

📌  Running the code

This code uses the uv as the package and project manager. Please refer to the uv documentation for more details on installation.

After cloning the repository, navigate to the project directory (Audio-JEPA) and run the following command:

uv sync

this will install all the dependencies.

To run the pre-training code, you can use the following command:

uv run src/train.py

This will run the training script with the default configuration (on CPU).

If you want to change the configuration, you can either change the configurations files directly in the config folder or use the command line arguments. For more information, check the Hydra documentation.

For example, to run the training script on GPU, logged on WandB, with a specific batch size, and some additional options you could use the following command:

uv run src/train.py logger=wandb trainer=gpu trainer.max_steps=100000 data.batch_size=64 callbacks.model_checkpoint.every_n_train_steps=20000 callbacks.model_checkpoint.save_top_k=-1

By default, training checkpoints are saved in the logs/train/runs/<date> folder. You can change this by modifying the logger configuration in the config folder.

To test the model, please refer to our fork of X-ARES where we added support for Audio-JEPA.

📌  Citation

If you use this work in your research, please consider citing as:

@inproceedings{tuncay2025audio,
  title = {{Audio-JEPA: Joint-Embedding Predictive Architecture for Audio Representation Learning}},
  author = {Tuncay, Ludovic and Labb{\'e}, Etienne and Benetos, Emmanouil and Pellegrini, Thomas},
  booktitle = {ICME 2025},
  address = {Nantes, France},
  year = {2025},
  url = {https://hal.science/hal-05128180}
}