Speech to speech translation (S2ST)

April 12, 2022 ยท View on GitHub

We provide the implementation and resources for the following work on speech-to-speech translation (S2ST):

  • Direct speech-to-speech translation with discrete units (Lee et al. 2021)
  • Textless Speech-to-Speech Translation on Real Data (Lee et al. 2021)
  • Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentation