wscribe transcribe [OPTIONS] SOURCE DESTINATION

August 6, 2023 ยท View on GitHub

  • wscribe ** Getting started wscribe is yet another easy to use front-end for [[https://github.com/openai/whisper][whisper]] specifically for transcription. It aims to be modular so that it can support multiple audio sources, processing backends and inference interfaces. It can run both on CPU and GPU based on the processing backend. Once transcript is generated, editing/correction/visualization of the transcript can be done manually with the [[https://github.com/geekodour/wscribe-editor][wscribe-editor]].

It was created at [[https://www.sochara.org/][sochara]] because we have a large volume of audio recordings that need to be transcribed and eventually archived. Another important need was that we needed to verify and manually edit the generated transcript, I could not find any open-source tool that checked all the boxes. Suggested workflow is generating word-level transcript(only supported in json export) and then editing the transcript with the [[https://github.com/geekodour/wscribe-editor][wscribe-editor]].

Currently, it supports the following. Check [[#roadmap][roadmap]] for upcoming support.

wscribe transcribe [OPTIONS] SOURCE DESTINATION

cpu

wscribe transcribe audio.mp3 transcription.json

use gpu

wscribe transcribe video.mp4 transcription.json --gpu

use gpu, srt format

wscribe transcribe video.mp4 transcription.srt -g -f srt

use gpu, srt format, tiny model

wscribe transcribe video.mp4 transcription.vtt -g -f vtt -m tiny wscribe transcribe --help # all help info #+end_src ** Numbers

  • These numbers are from machine under normal web-browsing workload running on a single RTX3050
  • Audio conversion takes around 1s
  • Also check [[https://github.com/ggerganov/whisper.cpp/issues/1127][this explanation about the speed difference]]. | device | quant | model | original playback | transcription | playback/transcription | |--------+---------+----------+-------------------+---------------+------------------------| | cuda | float16 | tiny | 6.3m | 0.1m | 68x | | cuda | float16 | small | 6.3m | 0.2m | 29x | | cuda | float16 | medium | 6.3m | 0.4m | 14x | | cuda | float16 | large-v2 | 6.3m | 0.8m | 7x | | cpu | int8 | tiny | 6.3m | 0.2m | 25x | | cpu | int8 | small | 6.3m | 1.3m | 4x | | cpu | int8 | medium | 6.3m | 3.6m | ~1.7x | | cpu | int8 | large-v2 | 6.3m | 3.6m | ~0.9x |

** Roadmap *** Processing Backends