Roadmap

August 7, 2024 · View on GitHub

Our roadmap; if an issue has been created or the feature is currently being worked on, please link the respective issue/PR.

Integrations:

  • Messenger platforms

  • Meeting platforms

    • Zoom (dial in)
    • Zoom (native)
    • Google meets
    • Teams

  • Synthesis providers

    • Rime
    • Coqui
    • Coqui (OSS)
    • gTTS
    • StreamElements
    • Bark
    • Play.ht
    • Eleven Labs
    • Cartesia
    • Amazon Polly
    • Resemble.AI

Language Models:

  • LLMs

    • ChatGPT (OpenAI, Azure)
    • GPT-4 (OpenAI)
    • Claude (Anthropic)
    • GPT4All

  • Transcribers

    • AssemblyAI
    • Deepgram
    • Google Cloud
    • Whisper.cpp
    • Azure
    • Whisper
    • RevAI

Conversational Features:

  • Improve filler audio
  • Backchanneling
  • Multi agent functionality
  • New endpointing styles
  • Smoother interruptions
  • Keyword boosting

Actions:

  • ActionType implementations

    • Calendar – look up availability
    • Calendar – make event

  • TBD

Telephony:

  • Integrate with new telephony providers

    • Twilio
    • Vonage

  • Transfer to human

Speech Recognition:

  • Voice isolation (for noisy backgrounds)
  • Echo cancellation (for now, can use krisp or other)
  • Realtime emotion