Membrane Demo

The simplest way to start using Membrane is via Boombox - see examples. This repo contains examples of using Membrane directly.

In the subdirectories of this repository you can find the following examples of using Membrane:

Basics

• simple_element - an example of a simple Membrane's element capable of counting the incoming buffers
• simple_pipeline - an example of a Membrane's pipeline playing an mp3 file
• messages_source_and_sink - send and receive media from the pipeline via Elixir messages
• playing_mp3_file - play an mp3 file in a Livebook cell

Audio

• mix_audio - script that mixes two audio tracks into a single AAC file
• audio_mixer - mix a beep sound into background music
• soundwave - plot live audio amplitude on a graph

Streaming protocols

• camera_to_hls - a demonstration of capturing camera output and converting it to an HLS stream
• camera_to_hls_nerves - a demonstration of capturing video from a camera module on Raspberry Pi running Nerves and broadcasting it to a browser via HLS
• rtmp - send and receive RTMP stream
• rtmp_to_hls - receiving RTMP stream and broadcasting it via HLS
• rtmp_to_adaptive_hls - receiving RTMP stream and broadcasting via multi-bitrate adaptive HLS
• rtp - sending and receiving RTP/SRTP stream
• rtp_to_hls - receiving RTP stream and broadcasting it via HLS
• rtsp_to_hls - receiving RTSP stream and converting it to HLS
• webrtc_live_view - send and receive WebRTC streams from a Phoenix LiveView app

AI

• openai_realtime_with_membrane_webrtc - conversation with AI via browser using OpenAI Realtime API
• speech_to_text - real-time speech recognition using Whisper
• style_transfer - real-time neural style transfer on a camera stream
• talk_with_gemini - low-latency voice conversation with Google's Gemini Live API
• whisper - real-time audio transcription with OpenAI's Whisper via Bumblebee
• yolo - real-time object detection on video with YOLO

Many of the demos use Livebook - install it to run them.

Authors

Membrane Framework is created by Software Mansion.

Since 2012 Software Mansion is a software agency with experience in building web and mobile apps as well as complex multimedia solutions. We are Core React Native Contributors and experts in live streaming and broadcasting technologies. We can help you build your next dream product – Hire us.

Copyright 2024, Software Mansion

Licensed under the Apache License, Version 2.0