Interpreter

Video Introduction

Overview

This Node-RED flow translates audio recorded by the microphone into a variety of languages directly from the flow itself.

The flow uses the Microphone and Play Audio nodes with the Watson Speech-to-Text, Language Translation and Text-to-Speech to perform the role of an interpreter.

Node-RED will:

• Record audio from the device microphone
• Convert the audio to a string using Speech-to-Text
• Translate the string into a different language using the Language Translation service
• Convert the text response back to spoken word using Text-to-Speech
• Output the resulting audio via the device speakers

Application flow

Link to Flow JSON

Flow description

• microphone clicking the button toggles recording, the node sends a buffer of the recorded audio as the msg.payload object.
• speech to text converts the buffer into text using the Watson Speech-to-Text services.
• set msg.payload moves the string output of speech to text to the msg.payloadobject as required by the subsequent nodes.
• language translation translates the string into a different language using the Language Translation service.
• text to speech converts the string into spoken word using the Watson Text-to-Speech services.
• set msg.payload moves the audio output of the previous node to the msg.payloadobject as required by the subsequent node.
• play audio plays the translated audio buffer from the device's speakers

Gotchas

• The microphone node requires an HTTPS connection