Mandala
Tools

Speech-to-Text

Convert speech to text using AI

Usage Instructions

Transcribe audio and video files to text using leading AI providers. Supports multiple languages, timestamps, and speaker diarization.

Tools

stt_whisper

Transcribe audio to text using OpenAI Whisper

Input

ParameterTypeRequiredDescription
providerstringYesSTT provider (whisper)
apiKeystringYesOpenAI API key
modelstringNoWhisper model to use (default: whisper-1)
audioFilefileNoAudio or video file to transcribe
audioFileReferencefileNoReference to audio/video file from previous blocks
audioUrlstringNoURL to audio or video file
languagestringNoLanguage code (e.g., "en", "es", "fr") or "auto" for auto-detection
timestampsstringNoTimestamp granularity: none, sentence, or word
translateToEnglishbooleanNoTranslate audio to English
promptstringNoOptional text to guide the model's style or continue a previous audio segment. Helps with proper nouns and context.
temperaturenumberNoSampling temperature between 0 and 1. Higher values make output more random, lower values more focused and deterministic.

Output

ParameterTypeDescription
transcriptstringFull transcribed text
segmentsarrayTimestamped segments
languagestringDetected or specified language
durationnumberAudio duration in seconds

stt_deepgram

Transcribe audio to text using Deepgram

Input

ParameterTypeRequiredDescription
providerstringYesSTT provider (deepgram)
apiKeystringYesDeepgram API key
modelstringNoDeepgram model to use (nova-3, nova-2, whisper-large, etc.)
audioFilefileNoAudio or video file to transcribe
audioFileReferencefileNoReference to audio/video file from previous blocks
audioUrlstringNoURL to audio or video file
languagestringNoLanguage code (e.g., "en", "es", "fr") or "auto" for auto-detection
timestampsstringNoTimestamp granularity: none, sentence, or word
diarizationbooleanNoEnable speaker diarization

Output

ParameterTypeDescription
transcriptstringFull transcribed text
segmentsarrayTimestamped segments with speaker labels
languagestringDetected or specified language
durationnumberAudio duration in seconds
confidencenumberOverall confidence score

stt_elevenlabs

Transcribe audio to text using ElevenLabs

Input

ParameterTypeRequiredDescription
providerstringYesSTT provider (elevenlabs)
apiKeystringYesElevenLabs API key
modelstringNoElevenLabs model to use (scribe_v1, scribe_v1_experimental)
audioFilefileNoAudio or video file to transcribe
audioFileReferencefileNoReference to audio/video file from previous blocks
audioUrlstringNoURL to audio or video file
languagestringNoLanguage code (e.g., "en", "es", "fr") or "auto" for auto-detection
timestampsstringNoTimestamp granularity: none, sentence, or word

Output

ParameterTypeDescription
transcriptstringFull transcribed text
segmentsarrayTimestamped segments
languagestringDetected or specified language
durationnumberAudio duration in seconds
confidencenumberOverall confidence score

stt_assemblyai

Transcribe audio to text using AssemblyAI with advanced NLP features

Input

ParameterTypeRequiredDescription
providerstringYesSTT provider (assemblyai)
apiKeystringYesAssemblyAI API key
modelstringNoAssemblyAI model to use (default: best)
audioFilefileNoAudio or video file to transcribe
audioFileReferencefileNoReference to audio/video file from previous blocks
audioUrlstringNoURL to audio or video file
languagestringNoLanguage code (e.g., "en", "es", "fr") or "auto" for auto-detection
timestampsstringNoTimestamp granularity: none, sentence, or word
diarizationbooleanNoEnable speaker diarization
sentimentbooleanNoEnable sentiment analysis
entityDetectionbooleanNoEnable entity detection
piiRedactionbooleanNoEnable PII redaction
summarizationbooleanNoEnable automatic summarization

Output

ParameterTypeDescription
transcriptstringFull transcribed text
segmentsarrayTimestamped segments with speaker labels
languagestringDetected or specified language
durationnumberAudio duration in seconds
confidencenumberOverall confidence score
sentimentarraySentiment analysis results
entitiesarrayDetected entities
summarystringAuto-generated summary

stt_gemini

Transcribe audio to text using Google Gemini with multimodal capabilities

Input

ParameterTypeRequiredDescription
providerstringYesSTT provider (gemini)
apiKeystringYesGoogle API key
modelstringNoGemini model to use (default: gemini-2.5-flash)
audioFilefileNoAudio or video file to transcribe
audioFileReferencefileNoReference to audio/video file from previous blocks
audioUrlstringNoURL to audio or video file
languagestringNoLanguage code (e.g., "en", "es", "fr") or "auto" for auto-detection
timestampsstringNoTimestamp granularity: none, sentence, or word

Output

ParameterTypeDescription
transcriptstringFull transcribed text
segmentsarrayTimestamped segments
languagestringDetected or specified language
durationnumberAudio duration in seconds
confidencenumberOverall confidence score

Notes

  • Category: tools
  • Type: stt
Speech-to-Text