Computer vision and multimodal learning · MLD-1229
Text-to-speech
Generating spoken audio from text, often with controllable voice or prosody.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Read a chatbot response aloud.
Original caveat
Natural-sounding speech does not establish factual correctness.
Context and aliases
Level: Intermediate. Stages: Architecture · Training · Inference.
Tags: DL · Audio · Multimodal.
Aliases: TTS · Speech synthesis.
Related concepts
Concepts linking here
Technology connections
- faster-whisper — Whisper inference implementation using CTranslate2.
- librosa — Python library for music and audio analysis.
- LiveKit Agents — Framework for realtime voice/multimodal agents.
- Piper — Local neural text-to-speech engine and voice tooling.
- pyannote.audio — Neural speech-processing toolkit including diarization.
- Silero VAD — Voice activity detection models and tooling.
- Whisper — OpenAI speech-recognition model and reference implementation.
- whisper.cpp — C/C++ inference implementation for Whisper models.
Original references
- Learning Transferable Visual Models From Natural Language Supervision ↗ · Consulted
- Deep Learning: online textbook ↗ · Consulted
- PyTorch neural-network layers ↗ · Reference link
- Original reference URL ↗