Spotify is testing a new feature that utilizes artificial intelligence (AI) to translate audio content into different languages, enhancing accessibility for global listeners, this feature allows audio content to be translated into additional languages with the original voice of the content creator.
Spotify collaborated with a select group of podcasters as part of this experimental program, the goal was to create AI-driven voice translations in languages such as Spanish, French, and German for specific podcast episodes.
This tool developed by Spotify leverages OpenAI’s Whisper, which is capable of transcribing English speech and translating it into other languages.
However, Spotify’s approach goes beyond mere text translation, it translates audio content into a different language and reproduces it in the voice of the original content creator.
This approach results in a more realistic, personable, and natural listening experience compared to traditional dubbing, translated episodes with AI-driven voiceovers are now available worldwide through Spotify’s platform.
The rollout began with Spanish translations and will expand to include French and German translations in the coming weeks.
In a statement, Spotify mentioned, “By matching the voice of the creator, voice translation gives listeners all over the world the ability to discover new podcasters and be inspired by them in a more realistic way.
We believe that a thoughtful approach to artificial intelligence helps build deeper connections between listeners and creators, which is essential to our mission of empowering human creativity.”
As of now, Spotify boasts over 100 million listeners for audio streaming worldwide, with more than 5 million audio streaming titles available in over 170 markets.
The company has seen substantial growth in the American audio streaming market from Q4 2022 to Q2 2023.
In June 2023, the company restructured its audio streaming division, resulting in the layoffs of 200 employees. Sahar Habashi, Spotify’s VP and Head of Audio Streaming, mentioned in a memo to employees that the company would focus more on partnerships with leading audio streaming providers worldwide.
Despite these changes, Spotify continues to organize a portfolio of original content, with recent and upcoming releases.
