This AI Replicates Your Voice in Five Seconds!
Take you lot ever wondered how long it would take for an AI to learn and replicate your phonation? Well, the answer to this question might come as a surprise equally a new AI manages to mimic your voice after listening to it for a mere 5 seconds.
Yes, yous read that right. Researchers at Google accept developed a neural network-based system for text-to-spoken communication (TTS) that manages to replicate the vocalism of speakers, including the ones that were never heard while training the AI of course.
The proposed organization consists of three major components namely a speaker encoder, a synthesizer, and a vocoder. The speaker encoder is trained on a dataset containing speeches of over a g people without transcripts. The synthesizer generates a "mel spectrogram" from the input text.
A vocoder network based on DeepMind'due south WaveNet is implemented in the network to convert the mel spectrograms generated past the synthesizer to waveform samples. Have a look at the overall flow of the system in the below diagram.
The researchers tested this system to decide the naturalness of the generated synthesized speech. For this, they created an evaluation gear up containing 100 phrases that are never used earlier in the preparation set and tested with ii different sets of seen and unseen speakers. The proposed model scored 4.0 Mean Stance Score (MOS) with 95% conviction levels.
Information technology is worth noting that the audio generated by their AI model for unseen speakers sounded as natural as the audio generated for seen speakers – the speakers whose voice has been used during the training phase.
If yous're interested to know how good the synthesized outputs are, listen to the beneath reference vocalism and synthesized outputs.
(Reference Audio)
(Synthesized Audio)
More samples are bachelor here if you're interested to explore more speech samples. To know more about how this organisation works behind the scenes, cheque out the research paper here and let us know your thoughts on it in the comments.
Source: https://beebom.com/ai-mimics-voice-in-5-seconds/
Posted by: shumwayarlither1978.blogspot.com
0 Response to "This AI Replicates Your Voice in Five Seconds!"
Post a Comment