What kinds of voices can you create with generative AI?

Let's listen to some examples. 

Hello VU students. Here's a sample from Eleven Labs, where you can choose from many different voices to speak the text that you type. This voice is called Jessica.

Hello VU students. Here's a sample from Eleven Labs, where you can choose from many different voices to speak the text that you type. This voice is called Desmond.

People can clone their own voice and submit it to Eleven Labs, then get paid when someone uses their voice.

Listen to three examples below.

Voice samples from Eleven Labs
Female voice speaking Hindi, male voice with Australian accents, Christy Carlson Romano's voice.

What are some beneficial uses of this technology?

1. Translating content, like videos and podcasts, so creators can reach more people around the world, fluently and in their own voices.
2. Helping patients recover their voice.
   
   A young woman lost her fluent speech due to a vascular brain tumor. A new voice was created for her, based on a recording she made before she lost her speech.
   
   These samples use Open AI's Voice Engine, which is not yet available publicly.

Listen to the patient read this text after losing her fluent speech due to a brain tumor.

Hi everyone! This is what my voice sounds like using Open AI's new text-to-speech model called Voice Engine. I was able to use just 15 seconds of a video I made for a class project to be the reference audio source for the voice you hear right now. What do you think?

Now listen to the patient read this text after using AI to train a model based on a recording she made before she got sick.

Hi everyone! This is what my voice sounds like using Open AI's new text-to-speech model called Voice Engine. I was able to use just 15 seconds of a video I made for a class project to be the reference audio source for the voice you hear right now. What do you think?

What are some unethical uses of this technology?

If someone makes a clone of a person's voice without permission, they could post audio or video content that makes the person say anything. This can be used to spread false information.

Learn more in the upcoming lesson on deepfakes.