Watch videos with subtitles in your language, upload your videos, create your own subtitles! Click here to learn more on "how to Dotsub"

Neural Translation

0 (0 Likes / 0 Dislikes)
Now, it's a pleasure to be here in Las Vegas to present to you. Now, I get invited to do keynotes across the globe. And while it's easy for me to be here in Las Vegas, it isn't always easy for me to travel across the world. And even when I do I can't always speak the local language. Well, what if neither language nor distance mattered for me to deliver a fantastic keynote?

What if technology could help me be where I needed to be and speak any language I wanted? Well it can. We are bringing the power of mixed reality and Azure AI Services to bring a truly game-changing experience. What you're about to see is an exact hologram of me — wearing this same outfit — that we recently captured at a mixed reality studio. And I don't speak Japanese, but what if I wanted to deliver my keynote in Japanese?

Using Azure AI technology, I can translate my English into Japanese and train it to sound exactly like me. The same voice tones, the same inflections. We brought this together — my hologram and Azure AI — to show you what's possible. So first, I'm going to put on my HoloLens 2 here and then we'll flip in the room — to the special camera — so you can see exactly what I'm seeing. Let's get started. First, let me introduce you to "Mini Me". There she is: my perfect hologram.

And thanks to the power of HoloLens 2, she just floats right with me! I'm literally holding my hologram so natural. Now she's a little too small to do a keynote. So let's get her up so she can do full-sized Japanese keynote. Render keynote. [Applause] Now as you can see, this is mind-blowing technology.

And what you just saw was my life-sized hologram — my exact replica — rendered here in real-time, speaking Japanese with my unique voice signature.

To do this, we used mixed reality technology to create my hologram and render it here live. Then, we used Azure's speech detect capability in English transcription to get my speech. Then, used Azure Translate to get the speech into Japanese— And finally applied neural Text-To-Speech technology so it sounded exactly like me just speaking Japanese. And the most amazing part? All of these technologies exist today. The future is here.

Video Details

Duration: 4 minutes and 2 seconds
Country: Andorra
Language: English
License: Dotsub - Standard License
Genre: None
Views: 12
Posted by: time000 on Feb 14, 2021

Neural Translation

Caption and Translate

    Sign In/Register for Dotsub to translate this video.