Okay, this is a game-changer. 🤯
I’ve been playing with AI video tools, and getting characters to speak anything but English is usually a total headache. But I just stumbled upon an incredible post from Tianyu Xu, and it looks like he’s cracked the code for Google’s Veo 3!
He shared a super simple trick to make your characters speak other languages. I was blown away by how straightforward it is.
Here’s the method Tianyu Xu laid out:
- State the Language: Just tell Veo 3 which language the character is speaking directly in the prompt. (e.g., “…and says in Mandarin:”)
- Write the Script: In the dialogue part of your prompt, use the actual target language.
- Use the API: He notes that you get a higher success rate using the Gemini/Veo API instead of other interfaces.
To prove it, he showed an example where he got a character to recite a tongue twister in Mandarin. So cool!
Now, Tianyu is super transparent and also gave a heads-up on a few known issues:
- Some interfaces (like Flow) might reject prompts with non-Latin alphabets.
- The audio generation can sometimes fail.
- You might get some unexpected accents depending on the prompt’s context.
He also mentioned that he was testing Veo 3’s facial expressions and is pretty happy with his avatar’s acting, which is a great bonus insight.
Seriously, go check out the full post from Tianyu Xu to see the video he created. It’s awesome to see him pushing the limits of what’s possible!