Genie 4 Lets You Rewrite the World Mid-Simulation

Situation report: Google just raised the bar in the world model race.

Google DeepMind released Genie 4 in research preview on Tuesday. According to TechCrunch AI, it’s the company’s most photorealistic and interactive world model yet. You can type prompts in the middle of a simulation to change the scene, and the model generates matching audio in real time. That audio covers music, ambient noise and interactive dialogue.

This matters for one reason. World models are moving from tech demos to tools people can actually steer. Genie 4 is Google’s clearest signal that it plans to lead that shift.

🎯 What’s new in Genie 4

Genie 3 arrived as a research preview a little over a year ago. Here’s what changed since then:

  1. Real-time steering. Free-form edits while the world runs. Change the weather, move the camera, add people or objects.
  2. Native audio. Sound is generated to fit the scene, not bolted on later.
  3. Longer consistency. Scenes hold together for up to two minutes. That’s double Genie 3’s limit.
  4. Better physics and characters. Movement looks more grounded and characters look more humanlike.
  5. Gemini as director. Gemini plans the steps and checks frames while Genie renders the visuals.

That last point stands out to me. Google isn’t treating the world model as a standalone toy. It’s pairing a reasoning model with a simulation engine, with each one doing the job it’s best at.

🤖 The robotics angle

In a research experiment tied to Gemini Robotics, a Gemini 4 Argon model broke tasks into steps. Genie 4 then simulated those steps in real time. The point is to test robot scenarios in simulation before anything happens in the physical world.

Google research director Tejas Kulkarni put the vision plainly:

“What we’ll increasingly see in the future are these hybrid world models, where you have a combination of Gemini writing code and text, and Genie ingesting that in real time and simulating reality at different levels of abstraction.”

This is significant because simulation is the bottleneck for physical AI. Real-world robot testing is slow, expensive and risky. A world model that a reasoning model can direct turns a lot of that testing into a software problem.

🎬 The use case nobody pitched

The official pitch covers gaming, interactive learning and robotics. One speculative example: stepping into a historical painting and chatting with the people in it about the event it shows.

But trusted testers, the people who get early access to Google’s newest tools, are pointing somewhere else. They’re using it to prototype films.

“The real time aspect becomes most valuable in the areas where keeping a state of flow in the creativity space becomes incredibly useful,” said Diego Rivas, a Google DeepMind engineer. He named ideation and storyboarding as examples.

That fits neatly with Google’s existing stack. Veo already makes HD clips with synchronized audio and is catching on with filmmakers. Rivas said users could eventually take Genie prototypes into Gemini Omni, a multimodal model that generates video from images, audio and text, and turn them into finished assets. He was clear that this pipeline is still a ways off.

⚔️ The battlefield

Genie 4 lands in a crowded and consolidating market:

  • Runway shipped GWM Worlds 2 a couple of months ago. It’s a playable world model with audio generation.
  • AMD is acquiring Fei-Fei Li’s World Labs.
  • Amazon is in talks to buy Decart.
  • Rivian acquired Third Dimension to bring simulation for self-driving testing in-house.

The pattern is obvious. Big players want world model capabilities inside their walls, not rented from startups. Google has the advantage of building its own, and of plugging it straight into Gemini.

⚠️ Known weaknesses

Google was upfront about the gaps:

  1. Details and objects drift the longer a simulation runs.
  2. Audio accuracy isn’t solved yet.
  3. Text inside the world isn’t reliably legible.
  4. The end-to-end product experience is still undefined.

Rivas repeatedly called it early days. Take that seriously. Two minutes of consistency is progress, but it’s not long enough for most production work.

📅 Rollout timeline

  • Now: Research preview for trusted testers.
  • Coming weeks: Google AI Ultra subscribers get access through Project Genie, Google’s tool for generating interactive worlds from text or image prompts.
  • Coming weeks: Early access partners on the Gemini API and Google AI Studio.

🧭 What to watch

If you work in game dev, film pre-production or robotics, it’s time to start experimenting. API access is the real milestone. That’s when developers can test whether Genie 4 holds up outside Google’s curated demos.

The bigger story is the hybrid model Kulkarni described: a reasoning model directing a simulator in real time. If that architecture works, world models stop being video generators and start becoming testing grounds for everything from robots to screenplays. Full details are in the original TechCrunch AI report.

Scroll to Top