Staff Research Scientist · Google DeepMind

Yulia Rubanova

Video generationControllabilityPersonalisationPhysical reasoning

I am a researcher at Google DeepMind, working on video generative models in GenAI. I work on pre-training for Gemini Omni, a frontier multimodal model released at Google I/O 2026. I focus on new capabilities and controls like reference images, audio, and editing.

Before Omni, I worked on Veo, including ingredient-to-video and Veo 3.1, building controllable video systems for character consistency, creative production, robotics evaluation, and physical world understanding.

I finished my PhD at the University of Toronto with Prof. Quaid Morris and David Duvenaud. I did multiple internships at Google Brain, including projects on discrete-variable RL for protein design and similarity networks for cancer prediction.

Research vision

Controllability, physical realism and runtime efficiency are crucial next steps for video world models. A leap in controllability is required to turn these models into reliable reasoning tools for real-world applications like robotics and will drive wider adoption of these models.

Core Projects

Gemini Omni multimodal video generation preview

Google I/O 2026

Gemini Omni

A native multimodal generation model for creating and editing video from any multimodal inputs like images, video, audio or text.

On Gemini Omni, I worked on large-scale pre-training for new reference-driven capabilities, including image and audio conditioning, spanning data generation, training, inference, and evaluation.

Veo 3.1 Ingredients to Video visual

Google I/O 2025

Veo Ingredient-to-Video

Ingredient-driven video generation that preserves identity, motion, and intent.

I was a core contributor to building Veo Ingredients from the ground up, enabling videos to be conditioned on ingredient images of characters, scenes, objects, textures, lighting, style, and more. I then co-led bringing this capability to Veo 3 and Veo 3.1, where the challenge was extending character consistency to videos with sound, including speaking characters, for the first time.

Selected work

2025 · Veo world simulator

Evaluating Gemini Robotics Policies in a Veo World Simulator

Shows Veo can become a scalable robotics evaluation environment, predicting policy rankings, out-of-distribution failures, and safety issues across 1600+ real-world trials.

Gemini Robotics Team, Coline Devin, Yilun Du, Debidatta Dwibedi, Ruiqi Gao, Abhishek Jindal, Thomas Kipf, Sean Kirmani, Fangchen Liu, Anirudha Majumdar, Andrew Marmon, Carolina Parada, Yulia Rubanova, Dhruv Shah, Vikas Sindhwani, Jie Tan, Fei Xia, Ted Xiao, Sherry Yang, Wenhao Yu, Allan Zhou

arXiv preprint, December 2025 PaperProject page

Direct Motion Models good example preview

2025 · Video evaluation

Direct Motion Models for Assessing Generated Videos

Gives video teams a motion-sensitive evaluation tool that detects temporal failures missed by FVD and localizes where generated videos go wrong.

Kelsey Allen, Carl Doersch, Guangyao Zhou, Mohammed Suhail, Danny Driess, Ignacio Rocco, Yulia Rubanova, Thomas Kipf, Mehdi S. M. Sajjadi, Kevin Murphy, Joao Carreira, Sjoerd van Steenkiste

arXiv preprint, April 2025 PaperProject page

Visual Particle Dynamics preview

2024 · RGB-D dynamics

Learning 3D Particle-based Simulators from RGB-D Videos

Learns editable 3D dynamics directly from observation, bridging video understanding and simulation without privileged physical state.

William F. Whitney, Tatiana Lopez-Guevara, Tobias Pfaff, Yulia Rubanova, Thomas Kipf, Kimberly Stachenfeld, Kelsey R. Allen

ICLR 2024 PaperProject page

Constraint-based graph network simulator preview

2022 · Learned simulation

Constraint-based graph network simulator

Uses learned constraints and test-time optimization to combine neural simulation with ideas from traditional physics solvers.

Yulia Rubanova, Alvaro Sanchez-Gonzalez, Tobias Pfaff, Peter Battaglia

ICML 2022 PaperProject page

Neural ODE preview

2018 · Neural ODE

Neural Ordinary Differential Equations

NeurIPS Best Paper Award winner that introduced continuous-depth neural models and helped establish differentiable dynamics as a foundation for modern ML systems.

Ricky T. Q. Chen, Yulia Rubanova, Jesse Bettencourt, David Duvenaud

NeurIPS 2018 Best paper award PaperCode