Gemini Omni is where Gemini’s ability to reason meets the ability to create. It delivers a leap in world understanding, multimodality, and editing. Capabilities Performance Safety Showcase Try Gemini Omni Prompt: Make it look like the weird shape of my hand hole super zooms and magnifies the ground it's looking at in sharper quality.Prompt: When the finger in <video> touches the animal toy play the sound the animal makesPrompt: The lights of the apartments start turning on in sync with the music.Input videoPrompt: Transport the violinist to the image environmentPrompt: Make the violin invisiblePrompt: Change the camera angle to be over the violinist’s shoulder.Prompt: Change spaceship to <object>Prompt: A marble rolling fast on a chain reaction style track, continuous smooth shotPrompt: claymation explainer of protein folding, everything is made out of clay, no hands, stop motion, accuratePrompt: A skeuomorphism stop motion explainer about how the brain hippocampus works with a compelling voiceover. Don’t add seahorses. No voice cuts at the end. Don’t add text.Prompt: The video shows items of the alphabet. An unusual item starting with each letter is shown sitting on a table (like a Capybara for C, disco globe for D and Lava Lamp for L). All 26 letters must be represented by 26 items with matching lower thirds displaying the letter. Only one item and lower third at a time. Each lower third must look like a black marker written on a slip of paper in the bottom left. Rapid fire, roughly 9 frames per item at 24FPS. Last frame is a slip of paper "THE END". The whole video is accompanied by calm smooth music.Prompt: word by word, one word on a the screen at a time: did, you, know, that, this, model, can, do, pretty, good, text!? each word appears with a different animated style, perfect pacing to a rhythm, sizzle reelCreating your promptsUse our prompt guide to create realistic, coherent, and creative output.Slide 1 of 5[1] Human raters conducted direct side-by-side comparisons across 504 diverse examples (each including text prompts for editing, evaluating one generated video per example).Editing 3P 10sVideo EditingOmni's Editing capability has achieved leading results for: Overall Preference and Instruction Following in head-to-head comparisons by human raters against other leading video generation models on internal benchmarks [1].Movie Bench Audio T2VA Public BenchmarkText to Video (Overall Preference & Instruction Following)Participants viewed 1,003 prompts and respective videos on MovieGenBench, a benchmark dataset released by Meta. Omni performs best on Overall Preference and Instruction Following.T2V Fast MotionText to Video (Fast Motion)The Fast Motion evaluation dataset consists of 500 detailed text prompts designed to describe a wide variety of sports, athletic performances, and other activities. This dataset serves as a comprehensive benchmark for assessing the ability of AI models to interpret and generate highly dynamic, high-energy physical actions and diverse sporting events.I2V VBenchImage to VideoParticipants viewed 355 image and text pairs from the VBench I2V benchmark, outputs across Gemini Omni Flash, Grok-Imagine-Video, and Kling tied, leading over other models.[1] Human raters conducted direct side-by-side comparisons across 468 diverse examples (each including a mix of images, audio, and text prompts as references, evaluating one generated video per example).I+AR2V Image & AudioReference to VideoOmni's Reference to Video capability has achieved leading results for: Overall Preference and Speech Adherence in head-to-head comparisons by human raters against other leading video generation models on internal benchmarks [1].Training/development evaluations including automated and human evaluations carried out continuously throughout and after the model’s training, to monitor its progress and performanceHuman red teaming conducted by specialist teams who sit outside of the model development team, across the policies and desiderata, deliberately trying to spot weaknesses and ensure the model adheres to safety policies and desired outcomesAutomated red teaming to dynamically evaluate Gemini Omni Flash for safety and security considerations at scale, complementing human red teaming and static evaluationsEthics and safety reviews conducted ahead of the model’s releaseContent created or edited with Omni in the Gemini app, Google Flow or YouTube includes our imperceptible SynthID digital watermark and C2PA Content Credentials. You can easily verify content through the Gemini app and coming soon to Chrome and Search. You can find out more about how we're expanding our content transparency and verification tools to help you understand how content was created and edited across the web in our blog post.GeminiSupercharge your creativity and productivityGoogle FlowAn AI creative studio built with and for creativesYouTube ShortsA shorter way to discover, watch, and create on YouTubeGoogle AI StudioThe fastest path from prompt to productionGemini APIGet started building with cutting-edge AI modelsGoogle Enterprise Agent PlatformBuild, scale, and govern agentsGoogle AI subscription required. Features vary by tier and geography.
Gemini Omni
Article URL: https://deepmind.google/models/gemini-omni/ Comments URL: https://news.ycombinator.com/item?id=48196609 Points: 33 # Comments: 7
Article URL: https://deepmind.google/models/gemini-omni/ Comments URL: https://news.ycombinator.com/item?id=48196609 Points: 33 # Comments: 7
- Article URL: https://deepmind.google/models/gemini-omni/ Comments URL: https://news.ycombinator.com/item?id=48196609 Points: 33 # Comments: 7
What people are saying
Hot takes
Loading takes…
Comments
Discussion · 0
Sign in to comment, like, and save articles.
Sign inLoading comments…

