Use this skill for generative video editing, text-to-video, image-referenced video generation, first-frame-to-video, first-and-last-frame transitions, and video extensions using Gemini Omni 1.1 Flash (gemini-omni-1.1-flash) via the official google-genai SDK. Includes workflows for pre-processing/opt

Gemini Omni Flash Skill This skill uses the Gemini Omni 1.1 Flash model ( gemini omni 1.1 flash ) to perform text to video generation, image to video generation (first frame and last frame transitions), video extensions (up to 40s), and video editing. [!WARNING] Important Regional Restrictions : Uploading videos to use for video edits or extensions is NOT available in the EEA, Switzerland, the United Kingdom, and some US states. If a video to video edit completes quickly with empty outputs ( total output tokens: 0 or no video content), it is likely due to this restriction. Core capabilities 1. Text to video : Generating videos from a text prompt. 2. First frame to video : Generating videos from a starting image ( first frame ). 3. First and last frame transition : Generating videos interpolating between a starting image and a final image ( first frame and last frame ; note: last frame must be used with first frame ). 4. Video extensions : Extending existing videos by up to 10 seconds per turn, up to a total length of 40 seconds ( extend or previous interaction id ). 5. Video editing and refinement : Editing existing videos (maximum duration 10 seconds), applying stylistic changes, or performing inpainting/outpainting. 6. Image and video referenced generation : Using style, character, or object references from images or videos to guide video generation. Workflow 1. Analyze request : Determine the target task (e.g., first frame to video, first and last frame transition, video extension, reference guided editing) and identify any input media assets. 2. Run SDK scripts : Directly run the appropriate utility ( scripts/video/generate video.py or scripts/upload file.py ). Configure settings like aspect ratio (e.g. 16:9 , 9:16 ), resolution ( 360p , 720p , 1080p , 4k ; default: 720p ), and duration (any integer between 3 and 10 seconds, e.g. 3 , 5 , 10 ). Note: 4k requests take longer to generate. 3. Retrieve and process output : Outputs are saved to the local filesystem (e.g. media/ ). Report back the completed media path to the user. Reference Documentation Interactions API : All operations and state management for the Gemini Omni 1.1 Flash model ( gemini omni 1.1 flash ) are handled via the [Interactions API](https://ai.google.dev/gemini api/docs/interactions overview). Files API : Input media files (such as reference images and videos) must be uploaded via the [Files API](https://ai.google.dev/gemini api/docs/files) first before being referenced in generations. The uploaded file URI and MIME type are then included in the interactions.create input parts array. [Gemini API Skill Reference](https://github.com/google gemini/gemini skills/blob/main/skills/gemini api dev/SKILL.md) : Platform wide guidelines, current model specifications, and SDK usage rules for the Gemini API. Dependencies and Prerequisites Python SDK ( google genai ) : Requires google genai = 2.19.0 (Python) to support the interactions client and full video output resolution configuration ( 360p , 720p , 1080p , 4k ). Install or upgrade using: Python Runtime : Requires Python = 3.10 (for compatibility with modern google genai SDK types and methods). ffmpeg & ffprobe : prep video.py , inspect video.py , and generate video.py (when stripping audio via strip audio ) require ffmpeg and ffprobe binaries installed and available in your system PATH . API Key : Set the GEMINI API KEY environment variable: Available scripts Use the following Python scripts to upload media with the Files API, prepare input videos with ffmpeg, and generate video outputs using the Interactions API. 1. [upload file.py](scripts/upload file.py) : Uploads local media (images and videos) to the Files API and polls until ACTIVE . If uploading a video larger than 25MB, it prints an informative warning/tip highlighting that Gemini Omni Flash is optimized for editing 10s videos at 720p/24fps, and recommends pre processing with prep video.py first to speed up the upload. 2. [generate video.py](scripts/video/generate video.py) : Performs end to end video generation and downloads the output video. It detects and uploads local media references (images or videos) before calling the Interactions API. Large video assets ( 25MB) will trigger informative pre processing recommendations without blocking the upload. Text to video : Output resolution options ( resolution ) : Gemini Omni 1.1 Flash natively supports four output resolutions across both landscape ( 16:9 ) and portrait ( 9:16 ) aspect ratios: 360p : 640x360 (16:9) or 360x640 (9:16) 720p : 1280x720 (16:9) or 720x1280 (9:16) — (default) 1080p : 1920x1080 (16:9) or 1080x1920 (9:16) 4k : 3840x2160 (16:9) or 2160x3840 (9:16) Configurable request timeouts ( timeout ) : Default HTTP timeout is 600 seconds (10 minutes). For computationally intensive requests — such as extending a 30s video in 4K by 10s (up to the maximum 40s total video length) — generation can take several minutes. Use timeout 900 (or 1200 ) to provide an extended execution budget. First frame to video : First and last frame transition : Provide a starting frame and an ending frame to generate a smooth transition between them (note: last frame must be used together with first frame ): Looping video (identical start and end frame) : Image referenced video generation : Video referenced video generation : Provide one or more reference videos ( video reference / vr ) to guide character, object, or motion style (ideal duration is ~3s, up to 3 reference videos recommended): Video extension (extend an existing video) : Extend an existing video by up to 10 seconds (total duration up to 40 seconds): Video extension with reference images and reference videos : Prompt based extension allows passing reference images and reference videos simultaneously: Video editing (keep original audio) : Video editing (regenerate all audio from scratch) : Turn by turn video editing (edit previous interaction) : Edit a prior video generation without re uploading assets by passing the interaction ID: Turn by turn video extension (extend previous interaction) : Extend a prior video generation by passing the previous interaction ID: Parallel batch execution (prompts file) : Run multiple prompts from a line by line text file concurrently: Parallel batch execution (JSON config) : Execute fully configured, distinct generation and editing jobs in parallel: Example jobs.json : 3. [inspect video.py](scripts/video/inspect video.py) : Inspects a local video file (using ffprobe ) to check its duration, resolution, frame rate (FPS), audio stream presence, and format details. To get a pre parsed, structured JSON summary: To get the complete, unmodified ffprobe raw JSON dump: 4. [prep video.py](scripts/video/prep video.py) : Normalizes, trims, and formats any video file to fit standard Gemini Omni Flash generation and editing limits. It handles timecode based trimming, optional frame rate conversion, and proportional scaling of large videos (max 1280x720 for landscape, 720x1280 for portrait) to optimize upload times without stretching. If the video is longer than 10 seconds and the script is run interactively (in a TTY), it prompts the user to select the first 10s, last 10s, or enter a custom timecode (defaulting to the first 10s). Trim first 10s (default) : or explicitly specify the start and duration: Trim last 10s (automatically calculates starting point based on source length): Trim 10s starting at specific timecode (MM:SS or HH:MM:SS): Custom frame rate and resolution : Strip audio for audio regeneration : Audio handling in video editing When editing a source video that contains audio, you must choose between keeping the original audio or regenerating all audio from scratch. Keep original audio : By default, Gemini Omni Flash preserves the existing audio layer (though it may modify or adapt it slightly during generation). Use this when the original background music, dialogue, or sound effects are desired. Regenerate all audio from scratch : If you want Gemini Omni Flash to re create a brand new audio layer tailored to the new visual style or prompt, you must upload the video with its audio stream stripped out. If any audio stream is present, Gemini Omni Flash will attempt to preserve/modify it instead of starting from scratch. Use strip audio (or a ) when pre processing with scripts/video/prep video.py or executing scripts/video/generate video.py . This forces Gemini Omni Flash to perform full audio generation. Prompting Gemini Omni Flash Single scene By default Gemini Omni Flash will try to create a video with a few different shots. It'll attempt to craft an interesting narrative based on the prompt. If you need the output video to contain a single scene, you must prompt for that: In a single unbroken scene In a single continuous shot No scene cuts For example: Removing unwanted elements If the generated video contains things you don't want, include simple negative prompts to avoid them: No dialogue No embellishments No extra sound effects Prompts for editing Simple prompts work best for video editing. Overly descriptive prompts can lead to unintended changes. The following are more examples of simple editing prompts: Make this video anime Put a fashionable hat on this person Change the lighting to be more dramatic Change the text on the sign to say "Omni Flash" When editing a specific aspect of the video, include "Keep everything else the same" to maintain visual consistency. The following are some examples to show how to apply this technique: Avoid: In the video of the man sitting on the sofa, please add a small black cat that runs from the right side of the screen, jumps onto his lap, and then he starts to stroke its head while looking down. Simplify: Add a cat that jumps onto his lap, he begins to pet it. Keep everything else the same. Avoid: Please remove the cell phone that the person is holding in their hand and fill in the background so it looks like they are just holding their hand empty. Simplify: Make the phone invisible. Keep everything else the same. Prompting the audio By default the model will try to generate an appropriate audio track for a video. This might not always be what you want. You can use your prompt to describe the type of audio you want. This is especially important if you want music in your video: Include calm background music The video has a high energy techno beat The audio is a low tinny radio broadcast in the background, playing a song Timing events You can prompt for things to happen at specific times in the video, there is no precise syntax needed and you can use natural language. This is especially useful in creating your own scene cuts, rhythm or rapid fire sequences. See the following for examples: After 3 seconds, a woman enters the scene. At 5s the chorus starts in the background audio. Every 2s cut to a new frame. In a rapid fire sequence, every half a second (12 frames at 24fps) change the scene to a new location. You can also use a timecode syntax: Meta prompting You can ask Gemini Omni Flash to pay attention to general qualities or principles of video generation: Consider micro detail, expression and timing to create a very rich, detailed but entirely natural sce

gemini-omni-flash-api