VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches
via In-Context Conditioning

Demo Video

Hover on the video to see corresponding text prompts

Condition

Generated Video

Frame 0

Frame 40

Frame 80

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

Condition

Generated Video

Frame 0

Frame 52

Frame 104

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

Condition

Generated Video

Frame 20

Frame 60

Frame 120

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

Condition

Generated Video

Frame 40

Frame 80

Frame 120

Frame 156

A blue airplane roars at high speed over the vast ocean, slices between towering ice glaciers, hurtles through a narrow canyon with cliffs on both sides, and finally streaks into the heart of a bustling city filled with skyscrapers.

More AnyP2V Showcases

Here we show our application on any-timestamp patches to video with arbitrary spatial layout frames

Condition

Generated Video

Frame 0

Frame 60

Frame 140

A red-and-white car drives from a forest road to a seaside highway and finally into a snowy forest.

Condition

Generated Video

Frame 0

Frame 40

Frame 76

A continuous high-speed journey. The camera rushes past the first hiker on a frozen lake, then soars over the mountains. It dives down to find the second hiker on a forest trail. Without stopping, the camera then rockets upwards and over another mountain range, finally landing behind the third hiker on a triumphant peak.

Condition

Generated Video

Frame 0

Frame 80

Frame 156

In a single, unbroken shot, the camera starts with a head-on view of a yellow Le Mans prototype race car speeding down a winding, sunlit forest road. The camera tracks it smoothly, and as the car takes a corner, the lush green scenery is replaced by a stark, snow-covered woodland. Continuing to follow the car, the camera pans to a side-profile view, and as the car emerges from the snowy trees, its path opens directly onto a breathtaking coastal highway, with blue ocean waves crashing against the rocky shore.

Condition

Generated Video

Frame 16

Frame 80

Frame 140

Witness the Aston Martin Valkyrie AMR Pro defy all seasons. From serene autumn forests and calm coastlines to snow-covered landscapes, it conquers every terrain. A seamless journey through nature's wonders, powered by pure engineering artistry.

Condition

Generated Video

Frame 0

Frame 76

A kangaroo takes a powerful leap. In a magical mid-air transformation, its form seamlessly morphs into a fluffy white golden retriever. As it descends, the dry field below simultaneously transforms into a lush green lawn, where the dog lands gracefully. A seamless, photorealistic evolution.

Condition

Generated Video

Frame 0

Frame 76

A seamless in-motion morph: A cheetah sprints across grass. Its spotted fur blurs, body reshapes, and legs extend into wheels. Mid-run, it transforms into a racing car, now parked in a stadium, with the savannah background dissolving into a racetrack.

Condition

Generated Video

Frame 0

Frame 76

A continuous shot follows a snipe as it takes flight from a shore. In mid-air, the bird and its natural surroundings seamlessly morph. The snipe transforms into a person on a motorcycle, while the coastline evolves into a quaint city street. The shot ends following the motorcycle. Photorealistic.

Condition

Generated Video

Frame 40

Frame 76

A seamless shot pushes forward into the bright halo of a lightbulb. The intense glow dissolves, acting as a transition. The camera emerges from this light into the darkness of a vast cave tunnel, revealing the brightly lit entrance far behind. Cinematic, photorealistic.

Condition

Generated Video

Frame 0

Frame 76

A continuous shot: An elderly man walks right past an old house. As he moves, the house dissolves, morphing into a modern café, and his form shifts to another walker.

Condition

Generated Video

Frame 0

Frame 76

A seamless, in-motion morph. A yellow VW van drives towards the camera, leaving a rocky path. As it transitions onto a paved forest road, its boxy frame fluidly reshapes, the yellow paint melting into vibrant red. The transformation completes as it speeds past, now a sleek Alfa Romeo.

More AnyI2V Showcases

Here we show our application on any-timestamp images to video with full images, including I2V, FLF2V and other flexible AnyI2V tasks

Condition

Generated Video

Frame 0

a young woman with long brown hair, ruffled by the breeze, standing outdoors near a creek. She is holding a bunch of purple flowers, which are gently falling from her grasp, and wearing a dress adorned with floral patterns. The sunlight appears to be shining on her, casting a warm glow on her face and hair. The creek flows slowly in the background, creating a soothing and peaceful atmosphere.

Condition

Generated Video

Frame 40

three people glide down a snowy slope. The camera captures a bird's-eye view of the scene, showing the skiers' figures moving smoothly across the snow-covered terrain. The mountains rise up in the background, their peaks and ridges stretching upwards towards the sky. The skiers are wearing protective gear, including helmets and goggles, and are using ski poles to aid in their descent.

Condition

Generated Video

Frame 76

a person, possibly an astronaut, standing in front of a vibrant and colorful background. The background appears to be a representation of space, with stars, planets, and other celestial bodies. The astronaut is wearing a suit that seems to be technologically advanced, with various lights and details. The suit also appears to have a reflective surface, which is reflecting the colors of the background. As the camera zooms out, the astronaut begins to fly deep into the starry sky, the suit's reflective surface glistening as it moves further away from the colorful background.

Condition

Generated Video

Frame 0

Frame 40

Frame 76

A lone tree stands on rocks. The camera zooms, branches glow, morphing to a burning object. Then, the object erupts, turning to a volcano. Seamless transitions.

Condition

Generated Video

Frame 0

Frame 40

Frame 76

A continuous tracking shot follows the jet trail. The camera drifts past, leaving the trail, and glides to the soaring eagle. Moving further, it exits the sky, revealing a white rabbit on green grass, each transition driven by smooth motion.

Condition

Generated Video

Frame 0

Frame 76

A seamless, single-shot camera push travels through a child's open closet. As the camera moves forward, the interior partitions dissolve, revealing a vast city street. The camera emerges into the bustling nightscape, the closet door now a fence overlooking the view.

Condition

Generated Video

Frame 0

Frame 76

The camera follows raindrops streaking down a windowpane. As they flow downwards, the drops converge and morph into a school of tiny, silver fish. The glass window dissolves into a clear, underwater stream, where the fish now swim among weeds. Magical, seamless.

Condition

Generated Video

Frame 0

Frame 76

a young child sitting in the shallow waters of a beach. The child is happily playing in the water, and the camera pans around to capture their joyful expression as they splash and play with the waves. There are droplets of water splashing around them, and the sunlight is reflecting off the water, creating a shimmering effect. In the background, there are rocks and the sea waves crashing, adding to the ambiance of the scene.

Condition

Generated Video

Frame 0

Frame 76

As the camera pans across the cozy interior space, it gradually zooms in on a warm and inviting coffee cup, sitting on a wooden table amidst the rustic ambiance. The amber-colored pendant lights above cast a soft glow, while the potted plants and textured walls create a serene and welcoming atmosphere. The camera's focus is now on the coffee cup, its contents steaming gently, as the natural light pours in from outside, adding to the cozy ambiance.

Condition

Generated Video

Frame 0

Frame 40

A zebra gallops across a green savanna. It leaps powerfully into the air, and in a magical mid-air transformation, its black and white stripes seamlessly morph into the vibrant, colorful patterns of a large, horse-shaped kite floating in a bright blue sky.

Condition

Generated Video

Frame 16

Frame 60

a white Tesla car accelerates, splashing water as it drives on the surface of a lake. The car is positioned near a shoreline with trees in the background, and the sky above is partly cloudy with the sun setting or rising, casting a golden hue on the scene. The camera follows the car as it gains speed, capturing the water splashing and the car's tires leaving a trail of ripples behind it.

More AnyV2V Showcases

Here we show our application on video inpainting, outpainting, transition, extensition and video camera control

This method simulates camera movements by frame-level progressively shifting or scaling the original video content on a spatiotemporal canvas. It unlocks a range of common camera motions, including zoom in/out and panning left, right, up, or down.

Our model enables interactive shot extension without cuts, extending short videos to minute-long durations while maintaining visual consistency. For a seamless loop, we transition the final generated segment back to the initial clip. Unlike simple First-Last frame-looping methods that often cause stuttering due to mismatched motion, our approach uses the last clip's motion information to ensure a smooth, consistent, and truly seamless loop.

The diagram above demonstrates how we can extend the narrative from an initial Sora video by interactively providing text prompts. The complete extended looping video is presented below:

Method Comparison