OmniCreator
Self-Supervised Unified Generation with Universal Editing
Applications
Text-guided Video Editing = Reference Video + Editing Prompt
Editing Types
Foreground: "A volcano"
Edited Video
Background: "Dark sky"
Edited Video
Composite: "Dark sky, Game style mountain"
Edited Video
Overall/Style: "Oil painting style"
Edited Video
Editing Scenarios
Weather: "It's snowing"
Edited Video
Time: "At sunset"
Edited Video
Background: "Red background"
Edited Video
Addition: "Fishing boats"
Edited Video
Replacement: "Roses"
Edited Video
Removal: "With no ship"
Edited Video
Appearance: "Tony Stark"
Edited Video
Motion/Pose: "Standing"
Edited Video
Text-to-Video Generation = Target Prompt
16 Frames
"A balloon floating away into the sky on a windy day."
"A robot assembling a car in a futuristic factory."
"A city skyline with fireworks exploding in the sky."
"An eagle flying over the mountains at dawn."
"A man hiking through a dense forest during autumn."
"A time-lapse of a flower blooming in a garden."
"A panda eating bamboo in a serene forest."
"A thunderstorm rolling in over the ocean with lightning strikes."
"A sunset casting long shadows over rolling hills."
"A diver exploring a coral reef underwater."
"A serious forest fire."
"A calm coastline with choppy waves."
32 Frames
"A thunderstorm with lightning striking across the sky."
"A serene forest with a waterfall flowing into a pond."
"A farmer plowing a field with an old tractor."
"A spooky river in the middle of a dense jungle."
64 Frames
"A cat resting on a sunny windowsill."
"A shipwreck under water."
"A sunset over a calm ocean."
"Fireworks exploding in the air."
Text-guided Image Editing = Reference Image + Editing Prompt
Addition: "A canoe"
Edited Image
Replacement: "A red parrot"
Edited Image
Removal: "With no cup"
Edited Image
Background: "A desert"
Edited Image
Style: "Van Gogh style"
Edited Image
Texture: "Crystal texture"
Edited Image
Action: "Flying"
Edited Image
Text-to-Image Generation = Target Prompt
"A serene mountain landscape at dawn, with soft mist covering the peaks and golden sunlight casting long shadows."
"An underwater scene with a vibrant coral reef, colorful fish swimming around, and sunlight filtering from above."
"A small, cozy cabin in the middle of a snowy forest, warm light glowing from its windows under a star-filled sky."
"A sleek, modern kitchen with stainless steel appliances, white marble countertops in natural light."
"A fantasy castle floating above the clouds, surrounded by ethereal light and mysterious mist."
"A beach at sunset, with soft waves lapping against the shore and a palm tree casting a shadow over the sand."
"A young woman with curly hair and a warm smile, standing in a sunflower field under a bright blue sky."
"A vibrant underwater world where buildings bioluminesce and a variety of sea creatures swim through the streets."
"A dramatic canyon landscape with towering rock formations, a winding river below, and a clear blue sky."
"A detailed close-up of an owl perched on a branch in a snowy forest, its feathers fluffed and eyes intense."
"A mystical cave with glowing crystals and an underground lake."
"Desert scene with towering sand dunes and traces of traffic on the sand."
…
