Text & Image to Video Models

Google's state-of-the-art video generation model. Simulates real-world physics with various visual styles.

Google's Veo 3. High-fidelity text-to-video with native audio generation, up to 8s clips.

Google's Veo 3 served via Replicate. Text-to-video with native synchronized audio generation. High-fidelity motion and scene coherence in short clips.

Latest Veo with image-to-video and context-aware audio

Tencent's HunyuanVideo, a 13B open-weights text-to-video diffusion transformer. Produces high-motion, photorealistic clips with smooth temporal consistency and was one of the first open models to rival closed systems on motion quality.

Kuaishou's Kling v2.1, generating 5 and 10 second videos at 720p or 1080p from text or an image. Known for cinematic camera work and realistic physical motion, available on Replicate via the official KwaiVGI account.

Kuaishou's premium Kling v2.1 Master. Generates 1080p 5s and 10s clips from text or an image with strong dynamics and prompt adherence. The top tier of the Kling 2.1 family.

Cinematic video up to 15s with multi-shot and native audio

Most versatile: multi-reference images, video editing, native audio

MiniMax Hailuo 02 on Replicate. Text-to-video and image-to-video producing 6s or 10s clips at 768p standard or 1080p pro. Known for accurate real-world physics and stable motion.

OpenAI's second-generation Sora video model. Realistic motion, improved physics, audio support.

Top-ranked for motion quality and visual fidelity

Runway's Gen-4 Turbo on Replicate. Fast image-to-video generation producing 5s and 10s clips at 720p with strong character and scene consistency across shots.

OpenAI video generation model. Create realistic and imaginative videos from text prompts up to 20 seconds.

Plug-and-play motion module that animates personalized Stable Diffusion models without further training. 16-frame clips at 512x512.

ByteDance distillation of AnimateDiff. 4-step sampling for over 10x faster inference at comparable quality to multi-step base model.

ByteDance's Seedance 1 Pro on Replicate. Text-to-video and image-to-video producing 5s or 10s clips at 480p or 1080p. Strong motion quality and prompt following from the Seedance family.

Champ controllable human image animation. Uses 3D parametric guidance (SMPL) for realistic full-body motion transfer from a single reference image.

CogVideoX-5B from Tsinghua/Zhipu AI, an open 5B-parameter text-to-video diffusion transformer. Generates 6-second 720p clips with coherent motion and is widely used in research for its open weights and reproducibility.

Zhipu/Tsinghua's 5B open text-to-video model. 720x480 @ 8fps, 6s clips, image-to-video variant available.

Tencent DynamiCrafter. Animates still images into short videos preserving texture and structure, with strong open-domain coverage.

Ant Group EchoMimic. Lifelike audio-driven portrait animation with editable landmark conditioning for fine-grained motion control.

Google FILM frame interpolation. Synthesizes high-quality intermediate frames between near-duplicate inputs, designed for large motion gaps.

Faster cheaper Veo 3 with audio

Faster Veo 3.1 with image-to-video and audio

xAI video with native audio and lip-sync, up to 15s

MiniMax's Hailuo video-01. 6s 1280x720 clips with strong cinematic motion and physical realism.

Minimax model for realistic human motion and VFX

Tencent's 13B open-weights video diffusion transformer. SOTA among open video models at release.

Kuaishou's Kling 1.6 Pro. Premium cinematic motion and physics realism, ~$0.07/sec.

Kuaishou's Kling v1.6 Pro on Replicate. Generates 5s and 10s clips in 1080p from text or an image, with cinematic motion and physics realism. The widely used pro tier of the 1.6 generation.

Kuaishou LivePortrait. Efficient portrait animation driven by reference videos with stitching, retargeting and motion-control parameters.

Lightricks' 2B DiT video model. Realtime generation on consumer GPUs (~6s @ H100, 24fps).

Luma's Dream Machine 1.6. 720p text/image-to-video with strong motion and camera control.

Fast affordable video with I2V support

Luma Labs' Ray-2 at 720p on Replicate. Text and image-to-video producing 5s and 9s clips with fast, coherent motion and strong camera control. Successor to Dream Machine.

ByteDance MagicAnimate. Temporally consistent human-image animation driven by a DensePose motion sequence with strong identity preservation.

MiniMax's video generation model. Fast, high-quality video output with text-to-video capabilities.

Genmo's 10B open-weights text-to-video model. AsymmDiT architecture, 5.4s @ 480p.

Genmo's Mochi 1, an open text-to-video model with high-fidelity motion built on a 10B Asymmetric Diffusion Transformer. Released under Apache 2.0, it was the largest open video model at launch and is strong on smooth, physically plausible movement.

Tencent MuseTalk real-time lip-sync model. Audio-driven mouth-region editing in latent space at 30+ fps on a single GPU.

Pika Labs' 2.0 release. Cinematic text/image-to-video with scene composition controls.

Physics-accurate video generation up to 1080p

Real-Time Intermediate Flow Estimation. Doubles or quadruples FPS of an existing video via learned optical-flow-based frame interpolation.

Runway's faster, cheaper Gen-3 variant. Image-to-video at 5 credits/sec (~$0.05/sec).

Stylized audio-driven talking-head generator. Synthesizes 3D motion coefficients from audio to animate a single portrait image with natural head movements.

Budget ByteDance video, fast and cheap

ByteDance video with T2V and I2V, up to 1080p

Picsart StreamingT2V. Generates long, consistent videos by chaining short autoregressive clips with motion and appearance memory.

SwinIR transformer-based super-resolution and denoising applied per-frame to video. Handles classic, real-world and lightweight upscaling.

Tencent ToonCrafter generative cartoon interpolation model. Synthesizes smooth in-between frames between two cartoon keyframes.

Tencent V-Express. Audio-driven portrait animation with progressive training, weak-condition learning, and expressive lip sync.

Tencent VideoCrafter latent video diffusion. Text-to-video and image-to-video generation up to 2s at 1024x576 with strong motion fidelity.

Alibaba's Wan 2.1 open-weights video diffusion model. 14B MoE-based, supports T2V and I2V.

Image-to-video variant of Alibaba's Wan 2.1 14B at 720p, accelerated by WaveSpeedAI. Animates a still input image into a short clip driven by a text prompt, keeping the source composition while adding motion.

Accelerated inference for Alibaba's Wan 2.1 14B text-to-video at 720p, hosted by WaveSpeedAI on Replicate. Open suite of video foundation models with high-resolution output and faster generation.

Ultra-cheap I2V. Upload image and animate it.

Ultra-cheap T2V for pennies

Lip-sync model that re-syncs a target video's lip movement to an arbitrary audio track. Robust to identity and language with a lip-sync discriminator loss.