Track4Gen: Teaching Video Diffusion Models to Track Points
Improves Video Generation

Hyeonho Jeong^1,2 Chun-Hao P. Huang¹ Jong Chul Ye² Niloy J. Mitra^1,3 Duygu Ceylan¹

¹Adobe Research ²KAIST ³UCL

Please click on other pages to see more results

Page 1 • Page 2 • Page 3 • Page 4

Raw Feature Comparison on Video Tracking

Track4Gen vs Stable Video Diffusion (I2V) vs ZeroScope (T2V)

Track4Gen

Stable Video Diffusion

ZeroScope

Extending Track4Gen with Test-time Adaptation

We integrate Track4Gen features with test-time adaptation algorithm of DINO-Tracker.

Visualization of the Optimization Progress

Optimize