MagicTimeRepository42/100 via “frame extraction and video captioning for dataset creation”
[TPAMI 2025🔥] MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators
Unique: Combines frame extraction with automatic captioning specifically for metamorphic content, generating descriptions that capture transformation semantics (growth rate, material changes, progression) rather than static image descriptions, enabling creation of training data optimized for metamorphic video generation.
vs others: More specialized than generic video-to-dataset tools because it generates captions focused on transformation semantics and temporal progression, whereas general tools produce static image descriptions that miss the temporal and physical aspects critical for training metamorphic models.