Complex Compositional Instruction Following

via “composition-aware object placement”

Make-A-Scene by Meta is a multimodal generative AI method puts creative control in the hands of people who use it by allowing them to describe and illustrate their vision through both text descriptions and freeform sketches.

Unique: Extracts compositional rules from sketch structure and encodes them as explicit constraints in the diffusion process, rather than treating composition as an emergent property of object placement — enables intentional compositional control

vs others: More compositionally aware than text-only generation because it explicitly analyzes sketch structure; more flexible than hard composition templates because it infers rules from user sketches rather than applying pre-defined patterns