Image Captioning With Instruction Guided Generation

via “conditional image captioning with text prompt guidance”

image-to-text model by undefined. 14,17,263 downloads.

Unique: Implements soft prompt conditioning through query token concatenation rather than hard constraints, allowing flexible style control without sacrificing visual grounding. Enables zero-shot domain adaptation without fine-tuning.

vs others: More practical than fine-tuning for style adaptation; more flexible than hard constraints like constrained beam search because it allows the model to override the prompt when visual content conflicts with it.