Sequential Text Conditioned Generation With Semantic Continuation

via “sequence-to-sequence-text-generation-with-visual-conditioning”

image-to-text model by undefined. 1,63,419 downloads.

Unique: Implements a document-aware transformer decoder with cross-attention to visual embeddings, enabling it to generate structured text (JSON, markdown) that respects document layout and field relationships rather than treating text generation as a generic language modeling task

vs others: More layout-aware than standard OCR+LLM pipelines because it jointly models vision and language, and faster than multi-stage approaches because it generates structured output directly without requiring separate parsing or post-processing steps