Interactive Element Extraction And Coordinate Mapping

[NAACL2025] LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications

Unique: Provides dual targeting methods (coordinates + DOM selectors) with automatic fallback, enabling robust element interaction even when page layout changes or coordinate-based targeting fails

vs others: More reliable than coordinate-only targeting (which breaks on layout changes) and more flexible than selector-only approaches (which fail on dynamic elements)