Incremental Sync With Cursor Based Pagination And Change Detection

via “incremental sync with cursor-based pagination and change detection”

Open-source context retrieval layer for AI agents

Unique: Implements cursor-based incremental sync with source-specific change detection, stored in PostgreSQL for durability. Cursor tracking enables efficient syncs by fetching only new/changed entities, reducing API calls and processing time.

vs others: Cursor-based incremental sync is more efficient than full re-indexing on every sync, and source-specific cursor handling is more flexible than generic timestamp-based approaches