hnsw-based approximate nearest neighbor search with configurable recall-latency tradeoff
Implements Hierarchical Navigable Small World (HNSW) graph indexing for sub-linear time complexity nearest neighbor queries across dense vector spaces. The implementation uses a multi-layer graph structure where each layer is a navigable small world graph, enabling efficient approximate search by starting from the top layer and progressively descending. Supports configurable M (max connections per node) and ef (search expansion factor) parameters to tune the recall-latency tradeoff, allowing users to balance query speed against result accuracy without re-indexing.
Unique: Implements HNSW with native support for multiple distance metrics (L2, cosine, dot product, Manhattan) and integrates graph construction into segment lifecycle management, allowing incremental index building during segment optimization rather than requiring full re-indexing on updates
vs alternatives: Faster approximate search than IVF-based methods for high-dimensional vectors (>100D) and supports dynamic insertion without full index rebuild, unlike traditional HNSW implementations that require offline construction
hybrid dense-sparse vector search with combined scoring
Enables simultaneous search across dense vectors (via HNSW) and sparse vectors (via inverted indices) with configurable weighted combination of results. The system maintains separate index structures for dense and sparse vectors within each segment, executes parallel searches, and merges results using a weighted scoring function that combines dense similarity scores with sparse BM25-style relevance scores. This allows semantic search (dense) and keyword matching (sparse) to be unified in a single query without requiring separate round-trips.
Unique: Implements sparse vector search via inverted indices with native integration into the same query pipeline as dense search, allowing single-pass hybrid queries without separate sparse/dense index lookups or post-processing merging
vs alternatives: More efficient than post-hoc result merging from separate dense and sparse indices because filtering and scoring happen in a unified query execution path, reducing latency by 30-50% compared to two-stage retrieval
write-ahead logging with configurable durability guarantees
Implements write-ahead logging (WAL) to ensure data durability and consistency, with configurable fsync policies to balance durability against write latency. Each write operation is logged to disk before being applied to in-memory indices, enabling recovery from crashes without data loss. Fsync policies range from immediate (fsync after every write, highest durability but highest latency) to batched (fsync every N writes, lower latency but higher data loss risk). WAL is used for both point-in-time recovery and segment compaction consistency.
Unique: Implements configurable fsync policies in WAL to allow applications to choose durability vs latency tradeoffs, with automatic recovery using WAL logs to restore to the last committed state without manual intervention
vs alternatives: More flexible than fixed durability guarantees because fsync policies are configurable per deployment, allowing high-latency systems to use immediate fsync while throughput-optimized systems use batched fsync
batch operations with transactional semantics
Supports batch operations (upsert, delete, update) that are applied atomically within a single request, ensuring all operations in the batch succeed or all fail together. Batch operations are processed through the update pipeline and applied to segments in a single transaction, maintaining consistency across multiple point updates. This enables efficient bulk loading and updates without requiring separate requests for each operation.
Unique: Implements batch operations with transactional semantics by processing all operations in a batch through a single update pipeline transaction, ensuring atomicity without requiring distributed transactions across shards
vs alternatives: More efficient than individual point updates because batch processing amortizes overhead across multiple operations, and transactional semantics ensure consistency without requiring client-side retry logic
qdrant edge library for embedded vector search on edge devices
Provides a lightweight embedded library (Qdrant Edge) that runs vector search directly on edge devices (mobile, IoT, embedded systems) without requiring a server connection. The library is a minimal Rust implementation of Qdrant's core search functionality (HNSW search, filtering, quantization) compiled to WebAssembly or native binaries for edge platforms. Edge library supports pre-built indices that are downloaded from the server and cached locally, enabling offline search with periodic synchronization.
Unique: Implements Qdrant Edge as a minimal WebAssembly/native library that includes HNSW search and filtering without server dependency, enabling offline search on edge devices with periodic synchronization
vs alternatives: More capable than simple vector libraries because it includes HNSW indexing and filtering, and more efficient than server-based search because it eliminates network latency
inference service integration for embedding generation
Provides optional inference service integration that generates embeddings from raw text/images using configurable embedding models (e.g., OpenAI, Hugging Face, local models). The inference service is decoupled from the vector database; clients can use it to generate embeddings before inserting into Qdrant, or Qdrant can be configured to call the inference service during upsert operations. This enables end-to-end workflows where raw documents are inserted and embeddings are generated automatically.
Unique: Implements inference service integration as an optional layer that can be enabled per collection, allowing automatic embedding generation during upsert without requiring separate embedding service calls
vs alternatives: More convenient than separate embedding generation because embeddings are generated automatically during upsert, reducing application complexity and enabling end-to-end RAG workflows
payload-based filtering with multiple field index types
Provides structured filtering on document metadata (payloads) using field-specific index types (keyword, integer range, geo-spatial, full-text) that are selected automatically or manually based on field type and query patterns. Each field maintains its own index structure (e.g., B-tree for ranges, inverted index for keywords, R-tree for geo) stored alongside vector indices in segments. Filters are applied during search to prune candidates before distance computation, reducing the search space and improving query latency for selective filters.
Unique: Integrates field indexing directly into segment architecture with automatic index type selection based on field cardinality and query patterns, enabling filters to be applied during HNSW traversal rather than post-search, reducing candidates evaluated by 50-90% for selective filters
vs alternatives: More efficient than post-filtering because index-aware pruning happens during graph traversal, whereas alternatives like Elasticsearch require two-phase search (filter then rank) or separate index lookups
vector quantization with configurable precision loss
Reduces memory footprint and improves search speed by quantizing dense vectors to lower precision (int8, uint8, or binary) while maintaining configurable recall through quantization-aware distance calculations. Supports both product quantization (PQ) and scalar quantization (SQ) approaches, where vectors are decomposed into subspaces or scaled to lower bit-widths. Quantized vectors are stored in segments alongside original vectors (or as the only copy), and distance computations use quantization-aware metrics that account for precision loss.
Unique: Implements both product quantization and scalar quantization with quantization-aware distance metrics that account for precision loss, allowing recall to be maintained within 2-5% of full-precision search while reducing memory by 4-16x
vs alternatives: More flexible than single-method quantization because it supports both PQ (better for high-dimensional vectors) and SQ (simpler, better for low-dimensional vectors), and quantization-aware metrics preserve recall better than naive quantization followed by standard distance computation
+6 more capabilities