local-pii-anonymization-before-llm-transmission
Intercepts prompts before they reach LLM APIs and applies pattern-based PII detection and replacement with deterministic tokens (e.g., [PERSON_1], [EMAIL_2]) using configurable regex and NER-style matching rules. The anonymization happens entirely on the client side with zero data transmission to external services, maintaining a local mapping table for later rehydration. Supports multiple PII categories (names, emails, phone numbers, SSNs, credit cards, API keys) with pluggable detection strategies.
Unique: Implements client-side anonymization with zero transmission of raw PII to external services, using deterministic token mapping that enables perfect rehydration without storing plaintext on remote servers. Combines regex-based pattern matching with optional NER integration for context-aware detection, all executed locally before API calls.
vs alternatives: Unlike cloud-based PII masking services (e.g., AWS Macie, Azure Purview) that require uploading data for scanning, rehydra performs all detection and anonymization locally, eliminating the trust boundary problem and reducing latency by avoiding round-trip API calls.
deterministic-pii-rehydration-in-llm-responses
Automatically reverses the anonymization process by mapping anonymized tokens (e.g., [PERSON_1]) back to their original PII values using the locally-stored mapping table generated during the anonymization phase. Uses exact token matching and position-aware replacement to restore context while preserving LLM-generated content. Supports partial rehydration (selectively restore only certain PII categories) and validation to ensure no tokens remain unrehydrated.
Unique: Implements stateful rehydration by maintaining a bidirectional mapping table that tracks which tokens correspond to which PII values, enabling perfect restoration without re-processing the original data. Supports policy-based selective rehydration where different PII categories can be restored conditionally based on downstream access control rules.
vs alternatives: Unlike generic token replacement systems that require manual mapping management, rehydra's rehydration is tightly coupled to its anonymization phase, ensuring consistency and enabling automatic validation. Provides audit trails and selective rehydration policies that generic string replacement tools do not offer.
pii-detection-in-structured-data-and-code
Extends PII detection beyond plain text to structured formats (JSON, XML, CSV) and code (Python, JavaScript, SQL), with format-aware parsing that understands data structure and can anonymize specific fields or values. Detects hardcoded secrets (API keys, database passwords) in code and configuration files. Supports custom field mappings (e.g., 'email' field always contains email PII) to improve detection accuracy in structured data.
Unique: Implements format-aware PII detection that understands the structure of JSON, XML, CSV, and code, enabling field-level anonymization and secret detection. Uses AST parsing for code analysis to detect hardcoded secrets with high accuracy, going beyond simple pattern matching.
vs alternatives: Unlike generic PII detection that treats all input as plain text, rehydra's structured data support preserves format and structure while anonymizing, enabling seamless integration with APIs and databases. Code-aware secret detection is more accurate than regex-based approaches because it understands language syntax.
pii-redaction-with-visual-feedback
Provides visual indicators (highlighting, strikethrough, color coding) in text and structured data to show which parts were anonymized, useful for debugging and validation. Supports multiple visual styles (inline redaction, margin notes, separate redaction report) and can generate side-by-side comparisons of original and anonymized text. Enables interactive redaction review where users can approve or reject individual anonymizations before sending to the LLM.
Unique: Implements multiple visual feedback mechanisms (inline redaction, margin notes, side-by-side comparison) that make anonymization decisions transparent and reviewable, with support for interactive approval workflows. Enables users to understand exactly what was anonymized and why.
vs alternatives: Unlike silent anonymization that provides no visibility, rehydra's visual feedback enables users to review and validate anonymization decisions before sending to the LLM. Interactive approval workflows add a human-in-the-loop layer that increases confidence in PII protection.
multi-provider-llm-integration-with-pii-handling
Provides a unified abstraction layer that wraps LLM provider APIs (OpenAI, Anthropic, Cohere, etc.) with automatic PII anonymization before sending requests and rehydration after receiving responses. Implements provider-agnostic request/response transformation using adapter patterns, allowing the same anonymization logic to work across different LLM APIs without code changes. Handles provider-specific response formats (streaming vs. batch, token counts, function calling) transparently.
Unique: Implements a provider-agnostic adapter pattern that decouples PII anonymization/rehydration logic from provider-specific API details, allowing the same anonymization rules to apply across OpenAI, Anthropic, Cohere, and custom LLM endpoints. Uses composition-based request/response transformation rather than inheritance, enabling easy addition of new providers.
vs alternatives: Unlike LLM routing libraries (LiteLLM, LangChain) that focus on API compatibility, rehydra's multi-provider support is specifically designed to maintain PII protection across providers, ensuring that anonymization policies are consistently applied regardless of which backend is used.
configurable-pii-detection-rules-and-patterns
Allows users to define custom PII detection rules using regex patterns, NER models, or custom Python/JavaScript functions, with support for category-based organization (names, emails, phone numbers, custom types). Rules are composable and can be enabled/disabled per request, supporting both built-in patterns (SSN, credit card, email) and domain-specific patterns (medical record numbers, internal employee IDs). Configuration can be loaded from files (YAML, JSON) or defined programmatically.
Unique: Implements a pluggable rule engine that supports multiple detection backends (regex, NER, custom functions) with a unified interface, allowing users to compose detection strategies without modifying core code. Rules are first-class objects that can be serialized, versioned, and audited, enabling reproducible PII detection across different environments.
vs alternatives: Unlike fixed PII detection libraries (e.g., presidio, better-profanity) that have hardcoded patterns, rehydra's rule engine allows domain-specific customization without forking or extending the library. Configuration-driven approach enables non-developers to adjust detection rules without code changes.
session-based-pii-mapping-persistence
Maintains a session-scoped mapping table that tracks all PII-to-token conversions within a single conversation or workflow, enabling consistent anonymization across multiple prompts and responses. Supports multiple persistence backends (in-memory, file-based, Redis, database) with automatic cleanup and optional encryption of stored mappings. Provides APIs to export, import, and audit the mapping history for compliance and debugging.
Unique: Implements a pluggable persistence layer that decouples mapping storage from the anonymization logic, supporting multiple backends (in-memory, file, Redis, database) with a unified interface. Provides automatic session lifecycle management (creation, cleanup, expiration) and optional encryption, enabling secure long-term storage of PII mappings.
vs alternatives: Unlike simple in-memory caches, rehydra's session persistence supports multiple backends and provides audit trails, making it suitable for production systems with compliance requirements. Encryption support and automatic cleanup distinguish it from generic key-value stores.
streaming-response-anonymization-and-rehydration
Handles streaming LLM responses (e.g., OpenAI's streaming API) by buffering tokens incrementally and applying rehydration on-the-fly as chunks arrive, without waiting for the complete response. Uses a token-aware buffer that detects partial tokens and ensures rehydration happens at token boundaries, maintaining stream semantics while protecting PII. Supports both server-sent events (SSE) and WebSocket streaming protocols.
Unique: Implements a token-aware streaming buffer that detects PII token boundaries and performs rehydration on-the-fly without buffering the entire response, maintaining streaming semantics while ensuring correctness. Uses a state machine to handle partial tokens that span chunk boundaries, enabling reliable rehydration in streaming contexts.
vs alternatives: Unlike naive streaming implementations that buffer the entire response before rehydration, rehydra's streaming rehydration processes chunks incrementally, reducing memory usage and latency. Handles edge cases like tokens spanning chunks, which generic streaming libraries do not address.
+4 more capabilities