Runtime Neutral Testing Infrastructure With Replay Tests

via “runtime-neutral testing infrastructure with replay tests”

Vibe-Skills is an all-in-one AI skills package. It seamlessly integrates expert-level capabilities and context management into a general-purpose skills package， enabling any AI agent to instantly upgrade its functionality—eliminating the friction of fragmented tools and complex harnesses.

Unique: Provides runtime-neutral testing with replay tests that re-execute recorded execution traces to verify reproducibility. Unlike traditional unit tests, replay tests capture actual execution history and can detect behavior changes across versions. Tests are independent of runtime environment.

vs others: More comprehensive than unit tests alone; replay tests verify reproducibility across versions and can detect subtle behavior changes. Runtime-neutral approach enables testing in any environment without platform-specific test setup.

via “trace replay and validation”

We built meta-agent: an open-source library that automatically and continuously improves agent harnesses from production traces.Point it at an existing agent, a stream of unlabeled production traces, and a small labeled holdout set.An LLM judge scores unlabeled production traces as they stream.A pro

Unique: Validates agent behavior by replaying traces rather than relying on unit tests or manual testing, ensuring that generated harnesses preserve the behavior observed in successful runs

vs others: More comprehensive than traditional unit tests because it validates entire agent execution flows including tool interactions and LLM behavior, not just individual functions

via “workflow testing framework with deterministic execution replay”

Hey HN. Graph Compose is a hosted platform for orchestrating API workflows on Temporal. You define workflows as graphs of nodes (HTTP calls, AI agents, iterators, error boundaries) and everything runs as a durable Temporal workflow under the hood.Three ways to build the same graph: a React Flow visu

Unique: Uses Temporal's deterministic execution model to replay workflows with fixed activity results, enabling true unit testing without test doubles or mocking libraries, and catching non-determinism issues at test time

vs others: Tests workflows in isolation with deterministic replay, whereas generic testing approaches require full Temporal cluster setup or complex mocking of async execution

via “replay-driven agent testing without external tool execution”

Record, replay, and debug MCP tool call sessions

Unique: Implements replay as a transparent mock layer in the MCP protocol stack, allowing agents to run unmodified against recorded tool responses — avoids the need for test-specific agent code or dependency injection frameworks

vs others: Simpler than mocking individual tools because it operates at the MCP protocol level, capturing the full tool call contract rather than requiring per-tool mock definitions

via “deterministic mcp scenario replay with request matching”

CLI tool for running, recording and replaying MCP tool-call scenarios

Unique: Implements replay as a stateful MCP server that validates incoming requests against the recorded scenario schema before returning responses, ensuring that replayed scenarios only match legitimate tool calls rather than accepting arbitrary requests

vs others: More precise than generic HTTP mocking because it understands MCP tool schemas and validates argument types, whereas tools like Nock or Sinon would require manual request matching logic

via “deterministic-test-replay”

via “api-interaction-replay”

via “intelligent game state replay”