Experiment Comparison Across Metrics And Parameters

via “mechanical metric extraction and validation”

Claude Autoresearch Skill — Autonomous goal-directed iteration for Claude Code. Inspired by Karpathy's autoresearch. Modify → Verify → Keep/Discard → Repeat forever.

Unique: Enforces mechanical (deterministic, numeric) metrics as the sole decision criterion, eliminating subjective judgment from the autonomous loop. Metric extraction is validated during setup and cached to enable fast comparisons, and the system explicitly rejects non-deterministic or multi-objective metrics that would require heuristic decision-making.

Enables fully autonomous decision-making without human judgment by requiring mechanical metrics, whereas most agentic systems rely on heuristic scoring or human feedback.