Project Statistics And Code Metrics Generation

via “structured evaluation metrics and reporting”

AI coding agent benchmark — real GitHub issues, end-to-end evaluation, the standard for code agents.

Unique: Provides both structured (JSON) and human-readable reporting formats, enabling both programmatic analysis for research and interpretable summaries for communication. Includes per-instance details for debugging while also supporting aggregate statistics for comparison.

vs others: More comprehensive than simple pass/fail counts because it includes detailed logs and per-instance breakdowns, and more accessible than raw data because it provides both structured and human-readable formats for different audiences.