Performance Evaluation Via Cpu Instruction Counting With Evalperf Dataset

Enhanced Python coding benchmark with rigorous testing.

Unique: Uses CPU instruction counting via Linux perf counters rather than wall-clock time, enabling reproducible performance evaluation independent of hardware variance. Generates performance-exercising inputs with exponential scaling (2^1 to 2^26) to stress-test algorithmic complexity, and filters tasks based on profile size, compute cost, and coefficient of variation to select representative benchmarks.

vs others: More reproducible than wall-clock timing because instruction counts are hardware-independent; enables fair comparison across different machines and cloud environments. Exponential input scaling reveals algorithmic complexity issues that constant-size inputs would miss, providing deeper insight into code quality.