Verified record · from the answer index

benchmark-model

Benchmark a model served on MAX with the `max benchmark` command: measure throughput (tokens/sec), latency (TTFT, TPOT, inter-token latency), and GPU utilization by driving load against a running `max serve` endpoint. Use this whenever the

skill:modular/skills/benchmark-model · published by modular · source repository