Benchmark Optimized Performance Across Instruction Following Tasks

via “instruction-tuned-variant-for-chat-and-tasks”

Mistral's mixture-of-experts model with 176B total parameters.

Unique: Instruction-tuned variant achieves 90.8% on GSM8K through explicit training on mathematical reasoning tasks, demonstrating that instruction-tuning improves task-specific performance. This variant is optimized for following user instructions vs the base model's general language modeling.

vs others: Better instruction-following than base model; comparable to GPT-3.5-turbo on chat tasks (specific benchmarks unknown); open-source licensing enables fine-tuning for custom instructions vs closed-source models.