Mathematical Reasoning And Problem Solving

via “arithmetic and mathematical reasoning evaluation”

23 hardest BIG-Bench tasks where models initially failed.

Unique: Focuses specifically on multi-step arithmetic and mathematical reasoning through few-shot examples, isolating numerical reasoning capability from general language understanding. Tasks test both calculation accuracy and mathematical inference patterns.

vs others: More focused on mathematical reasoning than general reasoning benchmarks; more accessible than formal mathematics verification because it uses natural language problem statements rather than symbolic notation.

via “mathematical reasoning over visual data”

Mistral's 124B multimodal model with vision capabilities.

Unique: Achieves 69.4% on MathVista benchmark (outperforming all tested models) through integrated visual parsing and mathematical reasoning in a single 124B model, without requiring separate symbolic math engines or specialized mathematical libraries

vs others: Outperforms GPT-4o, Gemini-1.5 Pro, and Claude-3.5 Sonnet on MathVista while being available for self-hosted deployment, eliminating API dependency for educational or research mathematical analysis

via “mathematical reasoning and step-by-step problem solving”

DeepSeek's 236B MoE model specialized for code.

Unique: Trained on 6 trillion tokens including mathematical reasoning datasets and code-based solutions, enabling both symbolic reasoning and code generation for mathematical problems in a single model without separate math-specific components

vs others: Provides integrated mathematical reasoning and code generation (unlike Copilot which focuses on code) while maintaining open-source weights and supporting local deployment

via “mathematical reasoning and problem-solving”

671B MoE model matching GPT-4o at fraction of training cost.

Unique: Achieves 90.2% on MATH benchmark through MoE architecture that routes mathematical reasoning tokens through specialized expert parameters, enabling efficient scaling of reasoning capability without proportional increase in active parameters per token

vs others: Matches GPT-4o mathematical reasoning performance (90.2% MATH) while using 37B active parameters vs GPT-4o's undisclosed parameter count, reducing inference latency and cost for math-heavy workloads

via “mathematical reasoning with math benchmark performance”

Meta's 70B open model matching 405B-class performance.

Unique: Achieves strong mathematical reasoning performance at 70B parameters through instruction-tuning on mathematical problem-solving datasets, enabling competitive MATH benchmark performance without specialized symbolic reasoning modules

vs others: Provides mathematical reasoning capability comparable to larger closed-source models while remaining open-weight and self-hostable, though without formal verification guarantees of symbolic math systems

via “multi-step mathematical reasoning benchmark evaluation”

8.5K grade school math problems — multi-step reasoning, verifiable solutions, reasoning benchmark.

Unique: Uses linguistically diverse, human-authored grade school problems (not synthetic) that require genuine multi-step reasoning with basic arithmetic, combined with a standardized answer extraction format (#### delimiter) that enables reproducible evaluation across heterogeneous model outputs

vs others: More challenging than simple arithmetic benchmarks (requires 2-8 reasoning steps) yet more accessible than advanced math benchmarks, making it ideal for measuring practical reasoning improvements in production models

via “mathematical problem solving with symbolic reasoning”

Cost-efficient reasoning model with configurable effort levels.

Unique: Implements specialized mathematical reasoning patterns with step-by-step derivation generation, achieving competition-level math performance through domain-specific training rather than general reasoning

vs others: Matches o3 on mathematical benchmarks at lower cost; outperforms standard LLMs (GPT-4, Claude) on competition-level problems due to reasoning-grade capabilities

via “mathematical reasoning and step-by-step problem solving”

text-generation model by undefined. 1,37,84,608 downloads.

Unique: Qwen2.5-7B-Instruct includes explicit training on mathematical reasoning datasets (including GSM8K, MATH, and proprietary datasets) with emphasis on showing intermediate steps and justifying answers. The instruction-tuning includes prompts that encourage the model to 'think step by step' and 'show your work', which are known to improve mathematical reasoning through in-context learning effects.

vs others: Outperforms base Qwen2.5-7B on mathematical reasoning benchmarks by 15-20% due to instruction-tuning; more accessible than specialized math models (like Minerva) for general-purpose deployment

via “mathematical reasoning and logic problem evaluation with specialized scoring”

ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大

Unique: Evaluates mathematical reasoning with 1-5 quality scale for reasoning steps rather than binary correctness, enabling partial credit for correct methodology with computational errors. Combines final answer accuracy with reasoning quality assessment to capture mathematical thinking capability. Includes multi-step reasoning problems and logical inference tasks beyond simple arithmetic.

vs others: More nuanced mathematical assessment than MMLU (binary correctness) and captures reasoning quality vs answer-only evaluation

via “mathematical reasoning and symbolic computation”

Mistral Large — powerful reasoning and instruction-following

via “mathematical-problem-solving-with-symbolic-reasoning”

Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through responses with enhanced accuracy...

Unique: Leverages extended internal reasoning to explore multiple mathematical approaches and verify symbolic manipulations before responding, providing higher confidence in mathematical correctness than models without reasoning capabilities.

vs others: Exceeds GPT-4 and Claude on complex mathematics by using internal reasoning to validate symbolic steps, reducing hallucinated solutions and improving explanation quality for educational use cases.

via “mathematical reasoning evaluation”

UGI-Leaderboard — AI demo on HuggingFace

Unique: Isolates mathematical reasoning as a distinct evaluation dimension on the leaderboard, enabling models to be ranked separately on math vs general generation, revealing capability specialization.

vs others: Simpler than running MATH or GSM8K locally with custom evaluation scripts, but less transparent than open-source math benchmarks regarding problem selection and difficulty.

via “mathematical reasoning and symbolic computation”

This is Mistral AI's flagship model, Mistral Large 2 (version mistral-large-2407). It's a proprietary weights-available model and excels at reasoning, code, JSON, chat, and more. Read the launch announcement [here](https://mistral.ai/news/mistral-large-2407/)....

Unique: Trained on mathematical datasets with chain-of-thought reasoning to prioritize step-by-step problem solving, using attention mechanisms that track variable relationships and equation transformations

vs others: Comparable to GPT-4 on mathematical reasoning, while maintaining lower cost; outperforms Llama 2 on complex multi-step problems due to larger parameter count and specialized training

via “mathematical-reasoning-and-problem-solving”

Hermes 4 70B is a hybrid reasoning model from Nous Research, built on Meta-Llama-3.1-70B. It introduces the same hybrid mode as the larger 405B release, allowing the model to either...

Unique: Trained on mathematical problem datasets with explicit step-by-step annotations, enabling the model to generate intermediate steps that match human problem-solving patterns rather than jumping directly to answers

vs others: More transparent than Wolfram Alpha for showing reasoning steps, though less reliable for advanced mathematics; stronger than GPT-3.5 on symbolic manipulation due to larger parameter count

via “mathematical reasoning and symbolic computation”

GLM 4 32B is a cost-effective foundation language model. It can efficiently perform complex tasks and has significantly enhanced capabilities in tool use, online search, and code-related intelligent tasks. It...

Unique: GLM 4 32B includes specialized training on mathematical reasoning datasets, enabling it to show work and explain reasoning — not just generate answers — which is critical for educational and verification use cases

vs others: More cost-effective than Wolfram Alpha for symbolic reasoning while providing better explanations than calculators, though less precise than dedicated symbolic engines for complex expressions

via “mathematical reasoning and symbolic computation”

Qwen3-Max-Thinking is the flagship reasoning model in the Qwen3 series, designed for high-stakes cognitive tasks that require deep, multi-step reasoning. By significantly scaling model capacity and reinforcement learning compute, it...

Unique: Combines extended reasoning with mathematical domain knowledge to enable transparent, step-by-step mathematical problem-solving. Uses thinking tokens to represent intermediate mathematical steps and verification, making mathematical reasoning auditable and debuggable.

vs others: Provides better mathematical reasoning transparency than general-purpose LLMs while maintaining broader applicability than specialized mathematical AI systems, though with lower precision than dedicated computer algebra systems.

via “mathematical-problem-solving-with-symbolic-reasoning”

ERNIE-4.5-21B-A3B-Thinking is Baidu's upgraded lightweight MoE model, refined to boost reasoning depth and quality for top-tier performance in logical puzzles, math, science, coding, text generation, and expert-level academic benchmarks.

Unique: Combines MoE routing with specialized mathematical token embeddings trained on formal mathematical corpora, enabling the model to recognize and manipulate symbolic structures (equations, proofs) as first-class objects rather than treating them as opaque text sequences.

vs others: Achieves higher accuracy on mathematical benchmarks (AMC, AIME) than GPT-3.5 while using 1/10th the parameters, making it more cost-effective for math-heavy applications; however, still trails specialized symbolic solvers for formal verification

via “mathematical-problem-solving-with-step-by-step-reasoning”

DeepSeek-V3.1 is a large hybrid reasoning model (671B parameters, 37B active) that supports both thinking and non-thinking modes via prompt templates. It extends the DeepSeek-V3 base with a two-phase long-context...

Unique: Implements explicit reasoning phase specifically optimized for mathematical decomposition, allowing the model to verify intermediate steps before producing final answers, rather than generating answers directly.

vs others: More reliable for complex math than GPT-4 due to explicit verification phase, and more transparent than o1 (which hides reasoning) by allowing users to request step-by-step explanations.

via “mathematical reasoning and symbolic problem-solving”

Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and...

Unique: Qwen2.5 series explicitly improves mathematical reasoning capabilities over Qwen2 through enhanced training on mathematical datasets and reasoning patterns; achieves improved performance on MATH and similar benchmarks while maintaining general conversational ability

vs others: More reliable mathematical reasoning than Llama 2 70B; comparable to GPT-3.5 for standard problems but at lower cost; weaker than specialized math models like Minerva but more general-purpose

via “logical reasoning and mathematical problem-solving”

gpt-oss-20b is an open-weight 21B parameter model released by OpenAI under the Apache 2.0 license. It uses a Mixture-of-Experts (MoE) architecture with 3.6B active parameters per forward pass, optimized for...

Unique: MoE routing activates mathematical reasoning experts for symbolic manipulation and logical inference experts for proof generation, enabling efficient handling of different problem types without computing all parameters

vs others: Provides mathematical reasoning quality comparable to larger models while using sparse activation, reducing latency for interactive math tutoring applications