---
title: "MMLU Pro - Benchmark Evaluation - FinanceBenchmark"
description: "Robust multi-task language understanding reasoning benchmark with reasoning-focused questions."
canonical: "https://financebenchmark.ai/benchmarks/mmlu-pro"
type: "text/markdown"
---
# MMLU Pro

> Robust multi-task language understanding reasoning benchmark with reasoning-focused questions.

## Table of Contents
- [1. Specifications & Metadata](#specifications)
- [2. Model Rankings on this Benchmark](#rankings)
- [3. Source Attribution & Citation](#attribution)

## 1. Specifications & Metadata {#specifications}

- **Slug:** `mmlu-pro`
- **Domain Categories:** numerical, verification
- **Composite Weight:** 15 (Tier 2)
- **Task Count:** 12,000 tasks
- **Source / Publisher:** arXiv:2406.01574
- **Research Paper:** [https://arxiv.org/abs/2406.01574](https://arxiv.org/abs/2406.01574)
- **arXiv ID:** [arXiv:2406.01574](https://arxiv.org/abs/2406.01574)

## 2. Model Rankings on this Benchmark {#rankings}

| Rank | Model | Organization | Overall | Eval Date | Source |
|:----:|:------|:-------------|:---:|:---------:|:------:|
| 1 | [Claude Opus 5](https://financebenchmark.ai/models/claude-opus-5.md) | Anthropic | **91.6** | 2026-07 | [Ref](https://vals.ai) |
| 2 | [Claude Fable 5](https://financebenchmark.ai/models/claude-fable-5.md) | Anthropic | **91.5** | 2026-06 | [Ref](https://vals.ai) |
| 3 | [Grok 4.6](https://financebenchmark.ai/models/grok-4-6.md) | xAI | **89.4** | 2026-08 | [Ref](https://vals.ai) |
| 4 | [Grok 4.5](https://financebenchmark.ai/models/grok-4-5.md) | xAI | **89.2** | 2026-07 | [Ref](https://vals.ai) |
| 5 | [GPT-5.6 Sol](https://financebenchmark.ai/models/gpt-5-6-sol.md) | OpenAI | **89.1** | 2026-07 | [Ref](https://vals.ai) |
| 6 | [Muse Spark 1.1](https://financebenchmark.ai/models/muse-spark-1-1.md) | Meta | **88.7** | 2026-07 | [Ref](https://vals.ai) |
| 7 | [Qwen 3.8 Max](https://financebenchmark.ai/models/qwen-3-8-max.md) | Alibaba | **88.6** | 2026-08 | [Ref](https://vals.ai) |
| 8 | [Gemini 3.6 Flash](https://financebenchmark.ai/models/gemini-3-6-flash.md) | Google | **88.5** | 2026-07 | [Ref](https://vals.ai) |
| 9 | [Muse Spark 1.2](https://financebenchmark.ai/models/muse-spark-1-2.md) | Meta | **88.3** | 2026-08 | [Ref](https://vals.ai) |
| 10 | [Kimi K3](https://financebenchmark.ai/models/kimi-k3.md) | Moonshot AI | **88.0** | 2026-07 | [Ref](https://vals.ai) |
| 11 | [Claude Sonnet 5](https://financebenchmark.ai/models/claude-sonnet-5.md) | Anthropic | **87.5** | 2026-06 | [Ref](https://vals.ai) |
| 12 | [DeepSeek V4 Pro (0813)](https://financebenchmark.ai/models/deepseek-v4-pro-0813.md) | DeepSeek | **87.0** | 2026-08 | [Ref](https://vals.ai) |
| 13 | [GLM 5.2](https://financebenchmark.ai/models/glm-5-2.md) | Zhipu AI | **86.7** | 2026-06 | [Ref](https://vals.ai) |
| 14 | [GPT-5.6 Terra](https://financebenchmark.ai/models/gpt-5-6-terra.md) | OpenAI | **86.7** | 2026-07 | [Ref](https://vals.ai) |
| 15 | [Inkling](https://financebenchmark.ai/models/inkling.md) | Thinking Machines | **86.3** | 2026-07 | [Ref](https://vals.ai) |
| 16 | [DeepSeek V4 Flash](https://financebenchmark.ai/models/deepseek-v4-flash.md) | DeepSeek | **86.2** | 2026-07 | [Ref](https://vals.ai) |
| 17 | [GPT-5.6 Luna](https://financebenchmark.ai/models/gpt-5-6-luna.md) | OpenAI | **86.0** | 2026-07 | [Ref](https://vals.ai) |
| 18 | [Gemini 3.5 Flash Lite](https://financebenchmark.ai/models/gemini-3-5-flash-lite.md) | Google | **85.8** | 2026-07 | [Ref](https://vals.ai) |
| 19 | [Nemotron 3 Ultra](https://financebenchmark.ai/models/nemotron-3-ultra.md) | NVIDIA | **85.8** | 2026-06 | [Ref](https://vals.ai) |
| 20 | [Inkling Small](https://financebenchmark.ai/models/inkling-small.md) | Thinking Machines | **85.6** | 2026-07 | [Ref](https://vals.ai) |
| 21 | [Ling 3.0 Flash](https://financebenchmark.ai/models/ling-3-0-flash.md) | Ant Group | **82.0** | 2026-07 | [Ref](https://vals.ai) |

## 3. Source Attribution & Citation {#attribution}

All scores for MMLU Pro are derived directly from published literature or reproducible evaluation harnesses.
To submit updated evaluations, email [submit@financebenchmark.ai](mailto:submit@financebenchmark.ai).