head-to-head

Google: Gemma 4 31B (free) vs Mistral: Mistral Small 4

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-09-23.

Google: Gemma 4 31B (free) Mistral: Mistral Small 4
Vendorgooglemistralai
Quality Score100100
Benchmark Score53.73.8
Input PriceFree$0.15/M
Output PriceFree$0.60/M
Context Window262,144262,144
Max Output32,768209,715
Tool Calling
Structured Output
Reasoning Mode
Vision
Audio--
Benchmark Scores
ai_index31.39.6
eqbench70.8-

Who wins by task?

TaskGoogle: Gemma 4 31B (free)Mistral: Mistral Small 4
SQL Generation 140 132
Code Review 140 128
Code Completion 132 129
Code Refactoring 141 129
Bug Fixing 144 132
Unit Test Generation 130 122
Code Documentation 135 127
Regex Writing 126 120
CI/CD Pipelines 126 118
Frontend Component Design 128 123
Data Analysis 132 125
CSV / Spreadsheet Cleanup 134 128
ETL Scripting 133 123
JSON Extraction 132 131
Bulk Data Labeling 130 129
OCR / Document Parsing 131 128
Table Extraction from PDFs 131 128
Long-Document Summarization 143 131
Short-Form Summarization 127 124
Blog Post Writing 128 120

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemma 4 31B (free) Anthropic: Claude Haiku Latest vs Mistral: Mistral Small 4 Anthropic: Claude Sonnet 5 vs Google: Gemma 4 31B (free) Anthropic: Claude Sonnet 5 vs Mistral: Mistral Small 4 Anthropic: Claude Sonnet Latest vs Google: Gemma 4 31B (free) Anthropic: Claude Sonnet Latest vs Mistral: Mistral Small 4 Google: Gemini 3.1 Flash Lite vs Google: Gemma 4 31B (free) Google: Gemini 3.5 Flash Lite vs Google: Gemma 4 31B (free)

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.