Mistral: Mistral Medium 3.5 vs Google: Gemma 4 31B (free)
Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.
| Mistral: Mistral Medium 3.5 | Google: Gemma 4 31B (free) | |
|---|---|---|
| Vendor | mistralai | |
| Quality Score | 100 | 100 |
| Benchmark Score | 53.0 | 53.7 |
| Input Price | $1.50/M | Free |
| Output Price | $7.50/M | Free |
| Context Window | 262,144 | 262,144 |
| Max Output | 209,715 | 32,768 |
| Tool Calling | ✓ | ✓ |
| Structured Output | ✓ | ✓ |
| Reasoning Mode | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Audio | - | - |
| Benchmark Scores | ||
| ai_index | 49.4 | 48.4 |
| ai_index_agentic | 31.3 | 23.8 |
| ai_index_coding | 77.4 | 71.7 |
| eqbench | - | 57.5 |
The verdict
For a sample job of 1 million input tokens and 250,000 output tokens, Gemma 4 31B (free) costs $0 and Mistral Medium 3.5 costs $3.38, so Gemma 4 31B (free) is free for the same work.
Both read up to 262,144 tokens at once, roughly 393 pages of text.
Only Gemma 4 31B (free) offers video input.
Across the 20 tasks where they differ, Gemma 4 31B (free) on 20 (SQL Generation, Code Review, Code Completion and others).
Pick Gemma 4 31B (free) if you need lower cost, video input or the stronger all-round task scores.
Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.
Who wins by task?
| Task | Mistral: Mistral Medium 3.5 | Google: Gemma 4 31B (free) |
|---|---|---|
| SQL Generation | 153 | 156 |
| Code Review | 147 | 152 |
| Code Completion | 116 | 131 |
| Code Refactoring | 144 | 151 |
| Bug Fixing | 155 | 160 |
| Unit Test Generation | 140 | 143 |
| Code Documentation | 131 | 137 |
| Regex Writing | 128 | 131 |
| CI/CD Pipelines | 132 | 135 |
| Frontend Component Design | 137 | 138 |
| Data Analysis | 151 | 152 |
| CSV / Spreadsheet Cleanup | 142 | 145 |
| ETL Scripting | 138 | 143 |
| JSON Extraction | 134 | 143 |
| Bulk Data Labeling | 123 | 133 |
| OCR / Document Parsing | 139 | 140 |
| Table Extraction from PDFs | 139 | 140 |
| Long-Document Summarization | 141 | 149 |
| Short-Form Summarization | 119 | 129 |
| Blog Post Writing | 129 | 133 |
Scores reflect capability match + benchmark data + pricing for each task. Methodology →