head-to-head
Mistral: Mistral Medium 3.5 vs Google: Gemma 4 26B A4B (free)
Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-08-03.
| Mistral: Mistral Medium 3.5 | Google: Gemma 4 26B A4B (free) | |
|---|---|---|
| Vendor | mistralai | |
| Quality Score | 100 | 100 |
| Benchmark Score | 52.5 | 51.8 |
| Input Price | $1.50/M | Free |
| Output Price | $7.50/M | Free |
| Context Window | 262,144 | 262,144 |
| Max Output | - | 32,768 |
| Tool Calling | ✓ | ✓ |
| Structured Output | ✓ | ✓ |
| Reasoning Mode | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Audio | - | - |
| Benchmark Scores | ||
| ai_index | 49.4 | 42.4 |
| ai_index_agentic | 31.3 | 18.1 |
| ai_index_coding | 77.4 | 64.9 |
| eqbench | - | 70.0 |
Who wins by task?
| Task | Mistral: Mistral Medium 3.5 | Google: Gemma 4 26B A4B (free) |
|---|---|---|
| SQL Generation | 153 | 154 |
| Code Review | 147 | 151 |
| Code Completion | 116 | 132 |
| Code Refactoring | 144 | 150 |
| Bug Fixing | 155 | 158 |
| Unit Test Generation | 140 | 141 |
| Code Documentation | 131 | 137 |
| Regex Writing | 128 | 130 |
| CI/CD Pipelines | 132 | 134 |
| Frontend Component Design | 137 | 137 |
| Data Analysis | 151 | 149 |
| CSV / Spreadsheet Cleanup | 142 | 144 |
| ETL Scripting | 138 | 142 |
| JSON Extraction | 134 | 142 |
| Bulk Data Labeling | 123 | 133 |
| OCR / Document Parsing | 139 | 139 |
| Table Extraction from PDFs | 139 | 139 |
| Long-Document Summarization | 141 | 149 |
| Short-Form Summarization | 119 | 129 |
| Blog Post Writing | 129 | 132 |
Scores reflect capability match + benchmark data + pricing for each task. Methodology →
Related comparisons
Thinking Machines: Inkling Small vs Mistral: Mistral Medium 3.5
Thinking Machines: Inkling Small vs Google: Gemma 4 26B A4B (free)
Qwen: Qwen3.7 Flash vs Mistral: Mistral Medium 3.5
Qwen: Qwen3.7 Flash vs Google: Gemma 4 26B A4B (free)
Google: Gemini 3.6 Flash vs Mistral: Mistral Medium 3.5
Google: Gemini 3.6 Flash vs Google: Gemma 4 26B A4B (free)
Google: Gemini 3.5 Flash Lite vs Mistral: Mistral Medium 3.5
Google: Gemini 3.5 Flash Lite vs Google: Gemma 4 26B A4B (free)