head-to-head
Google: Gemma 4 31B (free) vs OpenAI: GPT-5.4 Mini
Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-09-23.
| Google: Gemma 4 31B (free) | OpenAI: GPT-5.4 Mini | |
|---|---|---|
| Vendor | openai | |
| Quality Score | 100 | 100 |
| Benchmark Score | 53.7 | 37.7 |
| Input Price | Free | $0.75/M |
| Output Price | Free | $4.50/M |
| Context Window | 262,144 | 400,000 |
| Max Output | 32,768 | 128,000 |
| Tool Calling | ✓ | ✓ |
| Structured Output | ✓ | ✓ |
| Reasoning Mode | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Audio | - | - |
| Benchmark Scores | ||
| ai_index | 31.3 | 39.7 |
| eqbench | 70.8 | - |
Who wins by task?
| Task | Google: Gemma 4 31B (free) | OpenAI: GPT-5.4 Mini |
|---|---|---|
| SQL Generation | 140 | 138 |
| Code Review | 140 | 139 |
| Code Completion | 132 | 131 |
| Code Refactoring | 141 | 142 |
| Bug Fixing | 144 | 143 |
| Unit Test Generation | 130 | 128 |
| Code Documentation | 135 | 134 |
| Regex Writing | 126 | 122 |
| CI/CD Pipelines | 126 | 124 |
| Frontend Component Design | 128 | 126 |
| Data Analysis | 132 | 130 |
| CSV / Spreadsheet Cleanup | 134 | 135 |
| ETL Scripting | 133 | 133 |
| JSON Extraction | 132 | 130 |
| Bulk Data Labeling | 130 | 128 |
| OCR / Document Parsing | 131 | 133 |
| Table Extraction from PDFs | 131 | 133 |
| Long-Document Summarization | 143 | 143 |
| Short-Form Summarization | 127 | 124 |
| Blog Post Writing | 128 | 126 |
Scores reflect capability match + benchmark data + pricing for each task. Methodology →
Related comparisons
Anthropic: Claude Haiku Latest vs Google: Gemma 4 31B (free)
Anthropic: Claude Haiku Latest vs OpenAI: GPT-5.4 Mini
Anthropic: Claude Sonnet 5 vs Google: Gemma 4 31B (free)
Anthropic: Claude Sonnet 5 vs OpenAI: GPT-5.4 Mini
Anthropic: Claude Sonnet Latest vs Google: Gemma 4 31B (free)
Anthropic: Claude Sonnet Latest vs OpenAI: GPT-5.4 Mini
Google: Gemini 3.1 Flash Lite vs Google: Gemma 4 31B (free)
Google: Gemini 3.1 Flash Lite vs OpenAI: GPT-5.4 Mini