picksbymodel Get API access →
head-to-head

Google: Gemma 4 26B A4B (free) vs OpenAI: GPT-5.4 Mini

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-09-23.

Google: Gemma 4 26B A4B (free) OpenAI: GPT-5.4 Mini
Vendorgoogleopenai
Quality Score100100
Benchmark Score50.937.7
Input PriceFree$0.75/M
Output PriceFree$4.50/M
Context Window262,144400,000
Max Output32,768128,000
Tool Calling✓✓
Structured Output✓✓
Reasoning Mode✓✓
Vision✓✓
Audio--
Benchmark Scores
ai_index27.539.7
eqbench70.0-

Who wins by task?

TaskGoogle: Gemma 4 26B A4B (free)OpenAI: GPT-5.4 Mini
SQL Generation 139 138
Code Review 140 139
Code Completion 131 131
Code Refactoring 141 142
Bug Fixing 144 143
Unit Test Generation 129 128
Code Documentation 134 134
Regex Writing 125 122
CI/CD Pipelines 125 124
Frontend Component Design 128 126
Data Analysis 132 130
CSV / Spreadsheet Cleanup 133 135
ETL Scripting 133 133
JSON Extraction 132 130
Bulk Data Labeling 130 128
OCR / Document Parsing 131 133
Table Extraction from PDFs 131 133
Long-Document Summarization 143 143
Short-Form Summarization 126 124
Blog Post Writing 127 126

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemma 4 26B A4B (free) Anthropic: Claude Haiku Latest vs OpenAI: GPT-5.4 Mini Anthropic: Claude Sonnet 5 vs Google: Gemma 4 26B A4B (free) Anthropic: Claude Sonnet 5 vs OpenAI: GPT-5.4 Mini Anthropic: Claude Sonnet Latest vs Google: Gemma 4 26B A4B (free) Anthropic: Claude Sonnet Latest vs OpenAI: GPT-5.4 Mini Google: Gemini 3.1 Flash Lite vs Google: Gemma 4 26B A4B (free) Google: Gemini 3.1 Flash Lite vs OpenAI: GPT-5.4 Mini

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.