head-to-head

Google: Gemma 4 31B (free) vs OpenAI: GPT-5.4 Nano

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.

Google: Gemma 4 31B (free) OpenAI: GPT-5.4 Nano
Vendorgoogleopenai
Quality Score100100
Benchmark Score53.768.1
Input PriceFree$0.20/M
Output PriceFree$1.25/M
Context Window262,144400,000
Max Output32,768128,000
Tool Calling✓✓
Structured Output✓✓
Reasoning Mode✓✓
Vision✓✓
Audio--
Benchmark Scores
ai_index48.463.1
ai_index_agentic23.845.4
ai_index_coding71.792.5
eqbench57.5-

The verdict

For a sample job of 1 million input tokens and 250,000 output tokens, Gemma 4 31B (free) costs $0 and GPT-5.4 Nano costs $0.51, so Gemma 4 31B (free) is free for the same work.

GPT-5.4 Nano reads up to 400,000 tokens at once, roughly 600 pages of text, against about 393 pages for Gemma 4 31B (free).

Only Gemma 4 31B (free) offers video input.

On our blended benchmark score GPT-5.4 Nano leads 68.1 to 53.7.

Across the 20 tasks where they differ, GPT-5.4 Nano on 20 (SQL Generation, Code Review, Code Completion and others).

Gemma 4 31B (free) was released in April 2026 and GPT-5.4 Nano in March 2026.

Pick Gemma 4 31B (free) if you need lower cost or video input; pick GPT-5.4 Nano if you need long documents, benchmark performance or the stronger all-round task scores.

Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.

Who wins by task?

TaskGoogle: Gemma 4 31B (free)OpenAI: GPT-5.4 Nano
SQL Generation 156 163
Code Review 152 158
Code Completion 131 133
Code Refactoring 151 157
Bug Fixing 160 168
Unit Test Generation 143 148
Code Documentation 137 140
Regex Writing 131 132
CI/CD Pipelines 135 139
Frontend Component Design 138 141
Data Analysis 152 159
CSV / Spreadsheet Cleanup 145 151
ETL Scripting 143 148
JSON Extraction 143 146
Bulk Data Labeling 133 134
OCR / Document Parsing 140 144
Table Extraction from PDFs 140 144
Long-Document Summarization 149 154
Short-Form Summarization 129 130
Blog Post Writing 133 135

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemma 4 31B (free) Anthropic: Claude Haiku Latest vs OpenAI: GPT-5.4 Nano Anthropic: Claude Sonnet 5 vs Google: Gemma 4 31B (free) Anthropic: Claude Sonnet 5 vs OpenAI: GPT-5.4 Nano Anthropic: Claude Sonnet Latest vs Google: Gemma 4 31B (free) Anthropic: Claude Sonnet Latest vs OpenAI: GPT-5.4 Nano Google: Gemini 3.1 Flash Lite vs Google: Gemma 4 31B (free) Google: Gemini 3.1 Flash Lite vs OpenAI: GPT-5.4 Nano

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.