head-to-head

OpenAI: GPT Mini Latest vs Google: Gemma 4 31B (free)

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.

OpenAI: GPT Mini Latest Google: Gemma 4 31B (free)
Vendor~openaigoogle
Quality Score100100
Benchmark Score-53.7
Input Price$0.75/MFree
Output Price$4.50/MFree
Context Window400,000262,144
Max Output128,00032,768
Tool Calling✓✓
Structured Output✓✓
Reasoning Mode✓✓
Vision✓✓
Audio--
Benchmark Scores
ai_index-48.4
ai_index_agentic-23.8
ai_index_coding-71.7
eqbench-57.5

The verdict

For a sample job of 1 million input tokens and 250,000 output tokens, Gemma 4 31B (free) costs $0 and GPT Mini Latest costs $1.88, so Gemma 4 31B (free) is free for the same work.

GPT Mini Latest reads up to 400,000 tokens at once, roughly 600 pages of text, against about 393 pages for Gemma 4 31B (free).

Only Gemma 4 31B (free) offers video input.

Across the 20 tasks where they differ, Gemma 4 31B (free) on 20 (SQL Generation, Code Review, Code Completion and others).

Pick GPT Mini Latest if you need long documents; pick Gemma 4 31B (free) if you need lower cost, video input or the stronger all-round task scores.

Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.

Who wins by task?

TaskOpenAI: GPT Mini LatestGoogle: Gemma 4 31B (free)
SQL Generation 133 156
Code Review 132 152
Code Completion 130 131
Code Refactoring 136 151
Bug Fixing 136 160
Unit Test Generation 124 143
Code Documentation 130 137
Regex Writing 119 131
CI/CD Pipelines 120 135
Frontend Component Design 122 138
Data Analysis 124 152
CSV / Spreadsheet Cleanup 133 145
ETL Scripting 128 143
JSON Extraction 130 143
Bulk Data Labeling 128 133
OCR / Document Parsing 131 140
Table Extraction from PDFs 131 140
Long-Document Summarization 137 149
Short-Form Summarization 123 129
Blog Post Writing 121 133

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemma 4 31B (free) Anthropic: Claude Haiku Latest vs OpenAI: GPT Mini Latest Anthropic: Claude Sonnet 5 vs Google: Gemma 4 31B (free) Anthropic: Claude Sonnet 5 vs OpenAI: GPT Mini Latest Anthropic: Claude Sonnet Latest vs Google: Gemma 4 31B (free) Google: Gemini 3.1 Flash Lite vs Google: Gemma 4 31B (free) Google: Gemini 3.1 Flash Lite vs OpenAI: GPT Mini Latest Google: Gemini 3.5 Flash Lite vs Google: Gemma 4 31B (free)

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.