head-to-head

Google: Gemma 4 26B A4B (free) vs Google: Gemini 3.1 Pro Preview Custom Tools

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.

Google: Gemma 4 26B A4B (free) Google: Gemini 3.1 Pro Preview Custom Tools
Vendorgooglegoogle
Quality Score100100
Benchmark Score48.4-
Input PriceFree$2.00/M
Output PriceFree$12.00/M
Context Window262,1441,048,576
Max Output32,76865,536
Tool Calling✓✓
Structured Output✓✓
Reasoning Mode✓✓
Vision✓✓
Audio-✓
Benchmark Scores
ai_index42.4-
ai_index_agentic18.1-
ai_index_coding64.9-
eqbench56.3-

The verdict

For a sample job of 1 million input tokens and 250,000 output tokens, Gemma 4 26B A4B (free) costs $0 and Gemini 3.1 Pro Preview Custom Tools costs $5.00, so Gemma 4 26B A4B (free) is free for the same work.

Gemini 3.1 Pro Preview Custom Tools reads up to 1,048,576 tokens at once, roughly 1,573 pages of text, against about 393 pages for Gemma 4 26B A4B (free).

Only Gemini 3.1 Pro Preview Custom Tools offers audio input.

Across the 20 tasks where they differ, Gemma 4 26B A4B (free) scores higher on 20 (SQL Generation, Code Review, Code Completion and others).

Gemma 4 26B A4B (free) was released in April 2026 and Gemini 3.1 Pro Preview Custom Tools in February 2026.

Pick Gemma 4 26B A4B (free) if you need lower cost or the stronger all-round task scores; pick Gemini 3.1 Pro Preview Custom Tools if you need long documents or audio input.

Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.

Who wins by task?

TaskGoogle: Gemma 4 26B A4B (free)Google: Gemini 3.1 Pro Preview Custom Tools
SQL Generation 153 132
Code Review 150 132
Code Completion 131 117
Code Refactoring 148 136
Bug Fixing 156 136
Unit Test Generation 140 124
Code Documentation 136 129
Regex Writing 130 117
CI/CD Pipelines 133 120
Frontend Component Design 136 122
Data Analysis 148 124
CSV / Spreadsheet Cleanup 143 132
ETL Scripting 141 128
JSON Extraction 142 121
Bulk Data Labeling 133 117
OCR / Document Parsing 138 131
Table Extraction from PDFs 138 131
Long-Document Summarization 147 136
Short-Form Summarization 129 113
Blog Post Writing 132 120

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Haiku Latest vs Google: Gemma 4 26B A4B (free) Anthropic: Claude Sonnet 5 vs Google: Gemma 4 26B A4B (free) Anthropic: Claude Sonnet Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Sonnet Latest vs Google: Gemma 4 26B A4B (free) ByteDance Seed: Seed-2.0-Lite vs Google: Gemini 3.1 Pro Preview Custom Tools ByteDance Seed: Seed-2.0-Mini vs Google: Gemini 3.1 Pro Preview Custom Tools Google: Gemini 3.1 Flash Lite Preview vs Google: Gemini 3.1 Pro Preview Custom Tools

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.