Anthropic: Claude Haiku Latest vs Google: Gemma 4 26B A4B (free)
Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.
| Anthropic: Claude Haiku Latest | Google: Gemma 4 26B A4B (free) | |
|---|---|---|
| Vendor | ~anthropic | |
| Quality Score | 100 | 100 |
| Benchmark Score | - | 48.4 |
| Input Price | $0.10/M | Free |
| Output Price | $0.50/M | Free |
| Context Window | 1,000,000 | 262,144 |
| Max Output | 128,000 | 32,768 |
| Tool Calling | ✓ | ✓ |
| Structured Output | ✓ | ✓ |
| Reasoning Mode | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Audio | - | - |
| Benchmark Scores | ||
| ai_index | - | 42.4 |
| ai_index_agentic | - | 18.1 |
| ai_index_coding | - | 64.9 |
| eqbench | - | 56.3 |
The verdict
For a sample job of 1 million input tokens and 250,000 output tokens, Gemma 4 26B A4B (free) costs $0 and Claude Haiku Latest costs $0.23, so Gemma 4 26B A4B (free) is free for the same work.
Claude Haiku Latest reads up to 1,000,000 tokens at once, roughly 1,500 pages of text, against about 393 pages for Gemma 4 26B A4B (free).
Only Gemma 4 26B A4B (free) offers video input.
Across the 20 tasks where they differ, Claude Haiku Latest scores higher on 1 (Code Completion), Gemma 4 26B A4B (free) on 19 (SQL Generation, Code Review, Code Refactoring and others).
Pick Claude Haiku Latest if you need long documents; pick Gemma 4 26B A4B (free) if you need lower cost, video input or the stronger all-round task scores.
Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.
Who wins by task?
| Task | Anthropic: Claude Haiku Latest | Google: Gemma 4 26B A4B (free) |
|---|---|---|
| SQL Generation | 133 | 153 |
| Code Review | 132 | 150 |
| Code Completion | 131 | 131 |
| Code Refactoring | 136 | 148 |
| Bug Fixing | 136 | 156 |
| Unit Test Generation | 124 | 140 |
| Code Documentation | 131 | 136 |
| Regex Writing | 119 | 130 |
| CI/CD Pipelines | 120 | 133 |
| Frontend Component Design | 122 | 136 |
| Data Analysis | 124 | 148 |
| CSV / Spreadsheet Cleanup | 133 | 143 |
| ETL Scripting | 128 | 141 |
| JSON Extraction | 131 | 142 |
| Bulk Data Labeling | 129 | 133 |
| OCR / Document Parsing | 131 | 138 |
| Table Extraction from PDFs | 131 | 138 |
| Long-Document Summarization | 137 | 147 |
| Short-Form Summarization | 123 | 129 |
| Blog Post Writing | 121 | 132 |
Scores reflect capability match + benchmark data + pricing for each task. Methodology →