head-to-head

OpenAI: GPT-5.4 Nano vs Google: Gemini 3.1 Pro Preview Custom Tools

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-09-23.

OpenAI: GPT-5.4 Nano Google: Gemini 3.1 Pro Preview Custom Tools
Vendoropenaigoogle
Quality Score100100
Benchmark Score31.5-
Input Price$0.20/M$2.00/M
Output Price$1.25/M$12.00/M
Context Window400,0001,048,576
Max Output128,00065,536
Tool Calling
Structured Output
Reasoning Mode
Vision
Audio-
Benchmark Scores
ai_index34.2-

Who wins by task?

TaskOpenAI: GPT-5.4 NanoGoogle: Gemini 3.1 Pro Preview Custom Tools
SQL Generation 138 132
Code Review 138 132
Code Completion 132 117
Code Refactoring 141 136
Bug Fixing 142 136
Unit Test Generation 128 124
Code Documentation 134 129
Regex Writing 123 117
CI/CD Pipelines 124 120
Frontend Component Design 126 122
Data Analysis 129 124
CSV / Spreadsheet Cleanup 135 132
ETL Scripting 132 128
JSON Extraction 131 121
Bulk Data Labeling 129 117
OCR / Document Parsing 132 131
Table Extraction from PDFs 132 131
Long-Document Summarization 143 136
Short-Form Summarization 125 113
Blog Post Writing 126 120

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Haiku Latest vs OpenAI: GPT-5.4 Nano Anthropic: Claude Sonnet 5 vs OpenAI: GPT-5.4 Nano Anthropic: Claude Sonnet Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Sonnet Latest vs OpenAI: GPT-5.4 Nano ByteDance Seed: Seed-2.0-Lite vs Google: Gemini 3.1 Pro Preview Custom Tools ByteDance Seed: Seed-2.0-Mini vs Google: Gemini 3.1 Pro Preview Custom Tools Google: Gemini 3.1 Flash Lite Preview vs Google: Gemini 3.1 Pro Preview Custom Tools

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.