head-to-head

OpenAI: GPT-5.4 vs Google: Gemini 3.1 Pro Preview Custom Tools

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-09-23.

OpenAI: GPT-5.4 Google: Gemini 3.1 Pro Preview Custom Tools
Vendoropenaigoogle
Quality Score100100
Benchmark Score80.9-
Input Price$2.50/M$2.00/M
Output Price$15.00/M$12.00/M
Context Window1,050,0001,048,576
Max Output128,00065,536
Tool Calling
Structured Output
Reasoning Mode
Vision
Audio-
Benchmark Scores
ai_index64.3-
eqbench82.4-

Who wins by task?

TaskOpenAI: GPT-5.4Google: Gemini 3.1 Pro Preview Custom Tools
SQL Generation 145 132
Code Review 154 132
Code Completion 120 117
Code Refactoring 157 136
Bug Fixing 158 136
Unit Test Generation 137 124
Code Documentation 140 129
Regex Writing 126 117
CI/CD Pipelines 133 120
Frontend Component Design 133 122
Data Analysis 138 124
CSV / Spreadsheet Cleanup 139 132
ETL Scripting 145 128
JSON Extraction 120 121
Bulk Data Labeling 116 117
OCR / Document Parsing 136 131
Table Extraction from PDFs 136 131
Long-Document Summarization 157 136
Short-Form Summarization 117 113
Blog Post Writing 133 120

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Haiku Latest vs OpenAI: GPT-5.4 Anthropic: Claude Sonnet 5 vs OpenAI: GPT-5.4 Anthropic: Claude Sonnet Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Sonnet Latest vs OpenAI: GPT-5.4 ByteDance Seed: Seed-2.0-Lite vs Google: Gemini 3.1 Pro Preview Custom Tools ByteDance Seed: Seed-2.0-Lite vs OpenAI: GPT-5.4 ByteDance Seed: Seed-2.0-Mini vs Google: Gemini 3.1 Pro Preview Custom Tools

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.