head-to-head

OpenAI: GPT-5.4 Mini vs Google: Gemini 3.1 Pro Preview Custom Tools

Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-09-23.

OpenAI: GPT-5.4 Mini Google: Gemini 3.1 Pro Preview Custom Tools
Vendoropenaigoogle
Quality Score100100
Benchmark Score37.7-
Input Price$0.75/M$2.00/M
Output Price$4.50/M$12.00/M
Context Window400,0001,048,576
Max Output128,00065,536
Tool Calling
Structured Output
Reasoning Mode
Vision
Audio-
Benchmark Scores
ai_index39.7-

Who wins by task?

TaskOpenAI: GPT-5.4 MiniGoogle: Gemini 3.1 Pro Preview Custom Tools
SQL Generation 138 132
Code Review 139 132
Code Completion 131 117
Code Refactoring 142 136
Bug Fixing 143 136
Unit Test Generation 128 124
Code Documentation 134 129
Regex Writing 122 117
CI/CD Pipelines 124 120
Frontend Component Design 126 122
Data Analysis 130 124
CSV / Spreadsheet Cleanup 135 132
ETL Scripting 133 128
JSON Extraction 130 121
Bulk Data Labeling 128 117
OCR / Document Parsing 133 131
Table Extraction from PDFs 133 131
Long-Document Summarization 143 136
Short-Form Summarization 124 113
Blog Post Writing 126 120

Scores reflect capability match + benchmark data + pricing for each task. Methodology →

Related comparisons

Anthropic: Claude Haiku Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Haiku Latest vs OpenAI: GPT-5.4 Mini Anthropic: Claude Sonnet 5 vs OpenAI: GPT-5.4 Mini Anthropic: Claude Sonnet Latest vs Google: Gemini 3.1 Pro Preview Custom Tools Anthropic: Claude Sonnet Latest vs OpenAI: GPT-5.4 Mini ByteDance Seed: Seed-2.0-Lite vs Google: Gemini 3.1 Pro Preview Custom Tools ByteDance Seed: Seed-2.0-Mini vs Google: Gemini 3.1 Pro Preview Custom Tools Google: Gemini 3.1 Flash Lite Preview vs Google: Gemini 3.1 Pro Preview Custom Tools

The Model Movers Report

One email every Friday, built from this site's own rankings: the current top five by benchmark score, every model released in the last seven days, and one note worked out from that week's numbers. You can unsubscribe from any issue with one click.