OpenAI: GPT-5.4 vs Google: Gemini 3.1 Pro Preview Custom Tools
Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.
| OpenAI: GPT-5.4 | Google: Gemini 3.1 Pro Preview Custom Tools | |
|---|---|---|
| Vendor | openai | |
| Quality Score | 100 | 100 |
| Benchmark Score | 89.6 | - |
| Input Price | $2.50/M | $2.00/M |
| Output Price | $15.00/M | $12.00/M |
| Context Window | 1,050,000 | 1,048,576 |
| Max Output | 128,000 | 65,536 |
| Tool Calling | ✓ | ✓ |
| Structured Output | ✓ | ✓ |
| Reasoning Mode | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Audio | - | ✓ |
| Benchmark Scores | ||
| ai_index | 84.8 | - |
| ai_index_agentic | 67.8 | - |
| ai_index_coding | 100.0 | - |
| eqbench | 75.6 | - |
The verdict
For a sample job of 1 million input tokens and 250,000 output tokens, Gemini 3.1 Pro Preview Custom Tools costs $5.00 and GPT-5.4 costs $6.25, so Gemini 3.1 Pro Preview Custom Tools is about 1.2 times cheaper for the same work.
Both take in a similar amount of text: 1,050,000 and 1,048,576 tokens, about 1,575 and 1,573 pages.
Only Gemini 3.1 Pro Preview Custom Tools offers audio input and video input.
Across the 20 tasks where they differ, GPT-5.4 scores higher on 20 (SQL Generation, Code Review, Code Completion and others).
GPT-5.4 was released in March 2026 and Gemini 3.1 Pro Preview Custom Tools in February 2026.
Pick GPT-5.4 if you need the stronger all-round task scores; pick Gemini 3.1 Pro Preview Custom Tools if you need lower cost, audio input or video input.
Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.
Who wins by task?
| Task | OpenAI: GPT-5.4 | Google: Gemini 3.1 Pro Preview Custom Tools |
|---|---|---|
| SQL Generation | 174 | 132 |
| Code Review | 175 | 132 |
| Code Completion | 120 | 117 |
| Code Refactoring | 173 | 136 |
| Bug Fixing | 187 | 136 |
| Unit Test Generation | 158 | 124 |
| Code Documentation | 146 | 129 |
| Regex Writing | 136 | 117 |
| CI/CD Pipelines | 149 | 120 |
| Frontend Component Design | 148 | 122 |
| Data Analysis | 173 | 124 |
| CSV / Spreadsheet Cleanup | 157 | 132 |
| ETL Scripting | 161 | 128 |
| JSON Extraction | 137 | 121 |
| Bulk Data Labeling | 122 | 117 |
| OCR / Document Parsing | 148 | 131 |
| Table Extraction from PDFs | 148 | 131 |
| Long-Document Summarization | 167 | 136 |
| Short-Form Summarization | 122 | 113 |
| Blog Post Writing | 143 | 120 |
Scores reflect capability match + benchmark data + pricing for each task. Methodology →