OpenAI: GPT-5.4 vs Google: Gemini 3.1 Pro Preview
Side-by-side comparison of specs, pricing, benchmark scores, and task rankings. Updated 2026-11-07.
| OpenAI: GPT-5.4 | Google: Gemini 3.1 Pro Preview | |
|---|---|---|
| Vendor | openai | |
| Quality Score | 100 | 100 |
| Benchmark Score | 89.6 | 74.7 |
| Input Price | $2.50/M | $2.00/M |
| Output Price | $15.00/M | $12.00/M |
| Context Window | 1,050,000 | 1,048,576 |
| Max Output | 128,000 | 65,536 |
| Tool Calling | ✓ | ✓ |
| Structured Output | ✓ | ✓ |
| Reasoning Mode | ✓ | ✓ |
| Vision | ✓ | ✓ |
| Audio | - | ✓ |
| Benchmark Scores | ||
| ai_index | 84.8 | 76.7 |
| ai_index_agentic | 67.8 | 35.3 |
| ai_index_coding | 100.0 | 100.0 |
| eqbench | 75.6 | 64.7 |
The verdict
For a sample job of 1 million input tokens and 250,000 output tokens, Gemini 3.1 Pro Preview costs $5.00 and GPT-5.4 costs $6.25, so Gemini 3.1 Pro Preview is about 1.2 times cheaper for the same work.
Both take in a similar amount of text: 1,050,000 and 1,048,576 tokens, about 1,575 and 1,573 pages.
Only Gemini 3.1 Pro Preview offers audio input and video input.
On our blended benchmark score GPT-5.4 leads 89.6 to 74.7.
Across the 20 tasks where they differ, GPT-5.4 scores higher on 18 (SQL Generation, Code Review, Code Refactoring and others), Gemini 3.1 Pro Preview on 2 (Code Completion, Bulk Data Labeling).
GPT-5.4 was released in March 2026 and Gemini 3.1 Pro Preview in February 2026.
Pick GPT-5.4 if you need benchmark performance or the stronger all-round task scores; pick Gemini 3.1 Pro Preview if you need lower cost, audio input or video input.
Costs use current list prices per million tokens; page counts assume about 0.75 words per token and 500 words per page.
Who wins by task?
| Task | OpenAI: GPT-5.4 | Google: Gemini 3.1 Pro Preview |
|---|---|---|
| SQL Generation | 174 | 168 |
| Code Review | 175 | 168 |
| Code Completion | 120 | 120 |
| Code Refactoring | 173 | 168 |
| Bug Fixing | 187 | 177 |
| Unit Test Generation | 158 | 154 |
| Code Documentation | 146 | 144 |
| Regex Writing | 136 | 133 |
| CI/CD Pipelines | 149 | 145 |
| Frontend Component Design | 148 | 145 |
| Data Analysis | 173 | 164 |
| CSV / Spreadsheet Cleanup | 157 | 155 |
| ETL Scripting | 161 | 156 |
| JSON Extraction | 137 | 137 |
| Bulk Data Labeling | 122 | 123 |
| OCR / Document Parsing | 148 | 147 |
| Table Extraction from PDFs | 148 | 147 |
| Long-Document Summarization | 167 | 163 |
| Short-Form Summarization | 122 | 121 |
| Blog Post Writing | 143 | 140 |
Scores reflect capability match + benchmark data + pricing for each task. Methodology →