Top picks for Self-Hosted / Local (2026)
Open-weights models you can run yourself. Ranked from 422 live models on the OpenRouter catalog, weighted for low cost.
Updated 2026-09-04 · prices checked at this morning's rebuild
Which should you use? Qwen: Qwen3.7 Flash tops this ranking on blended score. If cost drives the decision, Ling-3.0-flash is the cheapest of the leaders at $0.02/M input. To prototype without spending, MiniMax: MiniMax M3 (free) is the best free option ranked here.
| # | Model | Score | In / 1M | Out / 1M | Context | |
|---|---|---|---|---|---|---|
| 1 | Qwen: Qwen3.7 Flashqwen/qwen3.7-flash | 118 | $0.03 | $0.13 | 1,000,000 | Details → |
| 2 | Ling-3.0-flashinclusionai/ling-3.0-flash | 118 | $0.02 | $0.06 | 262,144 | Details → |
| 3 | Nex AGI: Nex-N2-Mininex-agi/nex-n2-mini | 118 | $0.03 | $0.10 | 262,144 | Details → |
| 4 | MiniMax: MiniMax M3 (free)minimax/minimax-m3:free | 118 | Free | Free | 1,048,576 | Details → |
| 5 | NVIDIA: Nemotron 3 Nano Omni (free)nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 118 | Free | Free | 256,000 | Details → |
| 6 | Google: Gemma 4 26B A4B (free)google/gemma-4-26b-a4b-it:free | 118 | Free | Free | 262,144 | Details → |
| 7 | Google: Gemma 4 31B (free)google/gemma-4-31b-it:free | 118 | Free | Free | 262,144 | Details → |
| 8 | Meta: Muse Spark 1.3 Contributormeta/muse-spark-1.3-contributor | 117 | $0.10 | $0.20 | 1,048,576 | Details → |
| 9 | Z.ai: GLM Flash Latest~z-ai/glm-flash-latest | 117 | $0.07 | $0.25 | 1,310,720 | Details → |
| 10 | Z.ai: GLM 5.3 Flashz-ai/glm-5.3-flash | 117 | $0.07 | $0.25 | 1,310,720 | Details → |
| 11 | Meta: Muse Spark 1.2 Contributormeta/muse-spark-1.2-contributor | 117 | $0.10 | $0.20 | 1,048,576 | Details → |
| 12 | Xiaomi: MiMo-V2.5xiaomi/mimo-v2.5 | 117 | $0.14 | $0.28 | 1,050,000 | Details → |
| 13 | Google: Gemma 4 26B A4B google/gemma-4-26b-a4b-it | 117 | $0.07 | $0.34 | 262,144 | Details → |
| 14 | Google: Gemma 4 31Bgoogle/gemma-4-31b-it | 117 | $0.09 | $0.34 | 262,144 | Details → |
| 15 | Qwen: Qwen3.5-9Bqwen/qwen3.5-9b | 117 | $0.10 | $0.15 | 262,144 | Details → |
How we ranked these
For Self-Hosted / Local, we weight models on low cost. Scores combine each model's public specs with independent benchmark results (Aider Polyglot coding scores, Artificial Analysis intelligence/coding/agentic indices) and live pricing. See full methodology →
About Self-Hosted / Local
Self-hosted / local deployment means running open-weights AI models on your own hardware without relying on cloud APIs. You need this when you require privacy, want to avoid per-token costs at scale, need offline capability, or operate in restricted network environments. A good model for local deployment balances inference speed and output quality within your hardware constraints-typically measured in tokens per second and VRAM requirements. Quantization (reducing model precision to 4-bit or 8-bit) is the single most important cost lever: it cuts memory usage by 60-75% with minimal quality loss, often making the difference between running a model and not running it at all.
When to use: Use this when you want to run an AI model on your own computer or server without sending data to external cloud services, either to keep information private, save money on API fees, or work without an internet connection.
Common questions
What is the smallest model I can realistically run on a laptop?
Mistral 7B or Llama 2 7B quantized to 4-bit will run on most laptops with 8GB RAM using tools like Ollama or LM Studio, though you'll see noticeable slowdown compared to a GPU. For faster inference, aim for at least a GPU with 6-8GB of dedicated VRAM, which lets you run 13B models at practical speeds.
How much does it cost to run a model locally versus using an API?
Local deployment has near-zero marginal cost per inference after the initial hardware investment, while APIs typically cost $0.001-$0.10 per thousand tokens depending on model size. If you're running thousands of inferences monthly, self-hosting breaks even within weeks; if you're running millions monthly, it's orders of magnitude cheaper.