Skip to content

LLM Gateway

Open-source, self-hostable, AGPLv3.

LLM Gateway is an open-source gateway (AGPLv3) you can self-host, with a hosted option and an OpenAI-compatible API. It is the only gateway in this list you can run yourself, which matters if you would rather not depend on any single gateway operator.

Open source (AGPLv3) Self-hostable BYOK at no markup
Status
Live
Models in catalog
288
Text / multimodal
206
Publishes pricing for
288 models
Largest context window
2M tokens
Model id style
Accepts bare ids (`gpt-4o`) alongside a provider-pinned `provider/model-id` form.
Billing
Pay per token with prepaid credits, bring your own provider keys for free, or self-host.
Catalog last checked
Documentation
Developer docs
Catalog

288 models on LLM Gateway

The 60 most widely available are shown; the rest are searchable in the full model list. "Id on this gateway" is what LLM Gateway calls the model — where it differs from the canonical id, that difference is what a router has to translate.

Search all 288 models on LLM Gateway
ModelVendorTypeId on this gatewayAvailable onContextInput / Mtok
Claude Fable 5 anthropic/claude-fable-5 Anthropic Multimodal claude-fable-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $8.36–$10.00
Claude Fable 5.1 anthropic/claude-fable-5.1 Anthropic Multimodal claude-fable-5-1 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $6.50–$10.00
Claude Haiku 4.5 anthropic/claude-haiku-4.5 Anthropic Multimodal claude-haiku-4-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 200K $0.850–$1.00
Claude Opus 4.6 anthropic/claude-opus-4.6 Anthropic Multimodal claude-opus-4-6 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.45–$5.00
Claude Opus 4.7 anthropic/claude-opus-4.7 Anthropic Multimodal claude-opus-4-7 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.58–$5.50
Claude Opus 4.8 anthropic/claude-opus-4.8 Anthropic Multimodal claude-opus-4-8 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.25–$5.50
Claude Opus 5 anthropic/claude-opus-5 Anthropic Multimodal claude-opus-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.45–$5.50
Claude Opus 5.5 anthropic/claude-opus-5.5 Anthropic Multimodal claude-opus-5-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.34–$4.40
Claude Sonnet 4.6 anthropic/claude-sonnet-4.6 Anthropic Multimodal claude-sonnet-4-6 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $2.01–$3.00
Claude Sonnet 5 anthropic/claude-sonnet-5 Anthropic Multimodal claude-sonnet-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $1.30–$2.20
Claude Sonnet 5.5 anthropic/claude-sonnet-5.5 Anthropic Multimodal claude-sonnet-5-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $1.43–$2.20
o3 openai/o3 OpenAI Multimodal o3 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestySayGMVercel 200K $1.30–$2.00
Qwen3.8 27B qwen/qwen3.8-27b Qwen Text qwen3.8-27b Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequestySayGMVercel 1M $0.049–$0.500
Claude Haiku 5.5 anthropic/claude-haiku-5.5 Anthropic Multimodal claude-haiku-5-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestyVercel 1M $0.065–$0.100
Claude Sonnet 4.5 anthropic/claude-sonnet-4.5 Anthropic Multimodal claude-sonnet-4-5 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestyVercel 1M $1.95–$3.00
Muse Spark 1.1 meta-llama/muse-spark-1.1 Meta Multimodal muse-spark-1.1 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampVercel 1M $1.06–$1.25
Muse Spark 1.2 meta-llama/muse-spark-1.2 Meta Multimodal muse-spark-1.2 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampVercel 1M $1.06–$1.25
Muse Spark 1.3 meta-llama/muse-spark-1.3 Meta Multimodal muse-spark-1.3 Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestyVercel 1M $1.06–$1.25
Qwen3.5 35B A3B qwen/qwen3.5-35b-a3b Qwen Multimodal qwen3.5-35b-a3b Cheaper InferenceCloudflareConcentrateDarkbloomExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequesty 262.1K $0.057–$0.250
Qwen 3.5 9B qwen/qwen3.5-9b Qwen Multimodal qwen3.5-9b Cheaper InferenceCloudflareConcentrateDarkbloomExperiential LabsLLM GatewayNanoGPTOpenRouterRequestyTogether 262.1K $0.040–$0.170
Qwen3.6 35B A3B qwen/qwen3.6-35b-a3b Qwen Multimodal qwen3.6-35b-a3b Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterSailSayGM 1M $0.076–$0.248
Qwen3.7 Plus qwen/qwen3.7-plus Qwen Multimodal qwen3.7-plus Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequestyTogether 1M $0.265–$0.400
Qwen3.8 Max qwen/qwen3.8-max Qwen Multimodal qwen3.8-max Cheaper InferenceCloudflareConcentrateExperiential LabsFireworksLLM GatewayNanoGPTOrcaRouterRampRequesty 1M $1.41–$2.00
MiMo V2.6 Flash xiaomi/mimo-v2.6-flash Xiaomi Multimodal mimo-v2.6-flash Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequestyVercel 1.1M $0.118–$0.140
Qwen3.5 27B qwen/qwen3.5-27b Qwen Multimodal qwen3.5-27b Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequesty 262.1K $0.086–$0.300
Qwen3.6 Plus qwen/qwen3.6-plus Qwen Multimodal qwen3.6-plus Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterTogether 1M $0.276–$0.500
Qwen3.7 Flash qwen/qwen3.7-flash Qwen Multimodal qwen3.7-flash Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterVercel 1M $0.025–$0.030
Qwen3.7 Max qwen/qwen3.7-max Qwen Text qwen3.7-max Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterTogether 1M $1.25–$2.50
Qwen Flash qwen/qwen3.8-flash Qwen Text qwen-flash Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterTogether 1M $0.050–$0.150
Muse Spark 1.2 Contributor meta-llama/muse-spark-1.2-contributor Meta Multimodal muse-spark-1.2-contributor Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 1M $0.065–$0.100
Muse Spark 1.3 Contributor meta-llama/muse-spark-1.3-contributor Meta Multimodal muse-spark-1.3-contributor Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 1M $0.073–$0.100
Qwen3 32B qwen/qwen3-32b Qwen Text qwen3-32b CloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRequestyVercel 131.1K $0.080–$0.610
Qwen3.5 122B A10B qwen/qwen3.5-122b-a10b Qwen Multimodal qwen3.5-122b-a10b Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouter 262.1K $0.115–$0.400
Qwen3.6 27B qwen/qwen3.6-27b Qwen Text qwen3.6-27b Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 262.1K $0.150–$0.600
Qwen3.8 2.4T A95B qwen/qwen3.8-2.4t-a95b Qwen Text qwen3.8-2.4t-a95b Cheaper InferenceCloudflareExperiential LabsFireworksLLM GatewayOpenRouterRequestyTogether 1M $1.70–$2.50
DeepSeek V4.1 Flash 1017 deepseek-v4.1-flash-1017 DeepSeek Multimodal deepseek-v4.1-flash-1017 Cheaper InferenceConcentrateExperiential LabsIsoquantLLM GatewayRampSayGM 1.1M $0.030–$0.375
GLM-5.3-Flash glm-5.3-flash Z.ai Multimodal glm-5.3-flash Cheaper InferenceConcentrateDarkbloomExperiential LabsIsoquantLLM GatewaySayGM 1M $0.060–$0.150
GPT-5.6 Luna gpt-5.6-luna OpenAI Multimodal gpt-5.6-luna Cheaper InferenceConcentrateExperiential LabsLLM GatewayOrcaRouterRampSayGM 1.1M $0.107–$0.200
Ling 3.0 Flash inclusionai/ling-3.0-flash inclusionAI Text ling-3.0-flash Cheaper InferenceCloudflareExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 262.1K $0.021–$0.075
Ling 3.0 Flash VL inclusionai/ling-3.0-flash-vl inclusionAI Multimodal ling-3.0-flash-vl Cheaper InferenceCloudflareExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 262.1K $0.051–$0.075
Muse Wonder 1.0 meta-llama/muse-wonder-1.0 Meta Multimodal muse-wonder-1.0 Cheaper InferenceCloudflareExperiential LabsLLM GatewayRampRequestyVercel 1M $2.60–$4.00
Sonar perplexity/sonar Perplexity Text sonar Cheaper InferenceCloudflareExperiential LabsLLM GatewayOpenRouterRequestyVercel 131.1K $0.163–$1.00
Qwen3 14B qwen/qwen3-14b Qwen Text qwen3-14b CloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 41K $0.076–$0.610
Qwen3 30B A3B qwen/qwen3-30b-a3b Qwen Text qwen3-30b-a3b Cheaper InferenceCloudflareExperiential LabsLLM GatewayNanoGPTOpenRouterVercel 256K $0.095–$0.120
Qwen3 Coder Flash qwen/qwen3-coder-flash Qwen Text qwen3-coder-flash CloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRequesty 1M $0.195–$0.300
Qwen3 VL 235B A22B Instruct qwen/qwen3-vl-235b-a22b-instruct Qwen Multimodal qwen3-vl-235b-a22b-instruct Cheaper InferenceCloudflareLLM GatewayNanoGPTOpenRouterOrcaRouterVercel 262.1K $0.200–$0.400
Qwen3.6 Flash qwen/qwen3.6-flash Qwen Multimodal qwen3.6-flash CloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouter 1M $0.188–$0.250
Qwen3.8 Omni Flash qwen/qwen3.8-omni-flash Qwen Multimodal qwen3.8-omni-flash Cheaper InferenceCloudflareConcentrateLLM GatewayNanoGPTOpenRouterVercel 1M $0.128–$0.150
Step 3.7 Flash stepfun/step-3.7-flash Stepfun Multimodal step-3.7-flash Cheaper InferenceCloudflareConcentrateLLM GatewayOpenRouterRequestyVercel 262.1K $0.170–$0.200
Step 5 Preview stepfun/step-5-preview Stepfun Multimodal step-5-preview Cheaper InferenceCloudflareLLM GatewayNanoGPTOpenRouterRequestyVercel 1M $0.850–$1.00
DeepSeek V4.1 Flash deepseek-v4.1-flash DeepSeek Multimodal deepseek-v4.1-flash Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1M $0.053–$0.300
GPT-5.4 gpt-5.4 OpenAI Multimodal gpt-5.4 Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $1.54–$2.50
GPT-5.4 Mini gpt-5.4-mini OpenAI Multimodal gpt-5.4-mini Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 400K $0.464–$0.750
GPT-5.4 Nano gpt-5.4-nano OpenAI Multimodal gpt-5.4-nano Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 400K $0.124–$0.200
GPT-5.5 gpt-5.5 OpenAI Multimodal gpt-5.5 Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $3.09–$5.00
GPT-5.6 Sol gpt-5.6-sol OpenAI Multimodal gpt-5.6-sol Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $2.00–$4.00
GPT-5.6 Terra gpt-5.6-terra OpenAI Multimodal gpt-5.6-terra Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $0.824–$2.00
GPT-6 Astra gpt-6-astra OpenAI Multimodal gpt-6-astra Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $6.18–$10.00
GPT-6 Luna gpt-6-luna OpenAI Multimodal gpt-6-luna Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $0.062–$0.100
GPT-6 Sol gpt-6-sol OpenAI Multimodal gpt-6-sol Cheaper InferenceConcentrateExperiential LabsLLM GatewayRampSayGM 1.1M $1.24–$2.00
Cheapest here

Lowest input prices on LLM Gateway

Ranked by what this gateway charges, not by the cheapest price anywhere.

ModelVendorAvailable onContextInput / MtokSpread
Qwen3 Embedding 8B qwen/qwen3-embedding-8b Qwen Cheaper InferenceCloudflareFireworksLLM Gateway 41K $0.010–$0.012 1.18x
BGE-M3 baai/bge-m3 BAAI Cheaper InferenceCloudflareLLM Gateway 8.2K $0.010–$0.011 1.14x
Qwen3 Embedding 0.6B qwen/qwen3-embedding-0.6b Qwen Cheaper InferenceCloudflareLLM Gateway 32.8K $0.010–$0.011 1.14x
Qwen3 Reranker 0.6B qwen3-reranker-0.6b Qwen LLM Gateway 32.8K $0.010 —
Text Embedding 3 Small openai/text-embedding-3-small OpenAI Cheaper InferenceCloudflareLLM GatewayOrcaRouterVercel 8.2K $0.017–$0.020 1.18x
Text Embedding 005 google/text-embedding-005 Google Cheaper InferenceLLM GatewayVercel 2K $0.016–$0.025 1.54x
Text Multilingual Embedding 002 google/text-multilingual-embedding-002 Google Cheaper InferenceLLM GatewayVercel 2K $0.016–$0.025 1.54x
Qwen3 Reranker 4B qwen3-reranker-4b Qwen LLM Gateway 32.8K $0.025 —
Text Embedding 004 text-embedding-004 OpenAI LLM Gateway 2K $0.025 —
Qwen3.7 Flash qwen/qwen3.7-flash Qwen Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterVercel 1M $0.025–$0.030 1.18x
By model type

What LLM Gateway carries

A gateway with 2,000 models is not necessarily a gateway with 2,000 chat models.

Not exclusive

213 of these models are on other gateways too

Anything in this list can be served from somewhere other than LLM Gateway without changing the model id your application sends.

ModelVendorAvailable onContextInput / MtokSpread
Claude Fable 5 anthropic/claude-fable-5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $8.36–$10.00 1.20x
Claude Fable 5.1 anthropic/claude-fable-5.1 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $6.50–$10.00 1.54x
Claude Haiku 4.5 anthropic/claude-haiku-4.5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 200K $0.850–$1.00 1.18x
Claude Opus 4.6 anthropic/claude-opus-4.6 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.45–$5.00 1.45x
Claude Opus 4.7 anthropic/claude-opus-4.7 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.58–$5.50 1.54x
Claude Opus 4.8 anthropic/claude-opus-4.8 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.25–$5.50 1.69x
Claude Opus 5 anthropic/claude-opus-5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.45–$5.50 1.59x
Claude Opus 5.5 anthropic/claude-opus-5.5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $3.34–$4.40 1.32x
Claude Sonnet 4.6 anthropic/claude-sonnet-4.6 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $2.01–$3.00 1.49x
Claude Sonnet 5 anthropic/claude-sonnet-5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $1.30–$2.20 1.69x
Claude Sonnet 5.5 anthropic/claude-sonnet-5.5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampRequestyVercel 1M $1.43–$2.20 1.54x
o3 openai/o3 OpenAI Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestySayGMVercel 200K $1.30–$2.00 1.54x
Qwen3.8 27B qwen/qwen3.8-27b Qwen Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequestySayGMVercel 1M $0.049–$0.500 10.22x
Claude Haiku 5.5 anthropic/claude-haiku-5.5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestyVercel 1M $0.065–$0.100 1.54x
Claude Sonnet 4.5 anthropic/claude-sonnet-4.5 Anthropic Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestyVercel 1M $1.95–$3.00 1.54x
Muse Spark 1.1 meta-llama/muse-spark-1.1 Meta Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampVercel 1M $1.06–$1.25 1.18x
Muse Spark 1.2 meta-llama/muse-spark-1.2 Meta Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRampVercel 1M $1.06–$1.25 1.18x
Muse Spark 1.3 meta-llama/muse-spark-1.3 Meta Cheaper InferenceCloudflareConcentrateExperiential LabsLLM GatewayNanoGPTOpenRouterRampRequestyVercel 1M $1.06–$1.25 1.18x
Qwen3.5 35B A3B qwen/qwen3.5-35b-a3b Qwen Cheaper InferenceCloudflareConcentrateDarkbloomExperiential LabsLLM GatewayNanoGPTOpenRouterOrcaRouterRequesty 262.1K $0.057–$0.250 4.39x
Qwen 3.5 9B qwen/qwen3.5-9b Qwen Cheaper InferenceCloudflareConcentrateDarkbloomExperiential LabsLLM GatewayNanoGPTOpenRouterRequestyTogether 262.1K $0.040–$0.170 4.25x
Recent churn

What LLM Gateway has changed lately

From the daily catalog crawl. Every line below concerns this gateway, so it is not named on each one.

All gateway changes