Providers Overview
GoRoute connects applications to different hosted and local AI providers through a consistent gateway interface. This means your application can keep using the same connection while you change or add providers behind it. The catalog lists supported provider integrations; model names and availability depend on the provider and your GoRoute configuration.
The catalog includes 73 ProviderType profiles plus CustomOpenAICompatible endpoints. GoRoute handles the protocol translation, authentication, credential storage, retries, and usage tracking needed for each supported integration.
Interactive Provider Catalog
Filter all 73 ProviderType profiles and CustomOpenAICompatible by adapter tier, category, or capability, and click any provider ID to copy it for configuration.
Cerebras Wafer-Scale Engine
SambaNova Systems
xAI (Grok)
Fireworks AI
Perplexity AI
Anyscale Endpoints
DeepInfra
Novita AI
Nebius AI Studio
Hyperbolic AI
Lambda Labs Inference
Friendli AI
OpenRouter
vLLM Local / Self-Hosted
Cloudflare Workers AI
Databricks Model Serving
Snowflake Cortex REST API
Alibaba Cloud DashScope (Qwen)
ByteDance Volcengine (Doubao)
Zhipu AI BigModel (GLM)
Moonshot AI (Kimi)
MiniMax
SiliconFlow
Voyage AI
Jina AI
Replicate Deployments
AI21 Labs Studio
Baseten Model Gateway
NVIDIA NIM APIs
Scaleway Generative APIs
GitHub Copilot
Vercel AI Gateway
Hugging Face Inference
Featherless AI
fal.ai
Z.ai
Poe
Helicone AI Gateway
AIHubMix
Venice AI
Chutes AI
GMI Cloud
LlamaGate
Sarvam AI
Crusoe Cloud
Parasail
Upstage Solar
OVHcloud AI Endpoints
W&B Inference
Nscale
Public AI
Synthetic
NanoGPT
Xiaomi MiMo
Reka AI
01.AI (Yi)
Baichuan AI
StepFun
LM Studio (Local)
llamafile (Local)
Xorbits Inference
Provider Integration Matrix (73 ProviderType Profiles)
GoRoute registers 73 ProviderType profiles in AllProviders() (internal/domain/inference.go), combining dedicated native protocol adapters (openai, anthropic, gemini, bedrock, vertex, azure, cohere, mistral, ollama), 60+ certified OpenAI-compatible dialect profiles (internal/adapter/openaicompat/builtin_profiles.go and extended_profiles.go), and CustomOpenAICompatible for arbitrary self-hosted or private endpoints.
This matrix highlights core native adapters and representative dialect integrations. Model IDs change more often than adapters do, so model names shown in this guide and linked provider pages are representative examples, not an exhaustive or guaranteed-current inventory.
| Provider | Adapter Type | Supported Modalities | Streaming | Tools | Auth Strategy | Guide |
|---|---|---|---|---|---|---|
| OpenAI | Native Adapter | Chat, Embed, Moderation, Audio, Images, Batches, Realtime | Yes | Yes | Bearer Token (OPENAI_API_KEY) | OpenAI |
| Anthropic | Native Messages | Chat | Yes | Yes | x-api-key (ANTHROPIC_API_KEY) | Anthropic Claude |
| Google Gemini | Native Gemini | Chat, Embed, Multimodal Audio/Vision, Imagen | Yes | Yes | x-goog-api-key (GEMINI_API_KEY) | Google Gemini |
| AWS Bedrock | Native Converse | Chat, Embed, Tools | Yes (EventStream) | Yes | AWS SigV4 HMAC-SHA256 | AWS Bedrock |
| Google Vertex AI | Native Vertex | Chat, Embed, Multimodal | Yes (SSE) | Yes | GCP SA JSON / OAuth2 Bearer | Google Vertex |
| Azure OpenAI | Native Azure | Chat, Embed, Vision | Yes | Yes | api-key / Entra ID Bearer | Azure OpenAI |
| Cohere | Native Cohere v2 | Chat, Embed, Rerank | Yes | Yes | Bearer Token (COHERE_API_KEY) | Cohere |
| Mistral AI | Native Adapter | Chat, Embed, Tools | Yes | Yes | Bearer Token (MISTRAL_API_KEY) | Mistral AI |
| Ollama | Native Local | Chat, Embed | Yes (NDJSON) | No | None / Base URL (http://localhost:11434) | Ollama |
| Groq | Certified Dialect | Chat, Vision | Yes | Yes | Bearer Token | Dialects |
| DeepSeek | Certified Dialect | Chat, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| Together AI | Certified Dialect | Chat, Embed, Vision | Yes | Yes | Bearer Token | Dialects |
| Cerebras | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| SambaNova | Certified Dialect | Chat, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| xAI (Grok) | Certified Dialect | Chat, Vision, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| Fireworks AI | Certified Dialect | Chat, Embed, Vision | Yes | Yes | Bearer Token | Dialects |
| Perplexity AI | Certified Dialect | Chat, Search Citations | Yes | No | Bearer Token | Dialects |
| Anyscale | Certified Dialect | Chat, Embed | Yes | Yes | Bearer Token | Dialects |
| DeepInfra | Certified Dialect | Chat, Embed | Yes | Yes | Bearer Token | Dialects |
| Novita AI | Certified Dialect | Chat, Embed, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| Nebius AI Studio | Certified Dialect | Chat, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| Hyperbolic | Certified Dialect | Chat, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| Lambda Labs | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| Friendli AI | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| OpenRouter | Certified Dialect | Chat, Vision, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| vLLM | Certified Dialect | Chat, Embed | Yes | Yes | None / Bearer Token | Dialects |
| Cloudflare | Certified Dialect | Chat, Embed | Yes | Yes | Cloudflare API Token | Dialects |
| Databricks | Certified Dialect | Chat, Embed | Yes | Yes | Databricks Personal Access Token | Dialects |
| Snowflake Cortex | Certified Dialect | Chat, Embed | Yes | Yes | Snowflake JWT / Session Token | Dialects |
| DashScope (Qwen) | Certified Dialect | Chat, Embed, Vision | Yes | Yes | Bearer Token | Dialects |
| Volcengine | Certified Dialect | Chat, Vision, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| BigModel (GLM) | Certified Dialect | Chat, Embed, Vision | Yes | Yes | Bearer Token | Dialects |
| Moonshot (Kimi) | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| MiniMax | Certified Dialect | Chat, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| SiliconFlow | Certified Dialect | Chat, Embed, Reasoning | Yes (Reasoning) | Yes | Bearer Token | Dialects |
| Voyage AI | Certified Dialect | Embeddings | No | No | Bearer Token | Dialects |
| Jina AI | Certified Dialect | Embeddings, Rerank | No | No | Bearer Token | Dialects |
| Replicate | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| AI21 Labs | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| Baseten | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
| NVIDIA NIM | Certified Dialect | Chat, Vision | Yes | Yes | Bearer Token | Dialects |
| Scaleway | Certified Dialect | Chat | Yes | Yes | Bearer Token | Dialects |
Find model IDs available to your key
Use the provider's current model documentation to choose an ID, then check the gateway's tenant-filtered GET /v1/models inventory with the same virtual key your application will use. That inventory is the reference for models currently exposed to that caller. Provider access, gateway catalog discovery/sync settings, organization policies, and key allowlists can all affect availability. A model listed by a provider is not by itself confirmation that a particular GoRoute deployment can route it.
When catalog discovery is enabled, the gateway can synchronize models exposed by supported providers. Discovery does not make every provider model universally available: provider credentials, adapter/protocol compatibility, organization policy, and virtual-key permissions still apply. See Model Management & Access Control and model catalog configuration.
Embedded Model Catalog & Capability Generalizations (v1.6.0)
GoRoute embeds a curated catalog of 4,627 models (internal/modelcatalog/catalog.json.gz) with operation-level support and modality pricing provenance. When a model is not yet in the catalog or has CapabilityUnknown fields, internal/modelcatalog/generalizations.go (InferFamilyCapabilities, BackfillCapabilities, StripRegionalModelPrefix) supplies explicit heuristic defaults (Inferred: true, Source: "family-pattern-heuristic") for context windows and capabilities (tools, streaming, vision, reasoning, structured outputs) without treating unverified catalog rates as verified for budgeted traffic.
Operation-Level Routing Enforcement (SupportedOperations)
In v1.6.0, checkDeploymentOperation (internal/router/reliability.go) enforces operation compatibility before dispatching a request:
- Adapter-level check: Adapters implementing
OperationSupportChecker.SupportsOperation(op)reject unsupported operations with HTTP501 Not Implemented(<op>_not_supported). - Model-level check: When
GlobalModel.SupportedOperationsis populated, requests for operations outside that allowlist are rejected with HTTP400 Bad Request(unsupported_operation).
Authentication Strategies
GoRoute abstracts vendor authentication into four distinct automated mechanisms:
- Standard Bearer Authentication (
BearerAuthStrategy): InjectsAuthorization: Bearer <token>automatically for 35+ providers. - Cryptographic AWS SigV4 (
SigV4Signer): Signs requests dynamically using IAM access keys, temporary session tokens, and regional HMAC-SHA256 calculations. - Google OAuth2 Assertion Exchange (
TokenSource): Signs RS256 JWT assertions with GCP Service Account private keys, exchanges them for access tokens withoauth2.googleapis.com, and handles background caching. - Microsoft Entra ID & API Key (
AzureAuthStrategy): Automatically distinguishes between standard Azure resource keys (api-key: <key>) and Entra ID tokens (Authorization: Bearer <token>).
Dynamic Routing & Model Aliases
Configure providers in configs/config.yaml using either explicit provider prefixes or virtual alias routing:
1. Direct Dynamic Prefix Routing
Call upstream providers directly by prefixing the model parameter:
# Routes directly to Cerebras Wafer-Scale Engine
curl -X POST http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-virtual-key" \
-H "Content-Type: application/json" \
-d '{"model": "cerebras/llama3.3-70b", "messages": [{"role": "user", "content": "Hello"}]}'
# Routes directly to Anthropic Claude 3.5 Sonnet
curl -X POST http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-virtual-key" \
-H "Content-Type: application/json" \
-d '{"model": "anthropic/claude-sonnet-5-5", "messages": [{"role": "user", "content": "Hello"}]}'
2. High-Availability Model Groups & Fallback Topologies
Define resilient model aliases in configs/config.yaml:
model_list:
# Fast Tier: Gemini 2.5 Flash with fallback to GPT-4o-mini
- model_name: fast
routing_strategy: weighted-shuffle
fallbacks: ["fast-backup"]
model_params:
model: gemini/gemini-2.5-flash
api_key: os.environ/GEMINI_API_KEY
weight: 100
- model_name: fast-backup
model_params:
model: openai/gpt-4o-mini
api_key: os.environ/OPENAI_API_KEY
# Reasoning Tier: Anthropic Claude Sonnet with fallback to Azure GPT-4o
- model_name: reasoning
routing_strategy: least-busy
fallbacks: ["azure-gpt4o"]
model_params:
model: anthropic/claude-sonnet-5-5
api_key: os.environ/ANTHROPIC_API_KEY
- model_name: azure-gpt4o
model_params:
model: azure/gpt-4o
api_key: os.environ/AZURE_OPENAI_API_KEY
api_base: "https://my-enterprise.openai.azure.com"
azure_deployment_name: "gpt-4o-prod"
api_version: "2024-08-01-preview"
Standard Response Telemetry
Every request processed across any of the 73 ProviderType profiles includes standardized audit and FinOps telemetry headers:
| Header | Description | Example |
|---|---|---|
X-Gateway-Request-Id | Unique UUID assigned to the client invocation | req_01h8a... |
X-Trace-Id | Distributed W3C trace ID for end-to-end tracing | 4bf92f3577b34da6a3ce929d0e0e4736 |
X-Gateway-Provider | The actual upstream provider that fulfilled the request | bedrock, cerebras, openai |
X-Gateway-Model | The upstream foundation model executed | anthropic.claude-sonnet-5-5 |
X-Gateway-Cost-Micros | Exact cost of the invocation in micro-dollars ($1 = 1,000,000 µ$) | 1250 ($0.001250) |
X-Gateway-Routing-Time | Gateway latency overhead before upstream dispatch | 4.2ms |
X-Gateway-Cache | Cache hit status (HIT or MISS) | HIT |
Retry-After | Cooldown period emitted during upstream 429 rate limit events | 60 |