Skip to main content

Providers Overview

GoRoute connects applications to different hosted and local AI providers through a consistent gateway interface. This means your application can keep using the same connection while you change or add providers behind it. The catalog lists supported provider integrations; model names and availability depend on the provider and your GoRoute configuration.

The catalog includes 73 ProviderType profiles plus CustomOpenAICompatible endpoints. GoRoute handles the protocol translation, authentication, credential storage, retries, and usage tracking needed for each supported integration.

GoRoute Core Engine Standard OpenAI Protocol Client Application / SDK GoRoute AI Gateway Native OpenAI Adapter(Chat, reasoning, audio, images, embeddings) Native Anthropic Adapter(Claude Messages API) Native Gemini & Vertex Adapters(Gemini API, multimodal, Imagen) Native AWS Bedrock Adapter(SigV4, foundation model APIs) Native Azure OpenAI Adapter(API Key, Entra ID, Version Pinning) Native Cohere Adapter(Command R+, Embed v3, Rerank v3.5) OpenAI-Compatible Dialect Engine(60+ Built-in & Extended Profiles: Cerebras, Groq, DeepSeek, Together, vLLM, etc.) Model Router & Failover FinOps Cost & Token Ledger SSRF Network Hardening

Interactive Provider Catalog​

Filter all 73 ProviderType profiles and CustomOpenAICompatible by adapter tier, category, or capability, and click any provider ID to copy it for configuration.

74Total Profiles
8Native Adapters
65Certified Dialects
74Matching Filters
Capabilities:
Showing 74 of 74 provider profiles
Native Adapter
Cloud Flagship•Bearer Token
https://api.openai.com/v1
Full native adapter supporting Chat, Responses, Realtime WebSocket, Audio, Images, Files, Batches, and Moderations.
ChatStreamingToolsVisionReasoningEmbeddingsJSON SchemaAudioImages/models sync
Native Adapter
Cloud Flagship•x-api-key
https://api.anthropic.com/v1
Native /v1/messages & /anthropic/v1/messages support, extended thinking, prompt caching, and count_tokens.
ChatStreamingToolsVisionReasoningJSON Schema/models sync
Native Adapter
Cloud Flagship•API Key / OAuth
https://generativelanguage.googleapis.com/v1beta
Native GenerateContent wire translation with thought-signature & multi-modal support.
ChatStreamingToolsVisionReasoningEmbeddingsJSON Schema/models sync
Native Adapter
Cloud Flagship•Bearer Token
https://api.mistral.ai/v1
ChatStreamingToolsVisionEmbeddingsJSON Schema/models sync
Native Adapter
Local & Self-Hosted•None (Local)
http://localhost:11434
ChatStreamingToolsVisionEmbeddingsJSON Schema/models sync
Native Adapter
Cloud Flagship•AWS SigV4
https://bedrock-runtime.<region>.amazonaws.com
Native AWS SigV4 signing and Converse / ConverseStream API translation.
ChatStreamingToolsVisionReasoningEmbeddings
Native Adapter
Cloud Flagship•GCP Service Account / OAuth2
https://<region>-aiplatform.googleapis.com
ChatStreamingToolsVisionReasoningEmbeddingsJSON Schema
Native Adapter
Cloud Flagship•Bearer Token
https://api.cohere.com/v2
Native v2 Chat, Embeddings, and Rerank API support.
ChatStreamingToolsEmbeddingsRerankJSON Schema/models sync
Fast Inference•Bearer Token
https://api.groq.com/openai/v1
Supports Audio STT/TTS and strips unsupported logprobs/service_tier parameters.
ChatStreamingToolsVisionJSON SchemaAudio/models sync
Launch Set
Cloud Flagship•Bearer Token
https://api.deepseek.com/v1
Extracts reasoning_content deltas and enforces reasoner/R1 parameter constraints.
ChatStreamingToolsReasoningJSON Schema/models sync
Launch Set
Fast Inference•Bearer Token
https://api.together.xyz/v1
ChatStreamingToolsEmbeddingsRerankJSON Schema/models sync
Cloud Flagship•api-key / Entra ID
https://<resource>.openai.azure.com
Per-deployment endpoint strategy and api-version query parameter handling.
ChatStreamingToolsVisionEmbeddingsJSON Schema

Cerebras Wafer-Scale Engine

Built-in Dialect
Fast Inference•Bearer Token
https://api.cerebras.ai/v1
ChatStreamingToolsJSON Schema/models sync

SambaNova Systems

Built-in Dialect
Fast Inference•Bearer Token
https://api.sambanova.ai/v1
ChatStreamingToolsReasoningJSON Schema/models sync

xAI (Grok)

Built-in Dialect
Cloud Flagship•Bearer Token
https://api.x.ai/v1
ChatStreamingToolsVisionReasoningJSON SchemaImagesAudio/models sync

Fireworks AI

Built-in Dialect
Fast Inference•Bearer Token
https://api.fireworks.ai/inference/v1
ChatStreamingToolsVisionEmbeddingsRerankJSON SchemaImagesAudio/models sync

Perplexity AI

Built-in Dialect
Specialized & Embeddings•Bearer Token
https://api.perplexity.ai
ChatStreaming

Anyscale Endpoints

Built-in Dialect
Fast Inference•Bearer Token
https://api.endpoints.anyscale.com/v1
ChatStreamingToolsEmbeddingsJSON Schema/models sync

DeepInfra

Built-in Dialect
Fast Inference•Bearer Token
https://api.deepinfra.com/v1/openai
ChatStreamingToolsEmbeddingsJSON Schema/models sync

Novita AI

Built-in Dialect
Fast Inference•Bearer Token
https://api.novita.ai/v3/openai
ChatStreamingToolsReasoningEmbeddingsRerankJSON Schema/models sync

Nebius AI Studio

Built-in Dialect
Fast Inference•Bearer Token
https://api.studio.nebius.ai/v1
ChatStreamingToolsReasoningJSON Schema/models sync

Hyperbolic AI

Built-in Dialect
Fast Inference•Bearer Token
https://api.hyperbolic.xyz/v1
ChatStreamingToolsReasoningJSON Schema/models sync

Lambda Labs Inference

Built-in Dialect
Fast Inference•Bearer Token
https://api.lambdalabs.com/v1
ChatStreamingTools/models sync

Friendli AI

Built-in Dialect
Fast Inference•Bearer Token
https://inference.friendli.ai/v1
ChatStreamingToolsJSON Schema/models sync

OpenRouter

Built-in Dialect
Aggregators & Gateways•Bearer Token
https://openrouter.ai/api/v1
ChatStreamingToolsVisionReasoningJSON Schema/models sync

vLLM Local / Self-Hosted

Built-in Dialect
Local & Self-Hosted•Bearer Token (Optional)
http://localhost:8000/v1
ChatStreamingToolsEmbeddingsJSON Schema/models sync

Cloudflare Workers AI

Built-in Dialect
Cloud Flagship•Bearer Token
https://api.cloudflare.com/client/v4/ai/v1
ChatStreamingToolsEmbeddingsAudio

Databricks Model Serving

Built-in Dialect
Cloud Flagship•Bearer Token
https://<workspace>.cloud.databricks.com/serving-endpoints
ChatStreamingToolsEmbeddingsJSON Schema

Snowflake Cortex REST API

Built-in Dialect
Cloud Flagship•Bearer Token / Key-Pair JWT
https://<account>.snowflakecomputing.com/api/v2/cortex/inference
ChatStreamingToolsEmbeddings

Alibaba Cloud DashScope (Qwen)

Built-in Dialect
Regional & International•Bearer Token
https://dashscope.aliyuncs.com/compatible-mode/v1
ChatStreamingToolsVisionEmbeddingsJSON Schema/models sync

ByteDance Volcengine (Doubao)

Built-in Dialect
Regional & International•Bearer Token
https://ark.cn-beijing.volces.com/api/v3
ChatStreamingToolsVisionReasoningJSON Schema

Zhipu AI BigModel (GLM)

Built-in Dialect
Regional & International•Bearer Token
https://open.bigmodel.cn/api/paas/v4
ChatStreamingToolsVisionEmbeddingsJSON Schema

Moonshot AI (Kimi)

Built-in Dialect
Regional & International•Bearer Token
https://api.moonshot.cn/v1
ChatStreamingToolsJSON Schema/models sync

MiniMax

Built-in Dialect
Regional & International•Bearer Token
https://api.minimax.chat/v1
ChatStreamingToolsReasoningJSON Schema

SiliconFlow

Built-in Dialect
Regional & International•Bearer Token
https://api.siliconflow.cn/v1
ChatStreamingToolsReasoningEmbeddingsJSON Schema/models sync

Voyage AI

Built-in Dialect
Specialized & Embeddings•Bearer Token
https://api.voyageai.com/v1
EmbeddingsRerank

Jina AI

Built-in Dialect
Specialized & Embeddings•Bearer Token
https://api.jina.ai/v1
EmbeddingsRerank

Replicate Deployments

Built-in Dialect
Fast Inference•Bearer Token
https://api.replicate.com/v1
ChatStreamingTools

AI21 Labs Studio

Built-in Dialect
Cloud Flagship•Bearer Token
https://api.ai21.com/studio/v1
ChatStreamingTools

Baseten Model Gateway

Built-in Dialect
Fast Inference•Bearer Token
https://bridge.baseten.co/v1
ChatStreamingTools

NVIDIA NIM APIs

Built-in Dialect
Fast Inference•Bearer Token
https://integrate.api.nvidia.com/v1
ChatStreamingToolsVisionRerankJSON Schema/models sync

Scaleway Generative APIs

Built-in Dialect
Regional & International•Bearer Token
https://api.scaleway.ai/v1
ChatStreamingTools/models sync

GitHub Copilot

Extended Dialect
Aggregators & Gateways•Bearer Token
https://api.githubcopilot.com
ChatStreamingToolsReasoningJSON Schema/models sync

Vercel AI Gateway

Extended Dialect
Aggregators & Gateways•Bearer Token
https://ai-gateway.vercel.sh/v1
ChatStreamingToolsReasoningEmbeddingsJSON Schema/models sync

Hugging Face Inference

Extended Dialect
Aggregators & Gateways•Bearer Token
https://router.huggingface.co/v1
ChatStreamingToolsEmbeddingsJSON Schema

Featherless AI

Extended Dialect
Fast Inference•Bearer Token
https://api.featherless.ai/v1
ChatStreamingToolsJSON Schema/models sync

fal.ai

Extended Dialect
Specialized & Embeddings•Bearer Token
https://fal.run/openrouter/router/openai/v1
ChatStreamingToolsJSON SchemaImages

Z.ai

Extended Dialect
Regional & International•Bearer Token
https://api.z.ai/api/paas/v4
ChatStreamingToolsReasoningJSON Schema

Poe

Extended Dialect
Aggregators & Gateways•Bearer Token
https://api.poe.com/v1
ChatStreamingToolsJSON Schema/models sync

Helicone AI Gateway

Extended Dialect
Aggregators & Gateways•Bearer Token
https://ai-gateway.helicone.ai/v1
ChatStreamingToolsJSON Schema/models sync

AIHubMix

Extended Dialect
Aggregators & Gateways•Bearer Token
https://aihubmix.com/v1
ChatStreamingToolsReasoningEmbeddingsJSON Schema/models sync

Venice AI

Extended Dialect
Fast Inference•Bearer Token
https://api.venice.ai/api/v1
ChatStreamingToolsJSON Schema/models sync

Chutes AI

Extended Dialect
Fast Inference•Bearer Token
https://llm.chutes.ai/v1
ChatStreamingToolsReasoningJSON Schema/models sync

GMI Cloud

Extended Dialect
Fast Inference•Bearer Token
https://api.gmi-serving.com/v1
ChatStreamingToolsJSON Schema/models sync

LlamaGate

Extended Dialect
Aggregators & Gateways•Bearer Token
https://api.llamagate.dev/v1
ChatStreamingToolsJSON Schema/models sync

Sarvam AI

Extended Dialect
Regional & International•api-subscription-key
https://api.sarvam.ai/v1
ChatStreamingToolsJSON Schema

Crusoe Cloud

Extended Dialect
Fast Inference•Bearer Token
https://managed-inference.crusoecloud.com/v1
ChatStreamingToolsJSON Schema/models sync

Parasail

Extended Dialect
Fast Inference•Bearer Token
https://api.parasail.io/v1
ChatStreamingToolsJSON Schema/models sync

Upstage Solar

Extended Dialect
Regional & International•Bearer Token
https://api.upstage.ai/v1/solar
ChatStreamingToolsEmbeddingsJSON Schema

OVHcloud AI Endpoints

Extended Dialect
Regional & International•Bearer Token
https://oai.endpoints.kepler.ai.cloud.ovh.net/v1
ChatStreamingToolsEmbeddingsJSON Schema/models sync

W&B Inference

Extended Dialect
Fast Inference•Bearer Token
https://api.inference.wandb.ai/v1
ChatStreamingToolsReasoningJSON Schema/models sync

Nscale

Extended Dialect
Fast Inference•Bearer Token
https://inference.api.nscale.com/v1
ChatStreamingToolsJSON Schema/models sync

Public AI

Extended Dialect
Regional & International•Bearer Token
https://api.publicai.co/v1
ChatStreamingToolsJSON Schema/models sync

Synthetic

Extended Dialect
Fast Inference•Bearer Token
https://api.synthetic.new/openai/v1
ChatStreamingToolsReasoningJSON Schema/models sync

NanoGPT

Extended Dialect
Aggregators & Gateways•Bearer Token
https://nano-gpt.com/api/v1
ChatStreamingToolsReasoningJSON Schema/models sync

Xiaomi MiMo

Extended Dialect
Regional & International•Bearer Token
https://api.xiaomimimo.com/v1
ChatStreamingToolsReasoningJSON Schema

Reka AI

Extended Dialect
Cloud Flagship•Bearer Token
https://api.reka.ai/v1
ChatStreamingToolsJSON Schema

01.AI (Yi)

Extended Dialect
Regional & International•Bearer Token
https://api.lingyiwanwu.com/v1
ChatStreamingToolsJSON Schema/models sync

Baichuan AI

Extended Dialect
Regional & International•Bearer Token
https://api.baichuan-ai.com/v1
ChatStreamingToolsJSON Schema

StepFun

Extended Dialect
Regional & International•Bearer Token
https://api.stepfun.com/v1
ChatStreamingToolsJSON Schema/models sync

LM Studio (Local)

Extended Dialect
Local & Self-Hosted•Bearer Token (Optional)
http://localhost:1234/v1
ChatStreamingToolsReasoningEmbeddingsJSON Schema/models sync

llamafile (Local)

Extended Dialect
Local & Self-Hosted•Bearer Token (Optional)
http://localhost:8080/v1
ChatStreamingToolsEmbeddingsJSON Schema/models sync

Xorbits Inference

Extended Dialect
Local & Self-Hosted•Bearer Token (Optional)
http://localhost:9997/v1
ChatStreamingToolsEmbeddingsJSON Schema/models sync
Local & Self-Hosted•Configurable (Bearer / Custom Header)
https://<your-endpoint>/v1
Register arbitrary internal or third-party OpenAI-compatible endpoints via providers.custom_openai_compatible.
ChatStreamingToolsEmbeddingsJSON Schema/models sync

Provider Integration Matrix (73 ProviderType Profiles)​

GoRoute registers 73 ProviderType profiles in AllProviders() (internal/domain/inference.go), combining dedicated native protocol adapters (openai, anthropic, gemini, bedrock, vertex, azure, cohere, mistral, ollama), 60+ certified OpenAI-compatible dialect profiles (internal/adapter/openaicompat/builtin_profiles.go and extended_profiles.go), and CustomOpenAICompatible for arbitrary self-hosted or private endpoints.

This matrix highlights core native adapters and representative dialect integrations. Model IDs change more often than adapters do, so model names shown in this guide and linked provider pages are representative examples, not an exhaustive or guaranteed-current inventory.

ProviderAdapter TypeSupported ModalitiesStreamingToolsAuth StrategyGuide
OpenAINative AdapterChat, Embed, Moderation, Audio, Images, Batches, RealtimeYesYesBearer Token (OPENAI_API_KEY)OpenAI
AnthropicNative MessagesChatYesYesx-api-key (ANTHROPIC_API_KEY)Anthropic Claude
Google GeminiNative GeminiChat, Embed, Multimodal Audio/Vision, ImagenYesYesx-goog-api-key (GEMINI_API_KEY)Google Gemini
AWS BedrockNative ConverseChat, Embed, ToolsYes (EventStream)YesAWS SigV4 HMAC-SHA256AWS Bedrock
Google Vertex AINative VertexChat, Embed, MultimodalYes (SSE)YesGCP SA JSON / OAuth2 BearerGoogle Vertex
Azure OpenAINative AzureChat, Embed, VisionYesYesapi-key / Entra ID BearerAzure OpenAI
CohereNative Cohere v2Chat, Embed, RerankYesYesBearer Token (COHERE_API_KEY)Cohere
Mistral AINative AdapterChat, Embed, ToolsYesYesBearer Token (MISTRAL_API_KEY)Mistral AI
OllamaNative LocalChat, EmbedYes (NDJSON)NoNone / Base URL (http://localhost:11434)Ollama
GroqCertified DialectChat, VisionYesYesBearer TokenDialects
DeepSeekCertified DialectChat, ReasoningYes (Reasoning)YesBearer TokenDialects
Together AICertified DialectChat, Embed, VisionYesYesBearer TokenDialects
CerebrasCertified DialectChatYesYesBearer TokenDialects
SambaNovaCertified DialectChat, ReasoningYes (Reasoning)YesBearer TokenDialects
xAI (Grok)Certified DialectChat, Vision, ReasoningYes (Reasoning)YesBearer TokenDialects
Fireworks AICertified DialectChat, Embed, VisionYesYesBearer TokenDialects
Perplexity AICertified DialectChat, Search CitationsYesNoBearer TokenDialects
AnyscaleCertified DialectChat, EmbedYesYesBearer TokenDialects
DeepInfraCertified DialectChat, EmbedYesYesBearer TokenDialects
Novita AICertified DialectChat, Embed, ReasoningYes (Reasoning)YesBearer TokenDialects
Nebius AI StudioCertified DialectChat, ReasoningYes (Reasoning)YesBearer TokenDialects
HyperbolicCertified DialectChat, ReasoningYes (Reasoning)YesBearer TokenDialects
Lambda LabsCertified DialectChatYesYesBearer TokenDialects
Friendli AICertified DialectChatYesYesBearer TokenDialects
OpenRouterCertified DialectChat, Vision, ReasoningYes (Reasoning)YesBearer TokenDialects
vLLMCertified DialectChat, EmbedYesYesNone / Bearer TokenDialects
CloudflareCertified DialectChat, EmbedYesYesCloudflare API TokenDialects
DatabricksCertified DialectChat, EmbedYesYesDatabricks Personal Access TokenDialects
Snowflake CortexCertified DialectChat, EmbedYesYesSnowflake JWT / Session TokenDialects
DashScope (Qwen)Certified DialectChat, Embed, VisionYesYesBearer TokenDialects
VolcengineCertified DialectChat, Vision, ReasoningYes (Reasoning)YesBearer TokenDialects
BigModel (GLM)Certified DialectChat, Embed, VisionYesYesBearer TokenDialects
Moonshot (Kimi)Certified DialectChatYesYesBearer TokenDialects
MiniMaxCertified DialectChat, ReasoningYes (Reasoning)YesBearer TokenDialects
SiliconFlowCertified DialectChat, Embed, ReasoningYes (Reasoning)YesBearer TokenDialects
Voyage AICertified DialectEmbeddingsNoNoBearer TokenDialects
Jina AICertified DialectEmbeddings, RerankNoNoBearer TokenDialects
ReplicateCertified DialectChatYesYesBearer TokenDialects
AI21 LabsCertified DialectChatYesYesBearer TokenDialects
BasetenCertified DialectChatYesYesBearer TokenDialects
NVIDIA NIMCertified DialectChat, VisionYesYesBearer TokenDialects
ScalewayCertified DialectChatYesYesBearer TokenDialects

Find model IDs available to your key​

Use the provider's current model documentation to choose an ID, then check the gateway's tenant-filtered GET /v1/models inventory with the same virtual key your application will use. That inventory is the reference for models currently exposed to that caller. Provider access, gateway catalog discovery/sync settings, organization policies, and key allowlists can all affect availability. A model listed by a provider is not by itself confirmation that a particular GoRoute deployment can route it.

When catalog discovery is enabled, the gateway can synchronize models exposed by supported providers. Discovery does not make every provider model universally available: provider credentials, adapter/protocol compatibility, organization policy, and virtual-key permissions still apply. See Model Management & Access Control and model catalog configuration.

Embedded Model Catalog & Capability Generalizations (v1.6.0)​

GoRoute embeds a curated catalog of 4,627 models (internal/modelcatalog/catalog.json.gz) with operation-level support and modality pricing provenance. When a model is not yet in the catalog or has CapabilityUnknown fields, internal/modelcatalog/generalizations.go (InferFamilyCapabilities, BackfillCapabilities, StripRegionalModelPrefix) supplies explicit heuristic defaults (Inferred: true, Source: "family-pattern-heuristic") for context windows and capabilities (tools, streaming, vision, reasoning, structured outputs) without treating unverified catalog rates as verified for budgeted traffic.

Operation-Level Routing Enforcement (SupportedOperations)​

In v1.6.0, checkDeploymentOperation (internal/router/reliability.go) enforces operation compatibility before dispatching a request:

  • Adapter-level check: Adapters implementing OperationSupportChecker.SupportsOperation(op) reject unsupported operations with HTTP 501 Not Implemented (<op>_not_supported).
  • Model-level check: When GlobalModel.SupportedOperations is populated, requests for operations outside that allowlist are rejected with HTTP 400 Bad Request (unsupported_operation).

Authentication Strategies​

GoRoute abstracts vendor authentication into four distinct automated mechanisms:

  1. Standard Bearer Authentication (BearerAuthStrategy): Injects Authorization: Bearer <token> automatically for 35+ providers.
  2. Cryptographic AWS SigV4 (SigV4Signer): Signs requests dynamically using IAM access keys, temporary session tokens, and regional HMAC-SHA256 calculations.
  3. Google OAuth2 Assertion Exchange (TokenSource): Signs RS256 JWT assertions with GCP Service Account private keys, exchanges them for access tokens with oauth2.googleapis.com, and handles background caching.
  4. Microsoft Entra ID & API Key (AzureAuthStrategy): Automatically distinguishes between standard Azure resource keys (api-key: <key>) and Entra ID tokens (Authorization: Bearer <token>).

Dynamic Routing & Model Aliases​

Configure providers in configs/config.yaml using either explicit provider prefixes or virtual alias routing:

1. Direct Dynamic Prefix Routing​

Call upstream providers directly by prefixing the model parameter:

# Routes directly to Cerebras Wafer-Scale Engine
curl -X POST http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-virtual-key" \
-H "Content-Type: application/json" \
-d '{"model": "cerebras/llama3.3-70b", "messages": [{"role": "user", "content": "Hello"}]}'

# Routes directly to Anthropic Claude 3.5 Sonnet
curl -X POST http://localhost:8080/v1/chat/completions \
-H "Authorization: Bearer your-virtual-key" \
-H "Content-Type: application/json" \
-d '{"model": "anthropic/claude-sonnet-5-5", "messages": [{"role": "user", "content": "Hello"}]}'

2. High-Availability Model Groups & Fallback Topologies​

Define resilient model aliases in configs/config.yaml:

model_list:
# Fast Tier: Gemini 2.5 Flash with fallback to GPT-4o-mini
- model_name: fast
routing_strategy: weighted-shuffle
fallbacks: ["fast-backup"]
model_params:
model: gemini/gemini-2.5-flash
api_key: os.environ/GEMINI_API_KEY
weight: 100

- model_name: fast-backup
model_params:
model: openai/gpt-4o-mini
api_key: os.environ/OPENAI_API_KEY

# Reasoning Tier: Anthropic Claude Sonnet with fallback to Azure GPT-4o
- model_name: reasoning
routing_strategy: least-busy
fallbacks: ["azure-gpt4o"]
model_params:
model: anthropic/claude-sonnet-5-5
api_key: os.environ/ANTHROPIC_API_KEY

- model_name: azure-gpt4o
model_params:
model: azure/gpt-4o
api_key: os.environ/AZURE_OPENAI_API_KEY
api_base: "https://my-enterprise.openai.azure.com"
azure_deployment_name: "gpt-4o-prod"
api_version: "2024-08-01-preview"

Standard Response Telemetry​

Every request processed across any of the 73 ProviderType profiles includes standardized audit and FinOps telemetry headers:

HeaderDescriptionExample
X-Gateway-Request-IdUnique UUID assigned to the client invocationreq_01h8a...
X-Trace-IdDistributed W3C trace ID for end-to-end tracing4bf92f3577b34da6a3ce929d0e0e4736
X-Gateway-ProviderThe actual upstream provider that fulfilled the requestbedrock, cerebras, openai
X-Gateway-ModelThe upstream foundation model executedanthropic.claude-sonnet-5-5
X-Gateway-Cost-MicrosExact cost of the invocation in micro-dollars ($1 = 1,000,000 µ$)1250 ($0.001250)
X-Gateway-Routing-TimeGateway latency overhead before upstream dispatch4.2ms
X-Gateway-CacheCache hit status (HIT or MISS)HIT
Retry-AfterCooldown period emitted during upstream 429 rate limit events60