v1.5.0
Release Date: 2026-11-13
Theme: Enterprise Security Hardening, Redis Cluster Support, Durable FinOps, Streaming Guardrails & API Parity
Security & Multi-Tenant Authorization
- Operator RBAC & Inbound JWT/OIDC (
internal/auth/,internal/server/handlers_admin.go): Added role-based operator authorization (platform_admin,org_admin,org_viewer) with organization-scoped control-plane enforcement, inbound JWT/OIDC verification, and disabled master-key data-plane fallback. - Fail-Closed Team Lookup & Allowlist Persistence (
internal/storage/postgres.go): Enforced fail-closed team lookup error handling and persisted all team allowlists (allowed_models,allowed_mcp_servers,allowed_a2a_agents,allowed_client_apps) in PostgreSQL. - HTTP Security Headers & CORS Middleware (
internal/server/security_headers.go): AddedSecurityHeadersMiddleware(HSTS opt-in viaserver.enable_hsts,X-Content-Type-Options,X-Frame-Options,Referrer-Policy,Content-Security-Policy) and safe-by-defaultCORSMiddleware(server.cors_allowed_origins,server.cors_allow_credentials). - Per-Organization File Storage Quota & Upload Concurrency Limits (
internal/server/handlers_files.go): Addedserver.max_file_storage_bytes_per_org(default5 GiB,GATEWAY_MAX_FILE_STORAGE_BYTES_PER_ORG) andserver.max_concurrent_file_uploads(default8,GATEWAY_MAX_CONCURRENT_FILE_UPLOADS) with atomic in-flight reservation tracking (413 storage_quota_exceeded), bounded upload semaphore (429 upload_concurrency_limit), and explicitMultipartForm.RemoveAll()temporary spill-file cleanup. - Production Environment Hardening (
internal/config/config.go): UpdatedConfig.Validate()to treat bothENV=productionandGATEWAY_ENV=productionas production signals and reject default admin, encryption, or JWT secrets. - Credential & Key Hygiene: Restricted query-string credentials strictly to WebSocket upgrades (
/v1/realtime), enforced expiry and revocation on cached virtual keys, and updatedgolang.org/x/nettov0.62.0. - CI & Supply-Chain Security: Pinned all GitHub Actions workflows (
.github/workflows/ci.yml,.github/workflows/docker-publish.yml) to immutable 40-character commit SHAs, added.github/workflows/codeql.ymlfor Go and JavaScript/TypeScript analysis, and added.gitleaks.toml.
FinOps & Durable Micro-Dollar Accounting
- Durable Spend Event Outbox (
migrations/0008_add_spend_event_outbox.up.sql): Added PostgreSQL spend event outbox with retryable delivery and idempotent Redis spend reconciliation keyed by event ID (gw:spend:applied:{org}). - Upper-Bound Budget Reservations & Lease Renewal (
internal/finops/,internal/ratelimit/): Added pre-dispatch upper-bound budget reservation with automatic lease renewal for long-running/streaming requests and unified modality budget gating. - Budget Reset Period Advancement & PG/Redis Sync (
migrations/0011_budget_reset_outbox.up.sql): FixedPostgresRepository.ResetExpiredBudgetsWithIDs, synchronized entityspent_micros, and cleared Redis spend counters on period rollover. - Unpriced Usage & Modality Estimates: Surfaced
unpriced_requestsandunpriced_tokensin spend summaries instead of silently recording zero cost, and improved preflight token estimates for modality requests.
Routing, Reliability & Redis Cluster
- Redis Cluster & Sentinel Support (
internal/storage/,internal/cache/): UpgradedRedisFabrictogo-redisUniversalClient(storage.redis_addrs,storage.redis_master_name) with{org:<id>}hash-tagged Lua keys across rate limiting and response caching. - Embeddings Reliability & Shared Circuit Breakers (
internal/router/): WiredExecuteEmbeddingsthroughReliabilityManagerretries/fallbacks, shared circuit-breaker failure counts and half-open probe leases in Redis across replicas, and fixed adaptive routing signals and least-busy reservation tracking. - Bounded Fallback Traversal & Streaming Retries: Added cycle and depth limits to fallback group traversal and exponential backoff for streaming retries before first output token.
Guardrails, MCP & A2A
- All-Role Scanning, Streaming Redaction &
logging_onlyMode (internal/guardrails/stream_filter.go,migrations/0010_guardrail_mode.up.sql): Expanded input scanning to all message roles, added output blocking and streaming chunk inspection/redaction, and addedlogging_onlyguardrail policy mode. - Fail-Closed Policy & Full Inference Coverage: Enforced fail-closed guardrail policy lookups, added provider-neutral scanner hooks, and extended guardrail evaluation across all supported inference endpoints.
- A2A & MCP Hardening (
internal/a2a/,internal/mcp/): Closed the A2A OpenAI bridge bypass, wired inbound/outbound A2A guardrails (RouterService.SetGuardrails), hardened MCP guardrail evaluation, and wired the native A2A gRPC server behindserver.grpc_port(GATEWAY_GRPC_PORT).
API Compatibility & Distributed Caching
- OpenAI & Anthropic Wire Fidelity (
internal/adapter/): Added forwarding forextra_bodyand unknown top-level parameters (ExtraParams), Anthropic-formatted error envelopes on/v1/messages, streaming TTS (/v1/audio/speech), andtoolsforwarding on/v1/responses. - Canonical Response Cache Keys & Shared Invalidation (
internal/cache/): Keyed response cache entries by full canonical output-affecting request fields and propagated cache invalidation epochs across replicas via Redis.
Observability & Embedded Operator Web UI
- OTLP Distributed Tracing & Uniform Reservoir Sampling (
internal/observability/): Added optional OTLP/HTTP distributed tracing (tracing.otlp_endpoint,gen_ai.*span attributes) routed through the outbound SSRF policy, and replaced rolling-overwrite latency histograms with Vitter Algorithm R uniform reservoir sampling. - Structured Log Scrubbing & Protected Metrics (
internal/logger/): Addedlogger.ScrubSecretsto mask credentials in structured logs, protected/metricswith admin bearer authentication, and bounded Prometheus label cardinality. - Operator Web UI Hardening (
web/,internal/ui/): Repaired JSON field bindings, cleared React Query cache on Control Plane lock, self-hosted fonts (zero external font CDN calls), decoupled Playground/Agentic secrets, addedGET /admin/v1/mcp/tools, and enforced CIinternal/ui/distparity.