Skip to main content

v1.5.0

Release Date: 2026-11-13
Theme: Enterprise Security Hardening, Redis Cluster Support, Durable FinOps, Streaming Guardrails & API Parity


Security & Multi-Tenant Authorization​

  • Operator RBAC & Inbound JWT/OIDC (internal/auth/, internal/server/handlers_admin.go): Added role-based operator authorization (platform_admin, org_admin, org_viewer) with organization-scoped control-plane enforcement, inbound JWT/OIDC verification, and disabled master-key data-plane fallback.
  • Fail-Closed Team Lookup & Allowlist Persistence (internal/storage/postgres.go): Enforced fail-closed team lookup error handling and persisted all team allowlists (allowed_models, allowed_mcp_servers, allowed_a2a_agents, allowed_client_apps) in PostgreSQL.
  • HTTP Security Headers & CORS Middleware (internal/server/security_headers.go): Added SecurityHeadersMiddleware (HSTS opt-in via server.enable_hsts, X-Content-Type-Options, X-Frame-Options, Referrer-Policy, Content-Security-Policy) and safe-by-default CORSMiddleware (server.cors_allowed_origins, server.cors_allow_credentials).
  • Per-Organization File Storage Quota & Upload Concurrency Limits (internal/server/handlers_files.go): Added server.max_file_storage_bytes_per_org (default 5 GiB, GATEWAY_MAX_FILE_STORAGE_BYTES_PER_ORG) and server.max_concurrent_file_uploads (default 8, GATEWAY_MAX_CONCURRENT_FILE_UPLOADS) with atomic in-flight reservation tracking (413 storage_quota_exceeded), bounded upload semaphore (429 upload_concurrency_limit), and explicit MultipartForm.RemoveAll() temporary spill-file cleanup.
  • Production Environment Hardening (internal/config/config.go): Updated Config.Validate() to treat both ENV=production and GATEWAY_ENV=production as production signals and reject default admin, encryption, or JWT secrets.
  • Credential & Key Hygiene: Restricted query-string credentials strictly to WebSocket upgrades (/v1/realtime), enforced expiry and revocation on cached virtual keys, and updated golang.org/x/net to v0.62.0.
  • CI & Supply-Chain Security: Pinned all GitHub Actions workflows (.github/workflows/ci.yml, .github/workflows/docker-publish.yml) to immutable 40-character commit SHAs, added .github/workflows/codeql.yml for Go and JavaScript/TypeScript analysis, and added .gitleaks.toml.

FinOps & Durable Micro-Dollar Accounting​

  • Durable Spend Event Outbox (migrations/0008_add_spend_event_outbox.up.sql): Added PostgreSQL spend event outbox with retryable delivery and idempotent Redis spend reconciliation keyed by event ID (gw:spend:applied:{org}).
  • Upper-Bound Budget Reservations & Lease Renewal (internal/finops/, internal/ratelimit/): Added pre-dispatch upper-bound budget reservation with automatic lease renewal for long-running/streaming requests and unified modality budget gating.
  • Budget Reset Period Advancement & PG/Redis Sync (migrations/0011_budget_reset_outbox.up.sql): Fixed PostgresRepository.ResetExpiredBudgetsWithIDs, synchronized entity spent_micros, and cleared Redis spend counters on period rollover.
  • Unpriced Usage & Modality Estimates: Surfaced unpriced_requests and unpriced_tokens in spend summaries instead of silently recording zero cost, and improved preflight token estimates for modality requests.

Routing, Reliability & Redis Cluster​

  • Redis Cluster & Sentinel Support (internal/storage/, internal/cache/): Upgraded RedisFabric to go-redis UniversalClient (storage.redis_addrs, storage.redis_master_name) with {org:<id>} hash-tagged Lua keys across rate limiting and response caching.
  • Embeddings Reliability & Shared Circuit Breakers (internal/router/): Wired ExecuteEmbeddings through ReliabilityManager retries/fallbacks, shared circuit-breaker failure counts and half-open probe leases in Redis across replicas, and fixed adaptive routing signals and least-busy reservation tracking.
  • Bounded Fallback Traversal & Streaming Retries: Added cycle and depth limits to fallback group traversal and exponential backoff for streaming retries before first output token.

Guardrails, MCP & A2A​

  • All-Role Scanning, Streaming Redaction & logging_only Mode (internal/guardrails/stream_filter.go, migrations/0010_guardrail_mode.up.sql): Expanded input scanning to all message roles, added output blocking and streaming chunk inspection/redaction, and added logging_only guardrail policy mode.
  • Fail-Closed Policy & Full Inference Coverage: Enforced fail-closed guardrail policy lookups, added provider-neutral scanner hooks, and extended guardrail evaluation across all supported inference endpoints.
  • A2A & MCP Hardening (internal/a2a/, internal/mcp/): Closed the A2A OpenAI bridge bypass, wired inbound/outbound A2A guardrails (RouterService.SetGuardrails), hardened MCP guardrail evaluation, and wired the native A2A gRPC server behind server.grpc_port (GATEWAY_GRPC_PORT).

API Compatibility & Distributed Caching​

  • OpenAI & Anthropic Wire Fidelity (internal/adapter/): Added forwarding for extra_body and unknown top-level parameters (ExtraParams), Anthropic-formatted error envelopes on /v1/messages, streaming TTS (/v1/audio/speech), and tools forwarding on /v1/responses.
  • Canonical Response Cache Keys & Shared Invalidation (internal/cache/): Keyed response cache entries by full canonical output-affecting request fields and propagated cache invalidation epochs across replicas via Redis.

Observability & Embedded Operator Web UI​

  • OTLP Distributed Tracing & Uniform Reservoir Sampling (internal/observability/): Added optional OTLP/HTTP distributed tracing (tracing.otlp_endpoint, gen_ai.* span attributes) routed through the outbound SSRF policy, and replaced rolling-overwrite latency histograms with Vitter Algorithm R uniform reservoir sampling.
  • Structured Log Scrubbing & Protected Metrics (internal/logger/): Added logger.ScrubSecrets to mask credentials in structured logs, protected /metrics with admin bearer authentication, and bounded Prometheus label cardinality.
  • Operator Web UI Hardening (web/, internal/ui/): Repaired JSON field bindings, cleared React Query cache on Control Plane lock, self-hosted fonts (zero external font CDN calls), decoupled Playground/Agentic secrets, added GET /admin/v1/mcp/tools, and enforced CI internal/ui/dist parity.