MCP session guard policy (v1.0)
Added mcp-session-guard-inbound policy v1.0 for MCP sessions. It supports the 2024-11-05 MCP spec.
Changelog
What's new in Zuplo
Product updates, policies, and config changes. Follow Dispatch.
Configurable LLM routing retry backoff
LLM routing supports retry backoff per provider. Configure backoffMs and maxAttempts for each provider.
Token budget rate limiting
Token budget rate limiting reads usage.total_tokens from OpenAI and Anthropic responses, keeps a daily counter, and returns 429 when a budget is exceeded.
Cohere provider added to LLM routing
Added Cohere Command-R and Command-R+ to LLM routing. Set "id": "cohere" in the provider configuration.
Audit log export (Scale and Enterprise)
Export audit logs to S3-compatible storage or a webhook. Available on Scale and Enterprise plans.
Rate limit window reset timing corrected
Fixed sliding-window rate limit counters resetting up to 200ms early at burst traffic above 2,000 requests per second. Applies to Builder and above.
JWT validation policy (v2)
JWT inbound policy v2 adds JWKS auto-refresh, RS256 and ES256 algorithms, and claim-based consumer identity mapping.