Deployment Patterns
Ship updates to non-deterministic systems with zero downtime and binary safety.
The Danger of Global Restarts
In a monolithic agent system, every update is a "Global Restart" that risks 100% outage. In Consonant, we treat agent updates as Isolated Transitions. We provide native support for several advanced deployment patterns designed specifically for the unpredictability of LLMs.
1. Blue/Green Runtimes
Deploy a completely new version of your "Researcher" agent (v2) alongside the current stable version (v1). The Consonant Control Plane will keep the mTLS session alive while shifting traffic seamlessly between pods.
2. Canary Deployments
Route a small percentage of "Goals" to the new agent version. Consonant automatically measures the Success Rate and Latency of the Canary. If the new agent starts hallucinating or crashing, the Control Plane automatically rolls back the traffic to the stable version.
# Canary Deployment Manifest
apiVersion: consonant/v1
kind: Rollout
metadata:
name: smart-analyst-rollout
spec:
agent: smart-analyst
strategy:
canary:
weight: 10 # Start with 10% traffic
interval: 5m
maxSurge: 13. Shadow Mode (Dark Launch)
The most powerful tool for mission-critical agents. Consonant sends the exact same Goal and Context to both the stable and the shadow agent. The shadow agent's output is discarded, but its performance and results are logged and compared for accuracy in the dashboard.
A/B Testing Agents
You can use Shadow Mode to compare different models (e.g., GPT-4 vs Claude 3.5) on the same real-world production traffic without the user ever seeing a difference.