Documentation
Docs
Production

Deployment Patterns

Ship updates to non-deterministic systems with zero downtime and binary safety.

The Danger of Global Restarts

In a monolithic agent system, every update is a "Global Restart" that risks 100% outage. In Consonant, we treat agent updates as Isolated Transitions. We provide native support for several advanced deployment patterns designed specifically for the unpredictability of LLMs.

1. Blue/Green Runtimes

Deploy a completely new version of your "Researcher" agent (v2) alongside the current stable version (v1). The Consonant Control Plane will keep the mTLS session alive while shifting traffic seamlessly between pods.

2. Canary Deployments

Route a small percentage of "Goals" to the new agent version. Consonant automatically measures the Success Rate and Latency of the Canary. If the new agent starts hallucinating or crashing, the Control Plane automatically rolls back the traffic to the stable version.

yaml
# Canary Deployment Manifest
apiVersion: consonant/v1
kind: Rollout
metadata:
  name: smart-analyst-rollout
spec:
  agent: smart-analyst
  strategy:
    canary:
      weight: 10 # Start with 10% traffic
      interval: 5m
      maxSurge: 1

3. Shadow Mode (Dark Launch)

The most powerful tool for mission-critical agents. Consonant sends the exact same Goal and Context to both the stable and the shadow agent. The shadow agent's output is discarded, but its performance and results are logged and compared for accuracy in the dashboard.

A/B Testing Agents

You can use Shadow Mode to compare different models (e.g., GPT-4 vs Claude 3.5) on the same real-world production traffic without the user ever seeing a difference.