Plano is an AI-native proxy server and data plane for agentic applications. Built on Envoy by its core contributors.
Key capabilities:
- Orchestration: Low-latency orchestration between agents; add new agents without modifying app code
- Model Agility: Route by model name, alias, or automatically via preferences
- Agentic Signals: Zero-code capture of signals plus OTEL traces/metrics across every agent
- Moderation and Memory Hooks: Jailbreak protection, moderation policies, memory via Filter Chains
- Smart LLM Routing: Use Plano as an LLM router with semantic names and provider fallbacks
Supports OpenAI, Anthropic, and any OpenAI-compatible provider. ⭐6.8k on GitHub.