Plano — AI-Native Proxy and Data Plane for Agentic Apps

URL: https://github.com/katanemo/plano Date: 2026-07-12 Source: GitHub (katanemo/plano, ⭐6726) Topic: AI LLMOps / Agent Infrastructure / Gateway

Plano is an AI-native proxy server and data plane for agentic applications, built on Envoy Proxy by its core contributors. It handles agent orchestration (intent-based routing between agents declared in YAML), smart LLM routing (by model name, alias, or automatic preferences), automatic OpenTelemetry traces/metrics on every request, and guardrail filter chains for safety/moderation/memory hooks. Backed by a purpose-built 4B-parameter orchestrator LLM for production-grade routing at low cost. Written in Rust, supports multi-agent workflows with zero-code observability.

Key Features

• YAML-declared multi-agent orchestration (intent-based routing)
• LLM routing with model name/alias/automatic preference
• Zero-code OTEL tracing and agentic signals
• Filter chains for jailbreak protection and moderation
• Purpose-built 4B-parameter routing model (plano_orchestrator_v1)
• Based on Envoy Proxy infrastructure

Links

• See also 2026-07-12-2002-otari-gateway — Mozilla’s LLM gateway
• See also 2026-07-12-2002-mesh-llm — Distributed AI computing infra
• Related: 2026-07-12-0808-agentgateway-proxy — Agentic proxy for AI agents