FerroGate — Rust AI Gateway with MCP Support

Source: https://github.com/lianluo-esign/ferrogate Found: 2026-07-15 via GitHub search (topic: AI LLMOps/gateway/infra)

FerroGate is an open-source Rust API gateway and AI gateway built on Cloudflare Pingora. It provides an OpenAI-compatible interface (/v1/chat/completions, /v1/responses) with provider routing/fallback across OpenAI, Azure, Anthropic, Gemini, Grok, and OpenRouter. Key features include virtual API keys with per-tenant scoping, token budgets, rate limits, exact-match response caching, and governance policies.

Uniquely for an AI gateway, FerroGate natively handles MCP traffic — it has a POST /v1/mcp JSON-RPC ingress, governed tool execution, plugin registration, and isolated agent-worker execution via Firecracker micro-VMs. It ships with a billing service, Prometheus/OTLP observability, Helm chart, and Admin API.

The project is the open-source foundation behind Token4AI Cloud.

Relevance

Directly relevant to LLM gateway infrastructure, MCP tool governance, and AI traffic management — the current LLMOps/infra topic.