LLMProxyAI Security Gateway

Security-first proxy for Large Language Models with multi-provider routing, ring-based plugin pipeline, and real-time threat monitoring.

Security Pipeline

10-layer defense with ASGI firewall, injection scoring, PII masking (Presidio NLP + regex), and multi-turn trajectory detection.

5-ring pipeline (Ingress, Pre-Flight, Routing, Post-Flight, Background) with 18 marketplace plugins and WASM sandbox support.

OpenAI, Anthropic, Google, Azure, Ollama, Groq, Together, Mistral, DeepSeek, xAI, Perplexity, OpenRouter, Fireworks, SambaNova.

Real-time Security Operations Center with threat monitoring, guard controls, plugin management, spend analytics, and live terminal logs.

Dual-mode PII masking with Presidio NLP engine (18 entity types) and regex fallback. Vault-based tokenization with reversible demasking.

EMA-weighted latency routing, cross-provider fallback chains, model aliases, budget-aware downgrading, and A/B model experimentation.

Built for Security at Scale

LLM Providers

Security Rings

Marketplace Plugins

564

Tests Passing