AI Security Gateway

AI Security Gateway (AISG) is a vendor-neutral governance layer that sits between your application and any LLM provider (OpenAI, Anthropic, Google, Groq, Mistral, xAI, Together.ai, DeepInfra). It scans every request for sensitive data — emails, SSNs, credit cards, API keys, and 30+ entity types — and redacts or blocks them before anything reaches the model.

Fully stateless — prompts pass through and are never stored, logged, or used for training. Only metadata (cost, latency, entity counts) is recorded. Drop-in compatible with the OpenAI SDK (change two lines of code). Smart cost routing automatically picks the cheapest provider for each request. Hard budget enforcement prevents runaway agent costs. Prompt injection and jailbreak blocking included.

Works as a drop-in OpenAI SDK replacement — change your base URL, get instant security and cost control with no other code changes.

Available as a managed cloud (1M free credits, no credit card) or fully self-hosted via Docker under Apache 2.0. Zero telemetry, fail-closed by default — if the security layer is unreachable, requests are blocked, never forwarded unscanned.

Key capabilities:

• PII redaction across text and images (OCR-based)
• Prompt injection and jailbreak blocking
• Recursive loop protection — kills agent retry loops at the gateway layer
• HMAC-signed webhook alerts — real-time push to Slack, PagerDuty, or any SIEM
• EU AI Act Article 12 compliance logging — hash-chained tamper-evident audit trails
• Per-project spend quotas and token caps
• SAML SSO — Okta, Azure AD, Google Workspace with auto-provisioning
• 4-tier RBAC — Owner, Admin, Member, Viewer with 17 granular permissions
• SIEM Connectors — stream events to Splunk HEC, Datadog Logs, or Microsoft Sentinel
• Hybrid VPC — compiled Go proxy in your network, cloud dashboard for policies
• Per-project budget enforcement with hard spending caps
• Smart routing across 380+ models — auto-picks cheapest provider
• Zero data retention — prompts processed in-memory, never stored
• Full self-hosted option via Docker/Kubernetes (Apache 2.0)
• BYOK — no markup on your provider API costs

Built for developers shipping LLM apps, teams handling sensitive data in regulated industries (healthcare, finance, legal), and anyone who needs AI security without vendor lock-in.