Apps with 'LLM proxy' feature

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Open-source AI firewall and LLM proxy that redacts PII, blocks prompt injection, and enforces spend budgets before requests reach any AI provider. Cloud SaaS, Hybrid VPC and Apache 2.0, self-hostable.

flo2 is a cloud LLM gateway that routes one OpenAI- and Anthropic-compatible API key to many model providers, adding no token markup while handling smart routing, fallback, racing, A/B testing and per-call cost tracking.

Privaro.ai is an enterprise AI governance and sensitive data protection platform designed to help organizations adopt generative AI securely and with greater control.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.