Apps tagged with 'LLM Gateway'

Open-source, OpenAI-compatible gateway that routes hosted, BYOK, local, and custom models with access controls, budgets, and usage attribution.

Open-source LLM-ops platform combining prompt management, an AI gateway, tracing, a tool catalog, and evaluation in one self-hostable platform.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

Free AI gateway allows your AI to work none stop: one endpoint, 350 providers (90+ free), 1200+ models Quota-aware, auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 450+ contributors.

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

AI gateway written in Go. The fastest and the most resource-efficient. It serves OpenAI-compatible API and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama.

Bizgraph lets agencies set up automated custom pricing plans for each client—define your markup once, and every API call is tracked, priced, and invoiced automatically. Start with a 14-day free trial to see your profit margins grow.

Gonka Broker is a pay-as-you-go API for open-source language models served on the decentralized Gonka GPU network. It works as a drop-in replacement in most AI stacks: it exposes OpenAI-compatible Chat Completions and an Anthropic-compatible Messages endpoint, so switching...

The proxy server for AI-native apps. Arch handles the pesky low-level work in building agents like clariyfing vague user input, routing prompts to the right agents and unifying access to any LLM - all without locking you into a framework.

B-Lost AI is a next-generation, enterprise-grade AI API relay and aggregation platform designed for global developers, researchers, and AI startups.

Self-hosted AI platform for organizations: Chat, Code and Agent workspaces built on an enterprise LLM gateway with centralized access control, budgets and usage visibility.

Kryvlo is the intelligent LLM gateway that eliminates the hidden cost of hardcoded AI models. Our platform analyzes every prompt in real time and automatically routes it to the most cost-effective model across 300+ options — from lightweight tasks to frontier-level reasoning.

Gateway offering EU-hosted, OpenAI-compatible API access to 700+ models from 30+ providers, with pay-as-you-go pricing, failover, tracing, and GDPR compliance.

flo2 is a cloud LLM gateway that routes one OpenAI- and Anthropic-compatible API key to many model providers, adding no token markup while handling smart routing, fallback, racing, A/B testing and per-call cost tracking.

Unified platform for routing LLM traffic, observability, evals, prompt management, tracing, and spend controls, reducing dashboard switching time.

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics.

RouterPlex is a spend-safe AI gateway for 40 Claude, GPT, Gemini, and other models through one API key, with vendor list pricing and hard spend limits.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.