G
G

gen-ai-proxy

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics.

Dashboard view

Cost / License

Platforms

  • Self-Hosted
Alternatives
0likes
0alternatives
0articles

Features

No features, maybe you want to suggest one?

 Tags

gen-ai-proxy News & Activities

Highlights All activities

Recent activities

No activities found.

gen-ai-proxy information

AlternativeTo Category

AI Tools & Services

GitHub repository

  •  2 Stars
  •  0 Forks
  •  0 Open Issues
  •   Updated  
View on GitHub
gen-ai-proxy was added to AlternativeTo by Tafeen on and this page was last updated .
No comments or reviews, maybe you want to be first?

Official Links

AppStores & Other Links

What is gen-ai-proxy?

gen-ai-proxy - a self-hosted, open-source (Apache 2.0) proxy for LLM's

🔍 Track token usage per model/provider 📊 Exposes Prometheus metrics – ready for Grafana dashboards 🔌 Supports OpenAI-compatible endpoints 🧩 Multiple models/providers per user 🔐 API-key auth, JWT, and full Docker-compose deployment in minutes

Packed with simple UI and REST API, deployed easily with docker

Built for devs, ops, and anyone who loves control + visibility.