Apps tagged with 'LLM Inference' Page 2 of 3

All apps in Apps tagged with 'LLM Inference' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. NVIDIA NIM icon
     1 like

    NVIDIA NIM is a set of accelerated inference microservices that allow organizations to run AI models on NVIDIA GPUs anywhere.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Self-Hosted
    • Docker
    • Kubernetes
    • Online
    • US flagUnited States
    NVIDIA NIM screenshot 1
    NVIDIA NIM screenshot 1
    10 alternatives
  2. Corpus2GPT icon
     1 like

    Corpus2GPT: A project enabling users to train their own GPT models on diverse datasets, including local languages and various corpus types, using Keras and compatible with TensorFlow, PyTorch, or JAX backends for subsequent storage or sharing.

    Cost / License

    Platforms

    • Self-Hosted
    Training GPT from scratch in an artificial dummy data in 50 lines of code!
    5 alternatives
  3. HugstonOne icon
     1 like

    HugstonOne Enterprise Edition — Awesome AI App with Code editor and Live Preview Create games, dashboards, maps, tables, charts, webpages, data analysis, converters etc in seconds.

    Cost / License

    • Free
    • Proprietary

    Application type

    Platforms

    • Windows
    • Linux
    • SE flagSweden
    • European Union flagEU
    Image Processing, generating a webpage identical to the image, with Realtime visualization/preview.
    Data Analysis, generating charts with dataset  with Realtime visualization/preview.
    Creating different Realtime maps with different layers  with Realtime visualization/preview.
    +6
    HugstonOne screenshot 3
    24 alternatives
  4. Gonka Broker icon
     1 like

    Gonka Broker is a pay-as-you-go API for open-source language models served on the decentralized Gonka GPU network. It works as a drop-in replacement in most AI stacks: it exposes OpenAI-compatible Chat Completions and an Anthropic-compatible Messages endpoint, so switching...

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    • US flagUnited States
    Gonka Broker screenshot 1
    Gonka Broker screenshot 1
    Gonka Broker screenshot 2
    +3
    Gonka Broker screenshot 3
    6 alternatives
  5. Lexora is an AI infrastructure platform that provides hosted AI models, knowledge bases (RAG), image generation, and access to frontier AI models through a unified API. Developers can build AI assistants, chat with documents, and pay only for what they use instead of renting GPUs.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    • IN flagIndia
    Landing Page
    RAG trained AI Assistant for free!!
    Usage Graph!
    +1
    Nodes available!
    10 alternatives
  6. Arch icon
     Like

    The proxy server for AI-native apps. Arch handles the pesky low-level work in building agents like clariyfing vague user input, routing prompts to the right agents and unifying access to any LLM - all without locking you into a framework.

    Cost / License

    Platforms

    • Self-Hosted
    • Docker
    • US flagUnited States
    Arch screenshot 1
  7. OpenAdapter is an AI gateway sold as a flat subscription. One API key gets you 40+ open-source models (DeepSeek, Qwen, Kimi, GLM, MiniMax, Mistral, Llama) plus web search, OCR, vision, embeddings and a vector DB. Works with Cursor, VS Code, Claude Code, Zed and any OpenAI-compatible app.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Windows
    • Mac
    • Linux
    • SG flagSingapore
    The AI Subscription developers must have
    View your usage in the dashboard
    Models
    +1
    View your Quota and Usage metrics
    46 alternatives
  8. The DeepSeek API provides developers with direct access to DeepSeek’s advanced AI models, enabling them to run text, code, and multimodal tasks through simple endpoints for seamless integration into applications.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • CN flagChina
    DeepSeek Platform screenshot 1
    DeepSeek Platform screenshot 1
    DeepSeek Platform screenshot 2
    +1
    DeepSeek Platform screenshot 3
    16 alternatives
  9. GPUniq icon
     Like

    GPUniq is a stable GPU compute platform built for AI teams and developers who need reliable performance without paying traditional cloud prices. It provides on-demand access to powerful GPUs for LLM training, inference, computer vision, generative workloads, and 3D rendering —...

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • AE flagUnited Arab Emirates
    search page
    Page with opensource  hosted LLMs
    GPU Burst feature
  10. GMI Cloud icon
     Like

    You’re about to supercharge your AI models with lightning-fast inference. Inference Engine makes it easy to scale, and optimize your models for real-time performance. Let’s get started—your AI is ready to shine.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • US flagUnited States
    GMI Cloud screenshot 1
    GMI Cloud screenshot 1
    GMI Cloud screenshot 2
    +1
    GMI Cloud screenshot 3
    29 alternatives
  11. Lyrio.ai icon
     Like

    Lyrio.ai is an AI-powered workspace built for people who use AI to think, research, and write — not just chat. Unlike linear chatbots that forget context the moment a session ends, Lyrio gives you a persistent, branching canvas where every conversation, insight, and document...

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    • US flagUnited States
    Lyrio AI Workspace
    Branching
    Pins
    +3
    Synthesize
    8 alternatives
  12. EZmodel icon
     Like

    Abstract the complexity, focus on building great products. Fully compatible with OpenAI SDK - no new API to learn. From creative to production, AI capabilities at your fingertips.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • SG flagSingapore
    EZmodel screenshot 1
    EZmodel screenshot 1
    EZmodel screenshot 2
    +1
    EZmodel screenshot 3
    23 alternatives
  13. inferit icon
     Like

    inferit is a visual take on LLM inference. Most inference frontends are limited to a single visual input/output "thread". This makes it hard to compare output from different models, prompts and sampler settings.

    Cost / License

    Platforms

    • Online
    • Self-Hosted
    inferit screenshot 1
    inferit screenshot 1
    inferit screenshot 2
  14. Welcome to Vanish Private AI Chat by Startpage, your mystical AI chat companion available today on iOS. Vanish Private AI ensures your privacy & security by never logging your IP address or chat queries, saving conversations only locally on your device (never on our...

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • iPhone
    • iPad
    • Android
    • NL flagNetherlands
    • European Union flagEU
    Vanish Private AI screenshot 1
    Vanish Private AI screenshot 2
    Vanish Private AI screenshot 3
    19 alternatives
  15. Run and fine-tune generative AI models with easy-to-use APIs and highly scalable infrastructure. Train and deploy models at scale on our AI Acceleration Cloud and scalable GPU clusters. Optimize performance and cost.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    • US flagUnited States
    Together AI screenshot 1
    29 alternatives
  16. LitGPT icon
     Like

    Every LLM is implemented from scratch with no abstractions and full control, making them blazing fast, minimal, and performant at enterprise scale.

    Cost / License

    Platforms

    • Windows
    • Linux
    • Mac
    • Python
    1 alternatives
  17. LogFare icon
     Like

    OpenAI-compatible API with access to frontier models. Create a free account, get your API key, and start building. No rate limits, no credit card.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
    • Global
    LogFare screenshot 1
    LogFare screenshot 1
    LogFare screenshot 2
    +1
    LogFare screenshot 3
    14 alternatives
  18. Infercom icon
     Like

    EU sovereign Enterprise AI inference platform with OpenAI-compatible API for running open-source LLMs on dedicated infrastructure in Europe. Full GDPR, no US CLOUD act exposure.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • LU flagLuxembourg
    • European Union flagEU
    Dashboard
    Playground
    Plans
    6 alternatives
  19. Fellou icon
     Like

    An innovative, AI-driven web browser designed to revolutionize online interactions by integrating advanced artificial intelligence into every aspect of browsing.

    Cost / License

    • Free
    • Proprietary (MIT)

    Platforms

    • Mac
    • Global
    Fellou screenshot 1
    Fellou screenshot 1
    Fellou screenshot 2
    +44
    Fellou screenshot 3
    3 alternatives
  20. NetMind icon
     Like

    Net the future, power the AI. From APIs to enterprise solutions.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    • US flagUnited States
    NetMind screenshot 1
    9 alternatives
  21. A serverless AI platform that runs models on Cloudflare's network, offering over 50 open-source models and a comprehensive suite for global application deployment.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    • US flagUnited States
    Cloudflare Workers AI screenshot 1
    Cloudflare Workers AI screenshot 1
    52 alternatives
  22. Inkarms icon
     Like

    Open-source AI agent automates coding tasks from the terminal, logs actions locally, operates in a secure environment, and integrates with Slack, Telegram, and Discord.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Telegram
    • Discord
    • Slack
    • Terminal
    • WhatsApp
    • Telegram bot API
    • CA flagCanada
    Inkarms screenshot 1
    10 alternatives
  23. OpenAI Platform’s ChatGPT API lets you integrate GPT-5 series models to generate text, analyze and create images, work with audio, produce structured outputs, and build tool-using agents.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • US flagUnited States
    OpenAI Platform screenshot 1
    OpenAI Platform screenshot 1
    OpenAI Platform screenshot 2
    +2
    OpenAI Platform screenshot 3
    19 alternatives