llama.cpp Alternatives

llama.cpp is described as 'The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud' and is a large language model (llm) tool in the ai tools & services category. There are more than 25 alternatives to llama.cpp for a variety of platforms, including Windows, Mac, Linux, Android and iPhone apps. The best llama.cpp alternative is ChatGPT, which is free. Other great apps like llama.cpp are Ollama, Jan.ai, GPT4ALL and AnythingLLM.

Copy a direct link to this comment to your clipboard
Alternatives
Get a badge for your sitellama.cpp alternatives page was last updated

Alternatives list

  1. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.

    17 Lemonade Server alternatives

    Cost / License

    Platforms

    • Windows
    • Linux
    • Docker
    • Snapcraft
    • iPhone
    • iPad
    • Self-Hosted
    • Python
    Good alternative?
     
  2. A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

    Cost / License

    Platforms

    • Python
    • Mac
    • Linux
    • Self-Hosted
    • Kubernetes
    • OpenShift
    Good alternative?
     
  3. cs.AI icon
     5 likes

    An honest AI assistant that grounds answers in real knowledge and live search — no hallucinations, no API key required. Works offline. Open source.

    51 cs.AI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Mac
    Good alternative?
     
  4. Aether AI icon
     1 like

    A stunning, localized, general-purpose AI Agent for Android.

    Cost / License

    Application type

    Platforms

    • Android
    • Android Tablet
    Good alternative?
     
  5. Operit AI icon
     1 like

    📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱

    70 Operit AI alternatives

    Cost / License

    Platforms

    • Android
    Good alternative?
     
  6. LLM Hub icon
     1 like

    LLM Hub is an open-source Android app for on-device LLM chat and image generation. It's optimized for mobile usage (CPU/GPU/NPU acceleration) and supports multiple model formats so you can run powerful models locally and privately.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Android
    • Android Tablet
    Good alternative?
     
  7.  2 likes

    A decentralized AI inference network where anyone can use cloud-sized models with local-grade privacy, or contribute hardware and get paid to power it.

    Cost / License

    Application type

    Platforms

    • Online
    • Windows
    • Android
    • Mac
    • iPhone
    • Linux
    • Self-Hosted
    • Docker
    • iPad
    • Android Tablet
    • Google Chrome
    • Mozilla Firefox
    • Chrome OS
    Good alternative?
     
  8. An offline AI assistant that runs entirely from a USB drive on Windows and macOS, with no internet connection, account, or subscription.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Windows
    • Mac
    Good alternative?
     
  9. Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    Good alternative?
     
  10. Voelori icon
     Like

    A local-first Windows AI ecosystem: a multi-module workspace, a persistent AI agent, and a voice assistant. Runs offline. One-time purchase, no subscription.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Windows
    Good alternative?
     
  11. Thremark icon
     Like

    AI chat with real memory. Say something once — it knows forever. Every fact visible as a Mark you can edit or delete.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • iPhone
    • iPad
    • Online
    Good alternative?
     
  12. Parallely is a visual canvas for parallel AI exploration. Instead of a linear chat, you ask one question and Parallely "refracts" it into multiple parallel angles - definitions, applications, critiques, diagrams - streamed live onto an infinite canvas.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    Good alternative?
     
You are at page 3 of llama.cpp alternatives