Ollama Alternatives

Ollama is described as 'Facilitates local deployment of Llama 3, Code Llama, and other language models, enabling customization and offline AI development. Perfect for creating personalized AI chatbots and writing tools' and is a very popular large language model (llm) tool in the ai tools & services category. There are more than 100 alternatives to Ollama for a variety of platforms, including Mac, Windows, Linux, Web-based and Android apps. The best Ollama alternative is Jan.ai, which is both free and Open Source. Other great apps like Ollama are Ensu, AnythingLLM, LM Studio and Alpaca - Ollama Client.

filter to find the best alternatives

Ollama alternatives are mainly Large Language Model (LLM) Tools, but if you're looking for AI Chatbots or AI Writing Tools you can filter on that. Other popular filters include Open Source. You can also filter by region, for example EU-based alternatives if you prefer software developed in the European Union. These are just examples - use the filter bar below to find more specific alternatives to Ollama.
Copy a direct link to this comment to your clipboard
Alternatives
Get a badge for your siteOllama alternatives page was last updated

Alternatives list

  1. Instella icon
     8 likes

    Instella, a large language model tool developed by AMD, provides exceptional performance with open access to model weights and training data, promoting advancements in AI. It bridges the gap between fully open and open weight models by outperforming competitors like Llama-3.2-3B.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Self-Hosted
    • Docker
    • PyTorch
    Good alternative?
     
    |
    1
  2. Devika icon
     18 likes

    Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika utilizes large language models, planning and reasoning algorithms, and...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    Good alternative?
     
  3. AgentGPT icon
     19 likes

    AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

    104 AgentGPT alternatives

    Cost / License

    Application type

    Platforms

    • Online
    Good alternative?
     
  4. llama.cpp icon
     8 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Windows
    • Mac
    • Linux
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    • Self-Hosted
    Good alternative?
     
  5. Devin icon
     18 likes

    Devin is an autonomous agent that solves engineering tasks through the use of its own shell, code editor, and web browser.

    39 Devin alternatives

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
    • US flagUnited States
    Devin screenshot 1
    Good alternative?
     
  6.  16 likes

    Auto-GPT is an experimental open-source application showcasing the capabilities of the GPT-4 language model. This program, driven by GPT-4, chains together LLM "thoughts", to autonomously achieve whatever goal you set.

    59 Auto-GPT alternatives

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Self-Hosted
    Good alternative?
     
  7. LocalAI  icon
     11 likes

    Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

    74 LocalAI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    • Self-Hosted
    • Cloudron
    Good alternative?
     
  8. MiroThinker icon
     10 likes

    MiroThinker is an open-source search agent model, built for tool-augmented reasoning and real-world information seeking, aiming to match the deep research experience of OpenAI Deep Research and Gemini Deep Research.

    Cost / License

    Application type

    Platforms

    • Python
    • Windows
    • Linux
    • Mac
    • Self-Hosted
    Good alternative?
     
  9. NodeTool icon
     9 likes

    NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    Good alternative?
     
  10. BabyAGI icon
     12 likes

    This Python script is an example of an AI-powered task management system. The system uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks. The main idea behind this system is that it creates tasks based on the result of previous tasks and a predefined objective.

    95 BabyAGI alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Self-Hosted
    Good alternative?
     
  11. Custom Mac runtime allows instruction-tuned 26-billion-parameter model inference in about 2 GB RAM by streaming only required model experts from SSD, with 1.35 GB core and cache in memory. Supports 8 GB Apple Silicon Macs with CLI and native app, measured in 103 scenarios.

    Cost / License

    Platforms

    • Mac
    Good alternative?
     
You are at page 2 of Ollama alternatives