Open Source Ollama AlternativesLarge Language Model (LLM) Tools & AI Chatbots like Ollama

The best open source alternative to Ollama is DeepSeek. If that doesn't suit you, our users have ranked more than 50 alternatives to Ollama and many of them is open source so hopefully you can find a suitable replacement. Other interesting open source alternatives to Ollama are Jan.ai, AnythingLLM, Alpaca - Ollama Client and Ollama App.

filter to find the best alternatives

Ollama alternatives are mainly Large Language Model (LLM) Tools, but if you're looking for AI Chatbots or AI Writing Tools you can filter on that. Other popular filters include Open Source. You can also filter by region, for example EU-based alternatives if you prefer software developed in the European Union. These are just examples - use the filter bar below to find more specific alternatives to Ollama.
Copy a direct link to this comment to your clipboard
Ollama alternatives page was last updated

Alternatives list

  1. DeepSeek icon
     99 likes

    DeepSeek is a state-of-the-art AI assistant designed to provide intelligent, conversational support across diverse tasks. It leverages advanced natural language processing and machine learning to answer questions, generate creative content, solve complex problems, and offer...

    150 DeepSeek alternatives

    Cost / License

    • Freemium
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    • Android
    • iPhone
    • Android Tablet
    • iPad
     
  2. Jan.ai icon
     84 likes

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    181 Jan.ai alternatives

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • Flathub
    • Flatpak
    • Online
     
    |
    2
    Comments about Jan.ai as an Alternative to Ollama
    gbossley
    Positive
    0

    Ollama is now enhanced by UI extensions for (at least) Firefox and Chrome called Page Assist!

    erdar
    Positive
    0

    While ollama is only console based, with Jan you can use the LLMs directily via UI.

    Jan.ai icon
    Jan.ai icon
    • Jan.ai is Free and Open SourceOllama is also Free and Open Source
    • Jan.ai is Customizable and LightweightOllama is not according to our users
  3. AnythingLLM icon
     42 likes

    A multi-user ChatGPT for any LLMs and vector database. Unlimited documents, messages, and storage in one privacy-focused app. Now available as a desktop application!.

    156 AnythingLLM alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Mac
    • Windows
    • Self-Hosted
    • Docker
    • Linux
     
  4. Ollama App icon
     25 likes

    A modern and easy-to-use client for Ollama.

    Cost / License

    Application type

    Platforms

    • Windows
    • Linux
    • Android
    • F-Droid
     
  5. Private GPT icon
     32 likes

    Ask questions to your documents without an internet connection, using the power of LLMs. 100% private, no data leaves your execution environment at any point. You can ingest documents and ask questions without an internet connection!

    238 Private GPT alternatives

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
     
  6. Devika icon
     19 likes

    Devika is an Agentic AI Software Engineer that can understand high-level human instructions, break them down into steps, research relevant information, and write code to achieve the given objective. Devika utilizes large language models, planning and reasoning algorithms, and...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
     
  7. Instella icon
     7 likes

    Instella, a large language model tool developed by AMD, provides exceptional performance with open access to model weights and training data, promoting advancements in AI. It bridges the gap between fully open and open weight models by outperforming competitors like Llama-3.2-3B.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Self-Hosted
    • Docker
    • PyTorch
     
  8. AgentGPT icon
     19 likes

    AgentGPT allows you to configure and deploy Autonomous AI agents. Name your own custom AI and have it embark on any goal imaginable. It will attempt to reach the goal by thinking of tasks to do, executing them, and learning from the results.

    Cost / License

    Platforms

    • Online
     
12 of 37 Ollama alternatives