MLC LLM is described as 'Machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms' and is a AI Chatbot in the ai tools & services category. There are more than 50 alternatives to MLC LLM for a variety of platforms, including Mac, Windows, iPhone, Android and Linux apps. The best MLC LLM alternative is Lumo by Proton, which is both free and Open Source. Other great apps like MLC LLM are ChatGPT, Ollama, Google Gemini and Claude.
Runs fully private, offline chatbot entirely in browser, ensuring conversation data never leaves the device. No server, installation, external services, or account needed. Supports Llama 3, Mistral, and other open source models in a ChatGPT-like interface for privacy-focused users.
Cherry Studio is a desktop client that supports for multiple LLM providers, available on Windows, Mac, and Linux.
China
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
United States
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Bulgaria
EU
Unleash the power of artificial intelligence right at your fingertips with Chatbox, the versatile client application seamlessly integrated across all major platforms – Windows, Mac, Linux, Web, and iOS.
China
Customizable interface for private, on-device AI model chatting, open source and closed source LLM connections, OpenRouter support, custom backend support, and unified access to language models without reliance on a single provider, ensuring privacy and flexibility.
United States
Together Chat is a next-generation consumer app designed to let you interact seamlessly with today's most popular open-source models, including free access to DeepSeek R1, securely hosted in the North America.
United States
Raycast AI combines leading models with powerful extensions - right on your OS. Try a lite version of Raycast AI Chat for free.
United Kingdom
The simplest way to use private LLMs: Works fully offline and private when you don’t have internet. Runs models on-device optimized for Apple silicon.
United States
Complete LLM chatbot implementation, offering tokenization, pretraining, finetuning, evaluation, inference, and a simple web UI. Runs on a single 8xH100 node, features a hackable codebase, dependency-lite design, and automates the full workflow via scripts.
United States
