A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.
Cost / License
- Free
- Open Source (AGPL-3.0)
Application typeApplication types
Platforms
- Linux
- Windows
- Mac
RWKV Chat Alternatives
RWKV Chat is described as 'Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required' and is a large language model (llm) tool in the system & hardware category. There are more than 25 alternatives to RWKV Chat for a variety of platforms, including Windows, Mac, Linux, Android and Self-Hosted apps. The best RWKV Chat alternative is Ollama, which is both free and Open Source. Other great apps like RWKV Chat are Jan.ai, GPT4ALL, AnythingLLM and LM Studio.
Alternatives list
OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Mac
+3
Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
Cost / License
- Free
- Open Source (BSD-3-Clause)
Platforms
- Windows
- Android
- iPhone
- Mac
- Linux
United States
+5
24 ChatterUI alternativesRun LLMs on device or connect to various commercial or open source APIs. ChatterUI aims to provide a mobile-friendly interface with fine-grained control over chat structuring.
Cost / License
- Free
- Open Source (AGPL-3.0)
Application typeApplication types
Platforms
- Android
54 oMLX alternativesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Mac
South Korea
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
Cost / License
- Free Personal
- Open Source (MIT)
Application typeApplication types
Platforms
- Windows
- Online
- Self-Hosted
This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...
Cost / License
- Free
- Open Source (MIT)
Application typeApplication types
Platforms
- Windows
- United States
17 Lemonade Server alternativesLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Windows
- Linux
- Docker
- Snapcraft
- iPhone
- iPad
- Self-Hosted
- Python
- United States
+1
Cost / License
- Free
- Proprietary
Application type
Platforms
- Android
- United States
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Android
- iPhone
- iPad
China
25 AI Dev Gallery alternativesLearn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Windows
- United States
+1
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Windows
- Mac
- Linux
- Rust
