oMLX is described as 'LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar' and is a large language model (llm) tool in the ai tools & services category. There are more than 50 alternatives to oMLX for a variety of platforms, including Windows, Mac, Linux, Web-based and Android apps. The best oMLX alternative is DeepSeek, which is both free and Open Source. Other great apps like oMLX are Ollama, Jan.ai, Ensu and AnythingLLM.
Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.
Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.
India
Auto-GPT is an experimental open-source application showcasing the capabilities of the GPT-4 language model. This program, driven by GPT-4, chains together LLM "thoughts", to autonomously achieve whatever goal you set.
OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.
Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.
China
Experience AI chat on macOS with a SwiftUI-designed client utilizing Swift, CoreML, and BERT for native performance. Enjoy privacy-focused, intuitive chats with intelligent AI responses, profile customization, and full control via editable chat history and message rewind.
Embeddings databases are a union of vector indexes (sparse and dense), graph networks and relational databases. This enables vector search with SQL, topic modeling, retrieval augmented generation and more.
United States
This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...
United States
AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.
United States
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
United States
China
