Large Language Model (LLM) Tools Page 4 of 16

Pi is a new kind of AI, one that isn’t just smart but also has good EQ. We think of Pi as a digital companion on hand whenever you want to learn something new, when you need a sounding board to talk through a tricky moment in your day, or just pass the time with a curious and...

A traditional operating system takes instructions. An AI operating system takes objectives. Personal Computer gives Perplexity Computer and the Comet Assistant always-on, local access to your machine's files, apps, and sessions through a continuously running compact desktop.

SillyTavern is a user interface you can install on your computer (and Android phones) that allows you to interact with text generation AIs and chat/roleplay with characters you or the community create.

Supports multi-shot 1080p video generation from text or images, with smooth motion, detailed cinematic visual style, and accurate prompt interpretation.

KoboldCpp is an easy-to-use AI text-generation software for GGML models. It's a single self contained distributable from Concedo, that builds off llama.cpp, and adds a versatile Kobold API endpoint, additional format support, backward compatibility, as well as a fancy UI...

OptiQ is an MLX-native toolkit for running large language models on Apple Silicon. No PyTorch, no CUDA, no cloud.

Hundreds of models & providers. One command to find what runs on your hardware.

NodeTool is the open-source creative AI workspace — every major model from every major provider, called with your own keys, wired into one node-based canvas you run on your machine.

Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

Run open-source LLMs on your computer. You can download and make custom characters for your models. Works offline. The new name is Back yard though it is the same.

Offline AI companion for Mac and Windows. Your model, memory, and image generation stay on your machine - no account, no subscription, no server to disappear.

ChatRTX is a locally-run AI chatbot developed by NVIDIA that leverages the power of RTX GPUs to deliver fast, private, and offline conversational AI. It uses models like Mistral or LLaMA and can be customized with your own documents and data.

Warden is a minimalist, simple and beautiful macOS AI chat app, that supports most AI providers: ChatGPT, Anthropic (Claude), xAI (Grok), Google Gemini, Perplexity, Groq, Local LLMs through Ollama, OpenRouter, and almost any OpenAI-compatible APIs.

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

Auto-GPT is an experimental open-source application showcasing the capabilities of the GPT-4 language model. This program, driven by GPT-4, chains together LLM "thoughts", to autonomously achieve whatever goal you set.

Open-source LLM-ops platform combining prompt management, an AI gateway, tracing, a tool catalog, and evaluation in one self-hostable platform.

OpenCV provides a real-time optimized Computer Vision library, tools, and hardware. It also supports model execution for Machine Learning (ML) and Artificial Intelligence (AI).

AI-powered CLI that analyzes your hardware and recommends optimal LLM models you can run locally, with full Ollama integration.

Askimo is an open-source, privacy-first AI desktop application designed to help users work with multiple AI models from a single, consistent interface. It supports popular AI providers such as OpenAI, Anthropic (Claude), Gemini, Ollama, LocalAI, Docker AI, LM Studio, and X AI...

Multimodal Offline LLM Chat App with MNN.

Your versatile AI partner. Designed to amplify your productivity and streamline your tasks on macOS.

StableLM is an open-source language model developed by Stability AI that can generate text and code for various downstream applications. StableLM showcases the power of small, efficient models that can generate high-performing text and code locally on personal devices.

RikkaHub is an Android APP that supports for multiple LLM providers.

Stop sending your project context into a new AI tab every time you need a different model.