Large Language Model (LLM) Tools Page 6 of 16

AI00 RWKV Server is an inference API server for the RWKV language model based upon the web-rwkv inference engine.

Nexa Studio: Offline, Private AI with Unlimited Use.

Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...

This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...

A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.

Your Personalized AI Development Assistant and Workflow Copilot.

Browse Anything is an AI agent (computer use agent) that can browse the web, automate tasks, extract data, generate reports, and much more, all from a simple prompt. Think of it as your personal web assistant, powered by AI.

A friendly, human-like AI chatbot powered by Google Gemini.

Cohere is an API platform for integrating LLM functionality such as chatting and text classification into your application.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024).

Inferencer lets you run, host and deeply control the latest SOTA AI models (OSS, DeepSeek, Qwen, Kimi, GLM, MiniMax and more) from your own computer.

Unifies plugin and dataset integration with a single API, offers visual orchestration for AI application creation, analytics, annotation, and prompt engineering.

Copilot sidebar ported from Microsoft Edge to Chrome.

A versatile AI-powered application designed to meet the diverse needs of users seeking intelligent interaction and functionality. This app offers a free AI chat feature, enabling users to engage in conversations with advanced AI models, providing insights, answers, and...

A distraction-free LLM chat web app optimized for Kindle. The perfect companion for your book. Powered by Mixtral from Mistral AI. Mainly tested on Kindle Paperwhites.

llamafile lets you distribute and run LLMs with a single file, providing an OpenAI-compatible API as well as a KoboldAI API.

Leverage a no-code platform for AI voice assistants that enables calls and appointment scheduling, enhancing engagement and personalization for all businesses.

Chat with generative language models locally on your computer with zero setup. LocalChat is a simple, easy to set up local AI chat built on top of llama.cpp. It requires no technical knowledge and enables users to experience ChatGPT-like behavior on their own machines — fully...

The Yi series models are the next generation of open-source large language models trained from scratch by 01.AI.

Cross-platform framework for deploying LLM/VLM/TTS models locally on smartphones.

User-friendly, privacy-first & highly customizable native ChatGPT app for macOS. Support OpenAI, Azure OpenAI, Anthropic Claude & OpenRouter. Local LLMs via Ollama.

Experience the power of AI at your fingertips with Private LLM, AI chatbot that runs on your iPhone, iPad and Mac without needing an internet connection.

An end-to-end MLLM that accept any-form referring and ground anything in response.