MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- iPhone
- iPad
- Android
- Linux
- Mac
- Windows
- Python
- Online






































































Text-generation-web-ui has the most features, and is very lightweight. Probably the best offline LLM tool at the moment.