LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.
Cost / License
- Free
- Open Source (Apache-2.0)
Application type
Platforms
- Mac
South Korea
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.
South Korea
