OpenAI API compatible

Native Zig inference server for Apple Silicon Macs that runs local LLMs with MLX and GGUF support, plus OpenAI- and Anthropic-compatible APIs. The page highlights one-click local setup, Ollama compatibility, agent tools, MCP support, and performance claims against LM Studio.

A minimalist CLI LLM chatbot written in Python. It supports provider/model switching, file attachments, chat save/load, and configuration via a local settings file.