local LLMs

Sipp is a zero-dependency AI inference runtime for running models in the browser and across Node, Rust, Python, and self-hosted gateways. The page shows install commands, a symmetric client API, benchmark claims, and live demos for chat, agents, vision, and game use cases.

Ironsmith is an open-source macOS menu bar app that generates small native SwiftUI apps from prompts, using local or hosted LLMs.

A VS Code AI sidebar for focused coding help, with voice input, file and selection chat, Git and debugger context, and support for OpenAI-compatible, local, and budget models.

A GitHub repository guide to running state-of-the-art LLMs on local hardware, with concrete build notes, cost breakdowns, and runnable configs for large models.