local LLMs

A web calculator for estimating whether local LLMs fit on specific hardware and how fast they may run. It covers VRAM, token throughput, latency, power, and cost across multiple GPUs and devices.

Sipp is a zero-dependency AI inference runtime for running models in the browser and across Node, Rust, Python, and self-hosted gateways. The page shows install commands, a symmetric client API, benchmark claims, and live demos for chat, agents, vision, and game use cases.

Ironsmith is an open-source macOS menu bar app that generates small native SwiftUI apps from prompts, using local or hosted LLMs.

A VS Code AI sidebar for focused coding help, with voice input, file and selection chat, Git and debugger context, and support for OpenAI-compatible, local, and budget models.

A GitHub repository guide to running state-of-the-art LLMs on local hardware, with concrete build notes, cost breakdowns, and runnable configs for large models.