local-ai

An open 30B agentic model from Meta designed to run locally on consumer hardware for coding, function calling, and other always-on agent workflows.

A 30-second WebGPU benchmark that measures a device’s memory-bandwidth ceiling for local AI and checks for a WebGPU subgroup correctness bug, with receipts, projections, and comparison data.

Aloud is a macOS tool that reads Claude Code and OpenAI Codex replies out loud using local text-to-speech. It includes session-level controls, keyboard shortcuts, hook integration, and a clear install flow for developers.

A Go-based local orchestration platform for AI coding agents, with live event streaming, session replay, and durable execution history.

ImageSage is a private, local AI gallery for Windows that lets you search photos by visual content or text in images, then review AI-generated rename suggestions and manage files in place.

A Windows voice-dictation app in Rust that runs locally with whisper.cpp, supports hotkey dictation, system audio capture, file transcription, and optional local LLM cleanup.

Lucidos is a local AI OS and companion that keeps described apps running, responds to events, and works from a persistent desktop or browser-based interface. The repo shows install paths for macOS and Linux, a headless runtime, source build instructions, and a clear focus on user-owned local data.

Native Zig inference server for Apple Silicon Macs that runs local LLMs with MLX and GGUF support, plus OpenAI- and Anthropic-compatible APIs. The page highlights one-click local setup, Ollama compatibility, agent tools, MCP support, and performance claims against LM Studio.

SnapName is a macOS app that watches a screenshot or image folder and uses bundled local AI to suggest better filenames without uploading images.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

Otlet is a Postgres extension for running local LLM inference next to database rows. The README shows SQL examples, model registration, task execution, and an entity-resolution workflow with typed outputs.

wavecat is a fully local personal agent that watches your screen and runs entirely on-device. The page explains its privacy focus, hardware requirements, local model setup, and supported platforms.

Open-source local AI coworker system that routes Claude Code and Codex work to local models on your own hardware, with durable task handling, multi-machine cooking, and MCP/CLI support.

Symbio is a local AI assistant that learns from user corrections, builds training data from notes, and can fine-tune itself over time. It supports file operations, sandboxed shell commands, RAG, a Telegram bot, and a demo with MoA and skill adapters.

A private AI meeting-notes app that transcribes calls locally and uses Codex, Claude Code, or a local LLM to generate summaries and action items on-device.

Wolffish is a local desktop AI agent that runs on a user’s machine with full system access. It emphasizes offline operation, Markdown-based memory/brain files, and simple skill-based extension via SKILL.md.

QVAC SDK 0.12.0 adds TurboQuant, a KV-cache quantization feature for local LLM inference that claims up to 5x more context on-device with no retraining or code changes.

A local-first AI memory engine for asking questions over selected files on your computer using Ollama, embeddings, and a custom vector database.

Harbor is a local AI stack and launcher for starting pre-configured agentic coding tools against different backends, with support for tools like Codex, OpenCode, Claude Code, and web-enabled workflows.

Local push-to-talk dictation for macOS that uses Whisper, stays on-device, and pastes text at the cursor.

Local privacy gateway that redacts sensitive text before sending prompts to external LLMs, then reconstructs the final answer locally.

A browser-based clicker game where local AI builds a custom game from your idea entirely on-device via WebGPU, with no API keys or servers.

Open protocol and reference router for capability-aware AI routing across local and cloud models, with install steps and deployment details in the README.

Didon is an AI-powered automatic time tracker for macOS that turns screen activity into daily work logs, project breakdowns, and productivity insights. It runs locally with on-device AI, supports CSV exports, and is positioned for people who want automatic journaling without manual timers.