on-device-ai

Omni is a local-first semantic search app for macOS that indexes text, code, PDFs, images, audio, and video on-device. It supports multilingual search, private offline use, and exposes a local endpoint for agents to query indexed files.

Open-source project showing how to run a 28.9M-parameter language model on an ESP32-S3 microcontroller, with on-device inference, firmware, wiring, training code, and measured results.

Browser extension that scans pastes for credentials and PII before they reach LLM chat sites, with local on-device inference and no network calls.

Privacy-first AI meeting notes and writing assistant for macOS, with on-device transcription, smart minutes, action items, and AI writing tools. The repo also shows an opt-in plain Markdown storage mode and full source for the app.

A macOS command-line tool for on-device AI and voice tasks, including speak, listen, transcribe, chat, and an OpenAI-compatible local server.

Open-source project that ports Google DeepMind’s Magenta RealTime 2 music generation to Core ML for local execution on iPhone, with Apple Neural Engine acceleration and no GPU use.

LocalCode turns plain English into CLI commands on Apple Silicon Macs using Apple’s on-device Foundation Models framework, then asks for approval before running them.

A native macOS markdown writing app for plain .md notes on your own disk, with on-device AI search and semantic lookup.

An Android-focused on-device AI agent fork that can automate phone actions, run workflows and schedules, and be controlled locally or through Telegram.

A suite of three native macOS apps: Crest for notch-based control, Take for screen recording, and Minutes for on-device meeting notes. The page emphasizes offline use, local processing, one-time pricing, and how the apps work together on a MacBook notch.

An iPhone and iPad dictation app that cleans up speech into formatted text, with on-device or cloud transcription and a meeting bot that drafts follow-up emails.

A draft specification for an offline emergency dispatch protocol designed for on-device AI models on phones when no dispatcher is available.