Rust

Lightweight AI inference engine written in Rust for embedding local LLMs in mobile and desktop apps, with bindings for Python, Flutter, and React Native.

Open-source LLM uncertainty and hallucination detection tool that estimates epistemic risk in microseconds using exact-match normalized entropy, with Rust gateway and Python package support.

Keel is a Rust CLI harness for AI-assisted coding workflows. It adds auditable stopping conditions, durable memory, projections into agent instruction files, and reviewable gates with exported evidence.

Codexify is a Rust-based local MCP bridge for ChatGPT Web Pro that exposes tools like file access, shell commands, git operations, and project management on your machine. It also supports OpenAI’s native Secure MCP Tunnel and can aggregate other MCP servers.

WalTier is a Rust embeddable tiered write-ahead log coordinated through S3 conditional writes. It provides durable ordered logging, compaction, replicas, and local disk or memory stores for development and testing.

Ante is a self-contained coding agent for the terminal. It ships as a single Rust binary, supports online and offline use, and includes headless, server, and gateway modes for scripting, integrations, and bot workflows.

A small Rust-based LLM proxy for forwarding chat, messages, and responses requests to providers with gateway-key handling and optional protocol translation between Anthropic and OpenAI styles.

A Rust-based coding agent built for speed, low memory use, and Claude Code compatibility. The project highlights support for skills, hooks, MCP, plugins, sub-agents, and multiple LLM providers, with terminal, headless, and IDE-facing entry points.

Buzz is a self-hostable workspace for humans and AI agents to collaborate in the same threads, with signed events, audit trails, channels, workflows, and code-oriented actions.

Sana is an object-storage-native search database for vectors, full-text search, and attribute filters. The repo describes durability, indexing, backends, operations, and quick-start commands for running the service or demo.

A local Rust CLI for A/B testing two CLAUDE.md files against a fixed SWE-bench Lite smoke set, with doctor, run, and report commands.

Rust CLI that uses OpenAI Realtime voice input to orchestrate concurrent background coding agents, including Claude Code and Codex CLI, with slug-based task tracking and progress updates.

A Rust-based CLI that fetches web pages, strips page chrome, and outputs readable Markdown for AI agents and shell workflows.

Open-source local-first terminal for working with terminal sessions and coding agents. It keeps retained PTY sessions alive on your machine, discovers sessions from several local agent tools, and exposes them through a browser-based dashboard.

A GitHub repo section documenting a benchmark for Vestige, a local-first Rust MCP memory layer for multi-agent coding fleets. The page explains the benchmark setup, what is being measured, how to reproduce the main claim, and where to find transcripts, evidence, and harness code.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.

A Linux filesystem defragmenter written in Rust with a Qt Quick/Kirigami UI and CLI. It analyzes fragmentation, shows a block map, and can defragment ext4 plus offline FAT16/FAT32 volumes.

A Rust library for sparse byte-range caching and async read coalescing on immutable objects, with support for range semantics, eviction, and optional read-through caching.

A bootable Linux-based OS prototype with a React desktop, Rust daemons, Electron shell, and a local AI assistant. The page describes the boot flow, architecture layers, built-in apps, persistence, and hardware boot timing.

A self-hosted proxy and router for Claude Code that lets teams pool multiple Claude accounts and choose which account serves a session.

Beckon is a Rust CLI that plays different sounds for AI coding agent events such as completion, blockers, failures, and throttling. It supports installs, configurable packs, per-project behavior, and custom audio overrides.

An open-source course and reference implementation for a self-scaling OCR pipeline on Kubernetes, using Rust for ingestion, vLLM for inference, Redis and KEDA for event-driven scaling, and MCP integration for agent use.

Aerial is a local-first Rust tool for agent-to-agent messaging and orchestration, with durable mailboxes, a supervisor, and an MCP adapter. The page shows what it does, how it works, and basic install commands.

A Python CLI and research toolkit for simulating AI training math before model training. It estimates memory, training time, token budget, config risks, benchmark speed, and reliability, with optional native Rust and C backends.