Rust

An OpenAI-compatible LLM proxy that routes requests to the fastest healthy provider. It runs as a small sidecar, supports latency/error-aware routing, session affinity, and Vertex AI, and can be deployed as a single static binary or Docker container.

Local-first encrypted memory engine for AI agents, built in Rust with MCP support and persistent cross-session memory for Claude and other MCP clients.

A local Rust-plus-Python middleware layer for LLM apps that claims to reduce token usage and add in-process security checks before prompts are sent to a provider.

Forall is an AI coding agent from Astrio that generates spec-driven code with machine-checkable proofs. The repo shows two usage paths: a CLI workflow and a hosted MCP verify-only mode for tools like Cursor, Claude Code, or Codex.

A Rust CLI and MCP server for orchestrating multiple coding agents, fusing their answers, and resuming or routing agent sessions locally.

A local-first MCP server and companion CLI/TUI for giving AI agents a user-owned self model and scoped memory. It stores facets and audit events locally, supports approval-gated writes, and includes export/import for portability.

Cachet is a local semantic cache for LLM APIs that sits in front of OpenAI- or Anthropic-compatible endpoints and serves repeated or rephrased requests from cache. It includes a dashboard for hit rate and estimated savings, supports streaming responses, and is implemented as a single Rust binary.

Open-source MCP server and CLI that lets an LLM control hardware workflows like compiling, flashing, and reading serial output for firmware development and device diagnostics.

An associative memory database that stores facts in plain language and recalls them by meaning. It ships as a Rust core with optional SQLite, encryption, and HTTP server features, plus examples and API docs.

Local-first agentic coding assistant in Rust with a terminal UI, embedded web UI, phone app, always-on gateway, and LAN grid dispatch across multiple machines.

A local AI IDE plugin that cleans up messy prompts before they reach Claude, Cursor, or OpenCode. It fixes typos, dropped words, and split tokens on-device with no network or token cost.

A Rust reimplementation of the 1982 ZX Spectrum BASIC runtime, compiled to native binaries and WebAssembly, with a live browser demo. The page frames it as an AI software-engineering experiment and describes the interpreter, editor, screen, keyboard, and runtime behavior it recreates.

Logbox is a developer tool that captures dev server logs and exposes them through an MCP server so coding agents can search and inspect logs directly.

A cognitive memory engine for AI agents with temporal decay, contradiction detection, autonomous consolidation, knowledge graph support, and ANN recall via HNSW. The repo shows Rust and Python usage, MCP client setup, and a quick-start path for agents and developers.

A minimal Rust crate for building agentic workflows in applications, with ticket-based orchestration, tools, knowledge storage, schema validation, retries, budget policies, and multi-provider support.

Open-source Rust coding agent with LLM-native code understanding, shell safety, and support for multiple LLM providers with automatic failover.

Terminai is a transparent terminal wrapper that adds an AI overlay for Codex, Claude Code, and custom CLI agents. It gives agents live terminal context plus approval-gated shell suggestions while preserving the normal terminal workflow.

Offline duplicate-code detector for codebases where AI agents write most of the code. It scans for structurally duplicated functions, tracks duplication over git history, and can fail CI when new code repeats existing logic.

HelixDB is an OLTP graph-vector database built in Rust, aimed at AI apps, knowledge graphs, and memory layers. The page shows the product’s core model, CLI workflow, SDK examples, and local setup commands.

Rust TUI for browsing local Codex and Claude Code session logs, searching past chats, and estimating API-equivalent cost.

Lightweight AI inference engine written in Rust for embedding local LLMs in mobile and desktop apps, with bindings for Python, Flutter, and React Native.

Buzz is a self-hostable workspace for humans and AI agents to collaborate in the same threads, with signed events, audit trails, channels, workflows, and code-oriented actions.

Sana is an object-storage-native search database for vectors, full-text search, and attribute filters. The repo describes durability, indexing, backends, operations, and quick-start commands for running the service or demo.

A local Rust CLI for A/B testing two CLAUDE.md files against a fixed SWE-bench Lite smoke set, with doctor, run, and report commands.