Rust

A local Rust-plus-Python middleware layer for LLM apps that claims to reduce token usage and add in-process security checks before prompts are sent to a provider.

Forall is an AI coding agent from Astrio that generates spec-driven code with machine-checkable proofs. The repo shows two usage paths: a CLI workflow and a hosted MCP verify-only mode for tools like Cursor, Claude Code, or Codex.

A Rust CLI and MCP server for orchestrating multiple coding agents, fusing their answers, and resuming or routing agent sessions locally.

A local-first MCP server and companion CLI/TUI for giving AI agents a user-owned self model and scoped memory. It stores facets and audit events locally, supports approval-gated writes, and includes export/import for portability.

Cachet is a local semantic cache for LLM APIs that sits in front of OpenAI- or Anthropic-compatible endpoints and serves repeated or rephrased requests from cache. It includes a dashboard for hit rate and estimated savings, supports streaming responses, and is implemented as a single Rust binary.

Open-source MCP server and CLI that lets an LLM control hardware workflows like compiling, flashing, and reading serial output for firmware development and device diagnostics.

An associative memory database that stores facts in plain language and recalls them by meaning. It ships as a Rust core with optional SQLite, encryption, and HTTP server features, plus examples and API docs.

Local-first agentic coding assistant in Rust with a terminal UI, embedded web UI, phone app, always-on gateway, and LAN grid dispatch across multiple machines.

A local AI IDE plugin that cleans up messy prompts before they reach Claude, Cursor, or OpenCode. It fixes typos, dropped words, and split tokens on-device with no network or token cost.

A Rust reimplementation of the 1982 ZX Spectrum BASIC runtime, compiled to native binaries and WebAssembly, with a live browser demo. The page frames it as an AI software-engineering experiment and describes the interpreter, editor, screen, keyboard, and runtime behavior it recreates.

Logbox is a developer tool that captures dev server logs and exposes them through an MCP server so coding agents can search and inspect logs directly.

A cognitive memory engine for AI agents with temporal decay, contradiction detection, autonomous consolidation, knowledge graph support, and ANN recall via HNSW. The repo shows Rust and Python usage, MCP client setup, and a quick-start path for agents and developers.

A minimal Rust crate for building agentic workflows in applications, with ticket-based orchestration, tools, knowledge storage, schema validation, retries, budget policies, and multi-provider support.

Open-source Rust coding agent with LLM-native code understanding, shell safety, and support for multiple LLM providers with automatic failover.

A local LLM gateway that redacts secrets before requests reach model providers and restores them locally afterward. It is aimed at agent workflows where prompts and tool calls may contain real credentials.

Flux is a Rust-based LLM inference planner and runtime that measures local hardware, chooses a model placement plan, and serves models behind an OpenAI-compatible API.

Local tools for agentic software development: a Rust and egui workspace that groups tasks, shells, coding agents, and code review in one place, with remote browser access and reusable UI/terminal components.

A Rust PTY wrapper that adds Codex-style syntax colors to Claude Code shell commands without changing how Claude Code runs.

A no_std Rust memory engine for on-device LLM agents that uses provenance-aware recall to keep a model’s own output from becoming evidence.

PipeCrab is an open-source Rust pipeline for building voice agents, with local inference support and examples that show end-to-end audio, transcription, LLM, and TTS flows.

Terminai is a transparent terminal wrapper that adds an AI overlay for Codex, Claude Code, and custom CLI agents. It gives agents live terminal context plus approval-gated shell suggestions while preserving the normal terminal workflow.

Offline duplicate-code detector for codebases where AI agents write most of the code. It scans for structurally duplicated functions, tracks duplication over git history, and can fail CI when new code repeats existing logic.

HelixDB is an OLTP graph-vector database built in Rust, aimed at AI apps, knowledge graphs, and memory layers. The page shows the product’s core model, CLI workflow, SDK examples, and local setup commands.

Rust TUI for browsing local Codex and Claude Code session logs, searching past chats, and estimating API-equivalent cost.