llm

CLI tool for versioning, diffing, rolling back, and searching AI prompts, with Git-style workflows for prompt management.

Open-source AI agent monitoring platform with tracing, issue grouping, evals, semantic search, alerts, and MCP access for coding agents.

An OTP-native Elixir library for building AI agents, durable LLM workflows, retrieval pipelines, and production LLM services.

Lowfat is a lightweight CLI tool that filters noisy command output before it reaches an AI agent, with plugins, shell integration, and usage stats for token savings.

Google’s Gemini 3.5 Flash announcement describes a frontier model aimed at agents and coding, with notes on speed, multimodal generation, and availability through the Gemini app, Google Antigravity, Gemini API, AI Studio, Android Studio, and Gemini Enterprise.

LLMCap is a proxy for LLM API calls that hard-stops requests when a dollar cap is reached, with support for major providers and companion tools for VS Code, CLI, and Windows.

An open-source CLI for testing LLM prompts across consistency, latency, cost, and behavior, with HTML reports and support for OpenAI and Anthropic.

oruk is a live broadcast intelligence API for real-time news. It offers REST endpoints, SSE streaming, webhooks, and an MCP server for use in AI apps and developer workflows.

Portus is a Rust-based API and AI gateway for Kubernetes that handles HTTP, LLM, and MCP traffic on one data plane. The page shows Gateway API conformance, performance benchmarks, AI key and budget controls, and MCP routing examples.

Open-source structured memory for AI agents. Ingot stores tool results and documents in SQL-friendly form, with optional embeddings, MCP access, and a local quick start for running the stack.

Anthropic’s documentation page on how to prompt Claude Opus 5.5, with guidance for effort calibration, agentic runs, progress updates, multi-app workflows, refusals, pasted text, and visual inputs.

A local proxy that inspects LLM requests and attachments for secrets before they reach the model, with redaction, rejection modes, and local attachment decoding/OCR.

A browser extension that lets users move AI chat threads between ChatGPT, Claude, and Gemini without retyping. It supports exporting/importing local .chatbridge files and emphasizes browser-only, local-first handling.

A two-part self-study course for building a tiny LLM stack from scalar autograd to a working chat assistant, with modules covering transformers, pretraining, instruction tuning, retrieval, tool use, and agent loops.

A Python framework for building AI agents as Python objects, with typed methods, stateful fields, and LLM-driven agentic methods. The repo includes installation steps, a quick start, examples, and notes on supported models and safety boundaries.

TokenPath is an API for token-level citations and attribution for LLM outputs. It resolves claims in generated answers back to source spans, uses attention-based tracing, and includes an endpoint for raw heatmaps.

VS Code extension that helps review large AI-generated diffs with local call graphs, file dependency graphs, and review cards that show blast radius and context before changes are pushed.

fenic is an open-source Python framework for semantic DataFrames, letting you use LLM-powered operators like extract, classify, summarize, and embed inside query pipelines.

Open-source terminal coding agent in Rust with LLM-native code understanding, shell safety, multi-provider support, and automatic failover.

Python package for recording real LLM API responses and replaying them in tests so LLM-driven code can run deterministically without live API calls.

Open-source memory system for LLM characters with library, API, MCP server, and WebUI options. The repo explains how it stores and recalls character, user, episode, emotion, world, and calendar memory, and includes install and usage examples.

Self-hosted AI business analyst for querying company spreadsheets, contracts, PDFs, emails, and sample data, with answers that cite source files and run locally with your own model key.

Deterministic harness for LLM code edits. The model proposes SEARCH/REPLACE blocks, a local runtime applies them in a shadow worktree, and TypeScript compilation gates the merge.

Self-hosted voice agent runtime that streams speech-to-text, LLM output, and text-to-speech together in one process. The page shows quickstart commands, a minimal agent example, browser/client embedding, authentication notes, and performance benchmarks.