observability

Local-first observability and evaluation layer for production forecasts. Captures forecasts, validates them, computes horizon-aware metrics, and serves a read-only local UI for comparing runs.

Self-hosted observability and control plane for production and coding AI agents, with live timelines, fleet-wide feeds, token budgets, MCP allow/block rules, and support for Claude Code plus a Python sensor.

Open Bias is an open-source reliability harness for LLM apps and agents that enforces rules at runtime. It sits between your app and an LLM provider, using RULES.md policies to trace, block, or fix off-policy behavior.

Open-source package collection for BetterDB’s Valkey/Redis-based AI infrastructure, including semantic cache, agent memory, retrieval, monitoring, CLI, and an MCP server for assistants.

Open-source CLI and TUI for auditing Claude Code skills: shows usage heat, token cost, broken skills, and relationship graphs, with JSON/Markdown output for CI.

Open-source runtime for multi-agent AI systems with job scheduling, DAG orchestration, shared memory, tool execution, and real-time observability.

RiskKernel is an open-source, self-hosted reliability runtime for AI agents. It adds hard budgets, kill switches, crash-resumable runs, human approval gates, and OpenTelemetry export, with support for OpenAI, Anthropic, and existing agent stacks.

Intencion is a product analytics and observability platform for AI agents. It tracks user intent, tool calls, run outcomes, and resolution trends, then turns failures or unmet requests into Linear or GitHub issues.

Open-source platform for governing AI agents across clouds and stacks, with a control plane, sidecar-based data plane, policy enforcement, observability, and audit trails.

Greenflash is a product management layer for AI agents that reads production conversations, surfaces friction and intent gaps, and recommends what to fix or ship next. It includes SDKs, a REST API, Claude Code integration, and support for voice and text agents.

Self-hosted runtime for putting hard budgets, approval gates, observability, and resumable checkpoints around AI agents.

A local, read-only observability dashboard for Claude Code with live event streams, session Kanban, token and cost charts, a 3D tool-call graph, and plugin-based widgets.

Open-source agentic mesh for governing AI agents across enterprise systems, with identity, policy enforcement, audit trails, observability, and Kubernetes-native deployment.

An open-source control plane for AI agents that adds policy enforcement, approval gates, durable execution, audit logs, and observability for unattended workflows.

Go-native framework for building, orchestrating, and observing AI agents with native OpenTelemetry, an embedded dashboard, replay, and first-party MCP/A2A support.

Klent is an AI agent guardrails product that sits between agents and their tools, letting teams allow, deny, pause, rewrite, or redirect tool calls with policies, human approval flows, and audit trails.

A self-hosted Python runtime for building agentic AI apps with server-driven UI, audit logging, RBAC, sandboxing, and pluggable model orchestration.

A curated GitHub resource list for production AI agent infrastructure, covering runtimes, sandboxes, tool protocols, security, observability, and evaluation.

Local-first record, inspect, and replay tool for debugging AI agents. Orchid captures LLM calls and tool traffic through a proxy, exposes traces in a web UI and MCP tools, and supports offline replay for deterministic testing.

AISBF is a self-hostable AI service broker and OpenAI-compatible proxy/router for routing requests across multiple providers, adding prompt-aware model selection, failover, quotas, analytics, and privacy-focused deployment options.

Open-source Kubernetes-native runtime for LLM agents. CLRK runs agents in gVisor sandboxes and intercepts outbound traffic for observability, policy enforcement, credential injection, and routing control.

A plugin for recording AI coding agent activity in a tamper-evident local audit trail. It stores sessions, tool calls, prompts, and integrity checkpoints in SQLite and exposes CLI and UI views for status, reports, anomalies, spend, inventory, exports, and proof verification.

A single-binary OpenTelemetry trace generator that simulates realistic microservice and AI-agent traces, with chaos injection and multiple topology sizes.

Python toolkit for building LLM agents with MCP servers, skills folders, memory, streaming, and metrics support.