llm-tracing

An unofficial Grafana plugin for Hermes Agent that records LLM calls and tool executions as generations and sends OTEL traces and metrics to Grafana Cloud.

OpenSmith is a local-first, open-source alternative to LangSmith for tracing Python LLM pipelines. It supports decorators, context managers, console output, autopatching, CLI commands, local SQLite storage, and optional Postgres and OpenTelemetry integrations.