LLM infrastructure

Local-first AI memory layer for LLM apps with persistent knowledge graph storage, entity extraction, semantic retrieval, and API endpoints for ingesting and retrieving context.

Adola offers Rose 1, a prompt compression API that trims noisy context before LLM calls while aiming to preserve answer quality. The page shows quickstart code, benchmark claims, and use cases for agent traces, RAG retrieval, prompt gateways, and support copilots.

A logical KV cache profiler and leak detector for PagedAttention engines like vLLM and SGLang, with a dashboard, live engine hook, CI checks, and Perfetto trace export.

Production LLM infrastructure for building and monitoring AI agents, with model routing across 200+ models, output validation, observability, evals, governance, RAG, memory, and cost controls.

TokenGO is a self-operated inference API for open-weight LLMs and video models. It offers OpenAI-compatible access, model routing, enterprise uptime claims, and a set of priced models including GLM, DeepSeek, Kimi, and MiniMax.