attention

TokenPath is an API for token-level citations and attribution for LLM outputs. It resolves claims in generated answers back to source spans, uses attention-based tracing, and includes an endpoint for raw heatmaps.

A PyTorch reference implementation of DeepSeek Sparse Attention from the LLMs-from-scratch project, including a lightweight indexer, top-K token selection, and a GPT-style model with KV-cache support.