llm

A pricing analysis article comparing batch API discounts across Google, OpenAI, Anthropic, xAI, and OpenRouter, with a focus on where batch rates differ from standard pricing.

HyperSAE is a Python package for mechanistic interpretability that trains hyperbolic sparse autoencoders on LLM activations. The page includes installation steps, a quickstart example, benchmark tables, and a short software architecture overview.

OneRingAI is an open-source TypeScript library for building AI agents with integrations and graph memory. The repository shows a substantial codebase with docs, setup files, testing, MCP-related material, and references to supported models and multimodal capabilities.

An open-source project for running a small LLM and limited agent workflows on ESP32-P4 hardware, with model details, architecture notes, examples, and setup instructions.

A Python tool manager for AI agents that uses an LLM-tools.txt registry to install, pin, describe, and execute tools with one predictable contract.

A GitHub repository for an engine-agnostic KV cache fragment system for on-device LLM inference, with Android and Go components, adapters for llama.cpp/MLC-LLM/ONNX Runtime, and benchmark and monitoring code.

A local-first desktop environment for dispatching coding tasks to any model and any agent, with diff review, terminal streaming, task history, and per-project configuration.

An open-source ID library that generates human-readable, token-efficient IDs for AI agents and LLM workflows, with parsing, validation, deterministic IDs, and alias mapping utilities.

An experimental autonomous bare-metal OS agent that uses an LLM, VirtualBox, and screenshot inspection to iterate on low-level code, boot a VM, and refine behavior from execution results.

A TypeScript markdown parser built for incremental streaming, aimed at parsing LLM markdown output on the server or client. It exposes a typed AST, supports CommonMark and GFM tables, and includes examples for full and streaming parsing.

Apple Machine Learning Research paper proposing LaDiR, a reasoning framework that combines a VAE-based latent space with latent diffusion to improve LLM text reasoning and iterative refinement.

Public evaluation code for an Agent Memory Leaderboard, including answer-generation and scoring contracts for comparing LLM agent memory systems.

A write-up of a custom French-learning system built around spaced repetition, grammar tracking, and a voice practice app. It explains the problem, the workflow, and the model/API stack used to keep costs low.

arXiv paper on a self-speculative decoding framework for speeding up reasoning LLM inference on edge hardware, with hardware co-design and reported speedups.

A research preprint describing ADHD, a parallel divergent ideation method for LLM coding agents that isolates branches, uses cognitive frames, and then prunes with a separate critic pass.

A prompt-based medieval fantasy text adventure for LLM chats, with character creation, combat, companions, inventory tracking, and a main quest to find four mysterious items.

A free browser arcade game where you play as an LLM, dodging prompt injections, hallucinations, rate limits, and deprecation while gobbling tokens.

An open-source simulator that studies how GPT inference behaves under space radiation and cosmic-ray fault conditions, with CLI runs, comparisons, and self-contained HTML reports.

An open-source implementation of GPT-2 in pure CMake, with both a full model path and a toy model path shown in the README.

A GitHub research project documenting a long-form, multi-model analysis of LLM behavior across Claude, Gemini, ChatGPT, and Grok. The repo includes an executive summary, screenplay, technical white paper, and archive of logs and chat records.

A field note about testing a coding agent fully offline on a laptop with Ollama and Qwen3.8 27B, including the setup, failure modes, and the workaround that made the project finish.

An interactive simulation about how inference providers ration access to stronger LLMs when demand spikes. Users can compare the default industry rule with their own policy and explore who gets the strong model.

A tournament site where users coach LLMs competing in embodied 1v1 soccer, with signup access and a live kickoff countdown.

A Hermes plugin that uses adversarial LLM clones to confront sandbagging and reward-hacking behavior during agent sessions.