rag

A self-hosted Docker Compose stack for running local AI services including Ollama, LiteLLM, Whisper, Kokoro, embeddings, and an MCP Gateway.

JetBrains introduces Mellum2, an open-source 12B model built for software engineering workflows, routing, Q&A, RAG, sub-agents, and private deployment.

A pure-Python LLM inference engine and server with CUDA/HIP/Metal code generation, OpenAI-compatible API support, built-in RAG, and multi-GPU backend support.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

An open-source Python support agent that uses SynapCores as the agent brain for memory, retrieval, semantic tool routing, and generation. The repo includes a quick start, local Docker setup, example commands, and a traced demo of the agent loop.

Open-source local-first AI agent that routes between local and cloud LLMs, learns from escalations, and stores knowledge for future queries. The repo includes a quickstart, setup modes, and a concrete explanation of how it ingests docs and improves over time.

Neurvance provides CC0-licensed AI training data bundles with document-level provenance, EU AI Act Article 10/Annex IV mapping, and an API for bulk download and RAG retrieval.

An experimental RAG lab for constrained environments, with configurable document classification, chunking, retrieval, reranking, and chat context assembly. It includes Open WebUI integration and emphasizes debugging retrieval and context failures.

CacheCore is an agent infrastructure tool that sits between LLM clients and the API to cache exact and near-identical prompts, cutting repeat calls and latency. The page shows OpenAI-compatible integration, support for common agent frameworks, and use cases for RAG and multi-agent workflows.

Community edition of Merlin, a local-first deduplication tool for LLM context and RAG pipelines. The repo includes quick-start install steps, MCP and editor integrations, savings claims, and rollback guidance.

A blog post about verifiable RAG that benchmarks open-source NLI verifiers against Claude on RAGTruth and describes a Python library for sentence-level citation and claim verification.

A GitHub example that audits LangChain’s RAG quickstart with retrieval-quality metrics, flags off-topic and out-of-distribution queries, and surfaces ranking and calibration issues with charts and results files.

A GitHub repository for a latency-separated AI memory retrieval and RAG system. The README describes fetch, compute, and ANN search stages, includes benchmark ranges, and exposes a public test endpoint.