rag

A self-hosted Docker Compose stack for running local AI services including Ollama, LiteLLM, Whisper, Kokoro, embeddings, and an MCP Gateway.

Self-hosted, OpenAI-compatible AI gateway for private RAG, natural-language data access, and tool-calling agents. It connects files, databases, vector stores, APIs, and MCP tools through one backend with auth, observability, and governance features.

오픈소스 AI 인프라 산정 도구로, 보유 GPU나 목표 워크로드를 입력해 실행 가능한 모델, 필요 장비, 배치안, TCO 비교까지 계산합니다. LLM, RAG, VLM, 아바타, 음성 워크로드를 다루며 한국어/영어 UI와 여러 추천 경로를 제공합니다.

A local-first backend for AI agents that bundles documents, vector search, cache, queues, and cron jobs into one SQLite file, with optional Postgres support.

A 150M ModernBERT-based token classification model that extracts verbatim evidence spans for RAG and related pipelines, reducing the need for an LLM call to highlight answers.

JetBrains introduces Mellum2, an open-source 12B model built for software engineering workflows, routing, Q&A, RAG, sub-agents, and private deployment.

A two-part self-study course for building a tiny LLM stack from scalar autograd to a working chat assistant, with modules covering transformers, pretraining, instruction tuning, retrieval, tool use, and agent loops.

TokenPath is an API for token-level citations and attribution for LLM outputs. It resolves claims in generated answers back to source spans, uses attention-based tracing, and includes an endpoint for raw heatmaps.

ForthWrite is a Chrome extension for Gmail that learns a user’s email voice from sent messages and edits. This page explains its retrieval-and-feedback loop in detail, including pgvector-based RAG, edit-distance scoring, a phrasing miner, and the stack behind the product.

Hubmesh is a Python library for multi-hop GraphRAG retrieval planning on top of existing vector databases. It adds centrality-aware seed selection, budget-aware context packing, entity graph building, and an MCP server for agent/tool integrations.

A Python package and CLI for checking how closely an AI-generated answer reuses its source text, with support for verbatim matching, subsequence matching, quotation verification, and pipeline gating.

SmolSignal is an AI signal copilot for Flipper Zero files. It explains common capture formats, classifies safety risk, supports local and cloud model backends, and can generate safe consumer IR files.

Open-source SDK and libraries for building local-first, peer-to-peer AI apps. It supports local LLM inference, embeddings, translation, transcription, TTS, OCR, image generation, and an OpenAI-compatible API across desktop and mobile platforms.

A pure-Python LLM inference engine and server with CUDA/HIP/Metal code generation, OpenAI-compatible API support, built-in RAG, and multi-GPU backend support.

Dream Server is an open-source stack that turns a PC, Mac, or Linux machine into a private AI server with local model inference, chat UI, voice, agents, workflows, RAG, and image generation. The page shows setup instructions, platform support, release notes, and a clear positioning for self-hosted use.

AI-powered knowledge base for Terraform modules that supports semantic search, agentic composition, audit checks, and optimization from indexed repositories and conventions.

An open-source Python support agent that uses SynapCores as the agent brain for memory, retrieval, semantic tool routing, and generation. The repo includes a quick start, local Docker setup, example commands, and a traced demo of the agent loop.

Backprompter is a workspace for creating, testing, and deploying AI agents without backend code. The page shows prompt-based agent setup, simulated users and evaluations, hosted chat UI deployment, SDK/API access, RAG, voice chat, and Stripe billing.

Symbio is a local AI assistant that learns from user corrections, builds training data from notes, and can fine-tune itself over time. It supports file operations, sandboxed shell commands, RAG, a Telegram bot, and a demo with MoA and skill adapters.

A job board focused on AI engineering roles, with first-party listings for RAG, agents, evals, inference, and MCP-related work. The page shows live filters, location and seniority breakdowns, and a nightly refreshed feed of open roles.

Custodian Labs is a developer platform for building and deploying AI agents from a small code snippet. The page highlights agent deployment, built-in RAG, model flexibility, multi-agent routing, and a privacy-focused Guardian layer for handling PII.

AgentReady is an MCP-based service that turns public websites into agent-friendly docs sources with cited answers, llms.txt generation, and live /ask and /mcp endpoints.

An open-source multi-model teaching assistant for UIUC ECE 120, with a Gradio UI, retrieval-augmented search, and evaluation scripts. The repo includes setup instructions, a live Hugging Face demo, and details on how it uses separate models for retrieval, generation, moderation, and ranking.

An open NDJSON specification for AI crawler ingestion and site content graphs, with examples and reference files in the repository.