ai inference

Sipp is a zero-dependency AI inference runtime for running models in the browser and across Node, Rust, Python, and self-hosted gateways. The page shows install commands, a symmetric client API, benchmark claims, and live demos for chat, agents, vision, and game use cases.

A Python/Flask code example that shows how to build a retrieval-augmented generation API with Telnyx embeddings and chat completions. The repo includes setup steps, environment variables, endpoint docs, and sample responses.

Lightweight AI inference engine written in Rust for embedding local LLMs in mobile and desktop apps, with bindings for Python, Flutter, and React Native.