infrastructure

Open-source tooling that generates private, point-in-time infrastructure snapshots from cloud and on-prem systems into vendor-neutral OSIRIS JSON for audits, diagrams, diffs, CMDB/IPAM/DCIM workflows, and controlled AI/MCP context.

LiteLLM is moving its AI gateway to Rust and claims major gains in throughput, memory use, and request overhead while keeping the same config, API, and provider coverage.

Open-source AI infrastructure project focused on GPU memory management and serving, with a Python control plane, C++ data plane, and optional CUDA kernels.