pytorch

A hands-on workshop repository that walks developers through building a small GPT-style language model from scratch, including tokenization, transformer blocks, training, and text generation.

A PyTorch reference implementation of DeepSeek Sparse Attention from the LLMs-from-scratch project, including a lightweight indexer, top-K token selection, and a GPT-style model with KV-cache support.

A closed-loop controller for LLM training that adapts batch size, learning rate, checkpointing, and pruning to reduce OOM crashes on limited VRAM hardware.

A PyTorch research code file for adaptive topological control in latent spaces, with sphere-to-torus morphing, differentiable gating, and several geometry-inspired loss terms.