FPGA

A live demo and write-up showing a 3.16M-parameter INT4 transformer running entirely in on-chip memory on a Xilinx Kria KV260 FPGA, with measured token rates and hardware details.

An educational project that explains and demonstrates a homemade language processing unit inspired by Groq’s LPU, with a focus on running a small Transformer model and visualizing the idea behind AI hardware.