Projects
- 2026
Black & Weights
A proof of concept for a tiny specialized LLM (48M parameters) running in the browser. It’s inspired by the Black & White game series. You control a giant hand and can interact with the villagers on this island (controlled by the LLM).
My main motivation was to see how applications like games can take advantage of the dynamic interactions that LLMs can drive without having to deal with scaling costs on inference. I also wanted to learn how to train a small LLM end to end, distilling it from a larger model, and see how well it measures up in a specialized role.
