bootgpt: an 11.5 KB int8 char-level language model whose whole inference engine fits in a 512-byte boot sector
BootGPT runs a small character-level language model directly from a PC boot sector: its hand-written 16-bit x86 inference engine fits in 510 bytes, while an 11.5 KB int8 model sits in following disk sectors.
- inference