Show HN: I trained a 125M model to autocomplete piano on-device

A 125-million-parameter transformer was trained to autocomplete piano performances in real time, processing roughly 108 notes per second on an iPhone 15. The model operates entirely on-device, generating continuations after a user plays a few MIDI notes, and the app is available for free.