Classic Nintendo audio is translated in (very near) real-time for live playing by a modern-day “player piano” (Yamaha Disklavier) and robot percussion system, under Raspberry Pi control.
The software is responsible for translating the gameplay audio to instructions which ultimately define which solenoid should be actuated. In full disclosure, there is normally a half-second audio delay that was removed in editing, but it’s still very playable live. The piano is controlled through the Disklavier’s MIDI interface, while the percussion’s solenoids are directly controlled through the Pi’s GPIO interface.
“Nintendo audio played by player piano and robotic percussion“