Musician Yotam Mann first debuted the app at an event back in November after staying at Google Creative Lab in New York, then open-sourced the code for it. But since it was a bit of a pain to install, the search giant cleaned it up and released it with a simpler web-based interface. On desktop, your home keys activate a slice of the piano’s middle notes, while mobile users can tap directly on the screen. It’s playful and easy to use, if not totally intuitive about when your AI partner will jump in already.
The app runs off Tone.js, an audio library that Mann built himself, but its accompaniment logic is built off Magenta, Google’s TensorFlow framework for deep learning. But as Mann tells in the video above, it’s not just the AI that’s adjusting to humans: As their digital partner riffed new tones off their original notes, folks kept playing to build a simultaneous harmony, creating a continual play loop. Now that’s some biotech synergy.