TYPE / STUDIO · SPEAK IN MUSIC INDEPENDENT · ONE-PERSON BUILD TYPEAISTUDIO.COM

TYPE / AI

INSTRUMENT GUIDE
GUIDE
 HOME TYPE / INSTRUMENT · V1 BETA

How to play

Everything you need to play Type / Instrument. Read it once, then go make noise.


most ai music tools make you write a prompt and wait. this one you play. you type, and a real neural net plays the notes live while a band follows you. there's no prompt box and no generate button. the reason it feels different is that your hands are on the model while it sounds, not before it sounds.

Get in

open typeaistudio.com, hit try the instrument, and you land straight in it. it pulls three small ai models into your browser, a few MB, which takes a few seconds the first time and is instant after that. nothing uploads, and nothing needs an account.

you need a real keyboard, so play it on a laptop or desktop. headphones make it better. you'll see the instrument already up but silent, with an unmute button top right. click unmute or just start typing and the sound comes on. browsers block audio until you interact with the page, which is the only reason that button is there.

The one thing to understand

the keyboard is a pitch dial, not a piano. keys on the left play low, keys on the right play high. so q is low, p is high, and sweeping your fingers left to right climbs a line. you pick the shape and the timing. Piano Genie, the neural net, picks the actual notes, and it's trained so they land in key, which means you cannot play a wrong one.

your timing is the rhythm. tap quick for short notes, hold a key down to sustain it. that's the whole instrument. everything else is the band reacting to what you do.

Read the contour bar

just above the line of text you're typing there's a row of eight cells. every keystroke lights the cell for where that key sits, left to right. it's the fastest way to feel the mapping. hit a few keys and watch which cell flashes, then sweep your hand and watch it walk across.

Keys and punctuation

any lettera note, low on the left of the keyboard, high on the right
hold a keysustains that note until you let go
spacea rest, a breath between phrases
! or ?reaches for the top of the range
. or ,resolves low
enterfresh groove and a new phrase

Stop typing and the AI takes over

pause for about a second and a half and the co-pilot starts soloing in your style, picking up the shape of what you just played. the LEAD readout up top flips from you to AI, and a big label shows in the visualizer so you always know who's playing. start typing again and you take the lead back. that's the trade-fours bit, you and the ai passing the line back and forth.

The band follows you

the bass and the pad don't sit on a fixed chord. they track the key your notes imply, which is why the KEY readout updates and pulses when your playing moves the center, say from C to Am. nothing clashes because the band is chasing your lead, not the other way around.

Type faster and the band leans in

the more you type, the more energy builds. the energy meter heats from cyan toward red, the BPM ticks up and flashes when it rises, and the drums get busier. slow down and it all settles back. so your dynamics come from how hard you're typing, not from a slider.

The console

open it with the + on the right. here's what each control does.

adventuroushow risky Piano Genie's note choices are. low stays safe and tonal, high takes chances
ai co-pilotturns the pause-and-solo on or off
metronomea click on the beat so you can lock timing, off by default
drums / bass / padthe three band parts, toggle any of them
new grooveresamples the drum groove from GrooVAE
lead voicethe synth your notes play through: pluck, keys, glass, saw, bell, soft
tempo / volumebase speed and level
space / echoreverb and delay on the lead
mute / unmutesound on or off, top right, always reachable
stop all soundkills every voice at once if it gets away from you

What the colors mean

the visualizer is telemetry, not decoration. the red line across the middle is the live waveform, the blocks along the bottom are the spectrum. the square marks are notes. white squares are you, cyan squares are the ai co-pilot, magenta is the harmony sitting underneath. so you can watch who is playing what.

A few things to actually try

  • sweep the home row left to right, slowly, then again in a fast burst. listen to how the band reacts.
  • play a short phrase, stop, and let the ai answer. trade a few rounds with it.
  • switch the lead voice from keys to glass or bell and play the same thing.
  • turn the metronome on, lock a steady rhythm, then turn drums off and play just to the click.
  • hit new groove a few times until the drums sit right under what you're playing.

Under the hood

three real models from Google's Magenta run inside your browser. Piano Genie maps your keys to notes. MusicRNN writes the co-pilot solos. GrooVAE shapes the drum groove so it breathes instead of clicking like a metronome. all of it runs client side on TensorFlow.js, which is why there's no server, no key, and no wait. that gap is the whole point, you're playing a model instead of prompting one.

If something's off

no soundhit unmute, top right. it starts muted until you click or type
stuck loadingrefresh the page. a stale cached file can hang it, a reload pulls the current one
on a phoneit needs a physical keyboard, so come back on a laptop

ready? play the instrument. questions go to m@typeaistudio.com. see the terms and support.