Audio to MIDI

How to Convert Audio to MIDI Accurately

How to get accurate audio-to-MIDI results: pick the right source and detection mode, convert stems rather than full mixes, and clean up the notes.

On this page
  1. What affects accuracy
  2. Prepare the audio first
  3. Pick the detection mode
  4. Multiple instruments: separate stems first
  5. Tools: DAW features and dedicated converters
  6. Clean up after conversion
  7. Common mistakes
  8. Where to go next

What affects accuracy

Audio-to-MIDI tools estimate pitch, timing and loudness from a recording. They don’t understand the music. How well they do depends mostly on what you give them.

Source type ranking

Roughly, from easiest to hardest:

  • Monophonic lines, one note at a time: a vocal melody, a bass line, a single-note lead.
  • Percussive material, such as drum hits, where the tool mainly has to find the onsets.
  • Polyphonic single instruments, such as a piano or guitar playing chords.
  • Full mixes, with several instruments, reverb and overlapping notes.

A clean solo vocal usually converts far better than a finished song, even with the same software.

A dry, clean signal

Close, dry recordings work best: a direct guitar or bass signal, or an instrument miked close with little room sound. Heavy reverb, delay, chorus and distortion blur the start and end of each note, and they can add notes that were never played.

Prepare the audio first

A few steps before conversion usually save more time than any setting:

  • Set the tempo. Set the project tempo, or warp the audio to the beat, so the MIDI notes land on the grid.
  • Trim silence and remove noise. Low-level hiss, hum and room noise can create ghost notes. Trim the silence at the start and end of the clip.
  • Use a good file. WAV or FLAC is the safer choice. Ordinary MP3s often work well, but heavy compression can add artifacts that show up as short, false notes.

Pick the detection mode

Most converters let you choose how the audio should be read. Pick the mode that matches the material:

  • Melodic or monophonic for single-note lines.
  • Polyphonic or harmony for chords and multi-note instruments.
  • Percussive or drums for kits and rhythmic loops.

Choosing the wrong mode is a common reason for poor results. A chord read in melodic mode comes out as a jumble of short, wrong notes.

Multiple instruments: separate stems first

A full song won’t convert into clean, separate MIDI parts in one step. A more reliable approach is to split the song into stems first (vocals, drums, bass and other), then convert each stem with its own mode.

Some tools for this:

  • Built-in stem separation. Logic Pro 11 has a Stem Splitter that separates vocals, drums, bass and other parts. Ableton Live 12.3 added stem separation as well. Availability varies by version and edition, so check yours.
  • Free separators such as Demucs and Ultimate Vocal Remover (UVR).

Stems are never perfect. Each one carries some bleed from the others, and that bleed can create false notes. Expect to clean up.

Tools: DAW features and dedicated converters

Two groups of tools are worth knowing:

  • DAW features. Ableton Live has Convert Harmony, Convert Melody and Convert Drums. Logic Pro has Flex Pitch and Replace or Double Drum Track. Cubase has VariAudio and Hitpoints. Pro Tools has Elastic Audio. Each has its own article in this cluster.
  • Dedicated tools. Melodyne is a pitch and timing editor. Its editor and studio editions can detect several notes at once, while the essential edition handles one note at a time. Spotify’s Basic Pitch is a free, open-source model that can handle polyphonic recordings. NeuralNote is a free plugin built on Basic Pitch.

Dedicated tools are not automatically better. Basic Pitch is competitive on simple material, and a DAW’s built-in converter may be the easier choice when the rest of your session is already in that DAW.

Clean up after conversion

Plan to spend time on cleanup. The usual fixes:

  • Delete ghost notes and stray blips.
  • Fix octave errors. These are the most common pitch mistake, because the detector sometimes locks onto a harmonic.
  • Merge notes that were split in two.
  • Correct note lengths.
  • Quantize lightly, if the performance was not meant to be rigid.
  • Rescale velocity. Velocity is estimated from loudness, so treat it as a starting point.

Vibrato and slides are another issue. Depending on the tool’s settings, they turn into pitch bend or into many short notes. Choose the output that suits the part.

Low notes take longer to track. The low E on a bass, at about 41 Hz, has a cycle of about 24 ms, so the detector needs more time before it can judge the pitch. For a guitar’s low string, see the guitar guide.

Common mistakes

  • Expecting one click to turn a full mix into clean parts. Convert stems, not the finished song.
  • Skipping the source check. Noise, reverb and MP3 artifacts show up as false notes.
  • Assuming MIDI carries the sound. A MIDI file holds notes, timing, velocity and controllers. It does not carry the tone of the recording.
  • Assuming the output needs no editing. Plan for manual cleanup every time.
  • Assuming the expensive tool always wins. On simple, clean material, a free converter can be just as accurate.

Where to go next

Pick the workflow that matches your DAW or your source:

Keep exploring

Guides from other topics

All topics →