home/ atoms/ source-separation-six-stem-extension

Extending stem separation to guitar and piano is harder than the standard four-stem split

Standard Demucs separates four stems: drums, bass, vocals, other. The htdemucs_6s model adds guitar and piano. At the time of the v4 release, guitar quality is acceptable but the piano stem shows significant bleed and artefacts. This reflects a fundamental challenge: piano and guitar share harmonic spectral regions with each other and with ‘other’ instruments, and isolated piano/guitar stems are scarce in freely licensed multi-track datasets. The ‘other’ category absorbs most remaining harmonic content in the four-stem model, but splitting it requires much more training data with clean guitar and piano stems.

Examples

# Try the 6-stem model:
demucs -n htdemucs_6s mytrack.mp3
# Outputs: drums.wav, bass.wav, vocals.wav, other.wav, guitar.wav, piano.wav
# Warning: piano.wav may have significant bleed

Assessment

Why is separating piano harder than separating drums from a neural model perspective? What properties of drums make them easier to isolate?

“although the latter doesn't work so well at the moment).”
corpus · demucs-music-source-stem-separation · chunk 4