The signal separation evaluation campaign (20072010): Achievements and remaining challenges

Emmanuel Vincent, Shoko Araki, Fabian Theis, Guido Nolte, Pau Bofill, Hiroshi Sawada, Alexey Ozerov, Vikrham Gowreesunker, Dominik Lutter, Ngoc Q.K. Duong

Research output: Contribution to journalArticlepeer-review

140 Scopus citations


We present the outcomes of three recent evaluation campaigns in the field of audio and biomedical source separation. These campaigns have witnessed a boom in the range of applications of source separation systems in the last few years, as shown by the increasing number of datasets from 1 to 9 and the increasing number of submissions from 15 to 34. We first discuss their impact on the definition of a reference evaluation methodology, together with shared datasets and software. We then present the key results obtained over almost all datasets. We conclude by proposing directions for future research and evaluation, based in particular on the ideas raised during the related panel discussion at the Ninth International Conference on Latent Variable Analysis and Signal Separation (LVA/ICA 2010).

Original languageEnglish
Pages (from-to)1928-1936
Number of pages9
JournalSignal Processing
Issue number8
StatePublished - Aug 2012
Externally publishedYes


  • Audio
  • Biomedical
  • Evaluation
  • Resources
  • Source separation


Dive into the research topics of 'The signal separation evaluation campaign (20072010): Achievements and remaining challenges'. Together they form a unique fingerprint.

Cite this