Generalized constraints for NMF with application to Informed Source Separation

Christian Rohlfing, Julian M. Becker

Presented at the 24th European Signal Processing Conference (EUSIPCO 2016), 29th August - 2nd September 2016, Budapest, Hungary
Conference homepage


Nonnegative matrix factorization (NMF) is a widely used method for audio source separation. Additional constraints supporting e.g. temporal continuity or sparseness adapt NMF to the structure of audio signals even further.

In this paper, we propose generalized NMF constraints which make use of prior information gathered for each component individually. In general, this information could be obtained blindly or by a training step. Here we make use of these novel constraints in an algorithm for informed audio source separation (ISS). ISS uses source separation to code audio objects by assisting a source separation step in the decoder with parameters extracted with knowledge of the sources in the encoder. In [1], a novel algorithm for ISS was proposed which makes use of an NMF step in the decoder. We show in experiments that the generalized constraints enhance the separation quality while keeping the additionally needed bit rate very low.





NOTICE FOR IEEE PUBLICATIONS: © IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE. Contact: Manager, Copyrights and Permissions / IEEE Service Center / 445 Hoes Lane / P.O. Box 1331 / Piscataway, NJ 08855-1331, USA. Telephone: + Intl. 908-562-3966.