Document Detail

Online nonnegative matrix factorization with robust stochastic approximation.
MedLine Citation:
PMID:  24807135     Owner:  NLM     Status:  In-Data-Review    
Nonnegative matrix factorization (NMF) has become a popular dimension-reduction method and has been widely applied to image processing and pattern recognition problems. However, conventional NMF learning methods require the entire dataset to reside in the memory and thus cannot be applied to large-scale or streaming datasets. In this paper, we propose an efficient online RSA-NMF algorithm (OR-NMF) that learns NMF in an incremental fashion and thus solves this problem. In particular, OR-NMF receives one sample or a chunk of samples per step and updates the bases via robust stochastic approximation. Benefitting from the smartly chosen learning rate and averaging technique, OR-NMF converges at the rate of in each update of the bases. Furthermore, we prove that OR-NMF almost surely converges to a local optimal solution by using the quasi-martingale. By using a buffering strategy, we keep both the time and space complexities of one step of the OR-NMF constant and make OR-NMF suitable for large-scale or streaming datasets. Preliminary experimental results on real-world datasets show that OR-NMF outperforms the existing online NMF (ONMF) algorithms in terms of efficiency. Experimental results of face recognition and image annotation on public datasets confirm the effectiveness of OR-NMF compared with the existing ONMF algorithms.
Naiyang Guan; Dacheng Tao; Zhigang Luo; Bo Yuan
Related Documents :
19963865 - Wireless instantaneous neurotransmitter concentration sensing system (wincs) for intrao...
8225545 - A computer programme for recording male sex behaviour in rats.
24083315 - Error analysis of stochastic gradient descent ranking.
16171205 - Nav: a tool for producing presentation quality animations of graphical cognitive model ...
16834575 - Re-evaluating the recycling hypothesis in the germinal centre.
22288015 - A method for reviewing the accuracy and reliability of a five-level triage process (can...
Publication Detail:
Type:  Journal Article    
Journal Detail:
Title:  IEEE transactions on neural networks and learning systems     Volume:  23     ISSN:  2162-2388     ISO Abbreviation:  IEEE Trans Neural Netw Learn Syst     Publication Date:  2012 Jul 
Date Detail:
Created Date:  2014-05-08     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  101616214     Medline TA:  IEEE Trans Neural Netw Learn Syst     Country:  United States    
Other Details:
Languages:  eng     Pagination:  1087-99     Citation Subset:  IM    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine

Previous Document:  Transductive ordinal regression.
Next Document:  SSC: A Classifier Combination Method Based on Signal Strength.