Document Detail


Stochastic Subset Selection for Learning With Kernel Machines.
MedLine Citation:
PMID:  22049369     Owner:  NLM     Status:  Publisher    
Abstract/OtherAbstract:
Kernel machines have gained much popularity in applications of machine learning. Support vector machines (SVMs) are a subset of kernel machines and generalize well for classification, regression, and anomaly detection tasks. The training procedure for traditional SVMs involves solving a quadratic programming (QP) problem. The QP problem scales super linearly in computational effort with the number of training samples and is often used for the offline batch processing of data. Kernel machines operate by retaining a subset of observed data during training. The data vectors contained within this subset are referred to as support vectors (SVs). The work presented in this paper introduces a subset selection method for the use of kernel machines in online, changing environments. Our algorithm works by using a stochastic indexing technique when selecting a subset of SVs when computing the kernel expansion. The work described here is novel because it separates the selection of kernel basis functions from the training algorithm used. The subset selection algorithm presented here can be used in conjunction with any online training technique. It is important for online kernel machines to be computationally efficient due to the real-time requirements of online environments. Our algorithm is an important contribution because it scales linearly with the number of training samples and is compatible with current training techniques. Our algorithm outperforms standard techniques in terms of computational efficiency and provides increased recognition accuracy in our experiments. We provide results from experiments using both simulated and real-world data sets to verify our algorithm.
Authors:
Jason Rhinelander; Xiaoping P Liu
Related Documents :
9465569 - Air force school of health care science's quality of life study.
7599589 - Building and maintaining a library gopher: traditional skills applied to emerging resou...
20544479 - Interdisciplinary education in end-of-life care: creating new opportunities for social ...
17100589 - Premature ageing prevention: limitations and perspectives of pharmacological interventi...
18492639 - Mall walking as a physical activity option: results of a pilot project.
16679109 - Understanding the internet, website design and intranet development: a primer for radio...
17786269 - Applying transactional analysis and personality assessment to improve patient counselin...
9750939 - A multidimensional evaluation of fire fighter training for hazardous materials response...
22574729 - The indebtedness of portuguese soccer teams - looking for determinants.
Publication Detail:
Type:  JOURNAL ARTICLE     Date:  2011-10-27
Journal Detail:
Title:  IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society     Volume:  -     ISSN:  1941-0492     ISO Abbreviation:  -     Publication Date:  2011 Oct 
Date Detail:
Created Date:  2011-11-3     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  9890044     Medline TA:  IEEE Trans Syst Man Cybern B Cybern     Country:  -    
Other Details:
Languages:  ENG     Pagination:  -     Citation Subset:  -    
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Scale and Rotation Invariant Local Binary Pattern Using Scale-Adaptive Texton and Sub-uniform Based ...
Next Document:  Analysis of Using Interpulse Intervals to Generate 128-bit Biometric Random Binary Sequences for Sec...