Document Detail


AN EVALUATION OF MULTIPLE FEED-FORWARD NETWORKS ON GPUs.
MedLine Citation:
PMID:  21243729     Owner:  NLM     Status:  In-Data-Review    
Abstract/OtherAbstract:
The Graphics Processing Unit (GPU) originally designed for rendering graphics and which is difficult to program for other tasks, has since evolved into a device suitable for general-purpose computations. As a result graphics hardware has become progressively more attractive yielding unprecedented performance at a relatively low cost. Thus, it is the ideal candidate to accelerate a wide variety of data parallel tasks in many fields such as in Machine Learning (ML). As problems become more and more demanding, parallel implementations of learning algorithms are crucial for a useful application. In particular, the implementation of Neural Networks (NNs) in GPUs can significantly reduce the long training times during the learning process. In this paper we present a GPU parallel implementation of the Back-Propagation (BP) and Multiple Back-Propagation (MBP) algorithms, and describe the GPU kernels needed for this task. The results obtained on well-known benchmarks show faster training times and improved performances as compared to the implementation in traditional hardware, due to maximized floating-point throughput and memory bandwidth. Moreover, a preliminary GPU based Autonomous Training System (ATS) is developed which aims at automatically finding high-quality NNs-based solutions for a given problem.
Authors:
Noel Lopes; Bernardete Ribeiro
Related Documents :
18253819 - How variations in distance affect eyewitness reports and identification accuracy.
20705549 - On the decay of distractor-response episodes.
20884469 - The more often you see an object, the easier it becomes to track it.
12916649 - Dual target identification and the attentional blink in parkinson's disease.
6465219 - Mental retardation, inspection time, and central attentional impairment.
21254449 - Deficits in adults with autism spectrum disorders when processing multiple objects in d...
24611249 - Effect of handedness on gross motor skill acquisition in a novel sports skill task.
25407659 - Response dynamics in prospective memory.
7662179 - Age differences and similarities in patterns of cerebral hemispheric asymmetry.
Publication Detail:
Type:  Journal Article    
Journal Detail:
Title:  International journal of neural systems     Volume:  21     ISSN:  0129-0657     ISO Abbreviation:  Int J Neural Syst     Publication Date:  2011 Feb 
Date Detail:
Created Date:  2011-01-18     Completed Date:  -     Revised Date:  -    
Medline Journal Info:
Nlm Unique ID:  9100527     Medline TA:  Int J Neural Syst     Country:  Singapore    
Other Details:
Languages:  eng     Pagination:  31-47     Citation Subset:  IM    
Affiliation:
CISUC, Department of Informatics Engineering, University of Coimbra, Portugal. noel@ipg.pt.
Export Citation:
APA/MLA Format     Download EndNote     Download BibTex
MeSH Terms
Descriptor/Qualifier:

From MEDLINE®/PubMed®, a database of the U.S. National Library of Medicine


Previous Document:  Semi-supervised analysis of human brain tumours from partially labeled mrs information, using manifo...
Next Document:  Information quantification of empirical mode decomposition and applications to field potentials.