Mathematics and Computers in Simulation, volume 177, pages 232-243

Application of the residue number system to reduce hardware costs of the convolutional neural network implementation

Publication typeJournal Article
Publication date2020-11-01
Quartile SCImago
Q1
Quartile WOS
Q1
Impact factor4.6
ISSN03784754
Applied Mathematics
Theoretical Computer Science
General Computer Science
Numerical Analysis
Modeling and Simulation
Abstract
Convolutional neural networks are a promising tool for solving the problem of pattern recognition. Most well-known convolutional neural networks implementations require a significant amount of memory to store weights in the process of learning and working. We propose a convolutional neural network architecture in which the neural network is divided into hardware and software parts to increase performance and reduce the cost of implementation resources. We also propose to use the residue number system (RNS) in the hardware part to implement the convolutional layer of the neural network. Software simulations using Matlab 2018b showed that convolutional neural network with a minimum number of layers can be quickly and successfully trained. The hardware implementation of the convolution layer shows that the use of RNS allows to reduce the hardware costs on 7.86%–37.78% compared to the two’s complement implementation. The use of the proposed heterogeneous implementation reduces the average time of image recognition by 41.17%.

Citations by journals

1
2
3
4
5
6
7
8
Applied Sciences (Switzerland)
Applied Sciences (Switzerland), 8, 2.87%
Applied Sciences (Switzerland)
8 publications, 2.87%
IEEE Access
IEEE Access, 8, 2.87%
IEEE Access
8 publications, 2.87%
Electronics (Switzerland)
Electronics (Switzerland), 5, 1.79%
Electronics (Switzerland)
5 publications, 1.79%
Sensors
Sensors, 5, 1.79%
Sensors
5 publications, 1.79%
Lecture Notes in Computer Science
Lecture Notes in Computer Science, 5, 1.79%
Lecture Notes in Computer Science
5 publications, 1.79%
Remote Sensing
Remote Sensing, 4, 1.43%
Remote Sensing
4 publications, 1.43%
Neural Computing and Applications
Neural Computing and Applications, 4, 1.43%
Neural Computing and Applications
4 publications, 1.43%
Journal of Physics: Conference Series
Journal of Physics: Conference Series, 4, 1.43%
Journal of Physics: Conference Series
4 publications, 1.43%
Lecture Notes in Networks and Systems
Lecture Notes in Networks and Systems, 4, 1.43%
Lecture Notes in Networks and Systems
4 publications, 1.43%
Concurrency Computation Practice and Experience
Concurrency Computation Practice and Experience, 3, 1.08%
Concurrency Computation Practice and Experience
3 publications, 1.08%
Diagnostics
Diagnostics, 3, 1.08%
Diagnostics
3 publications, 1.08%
International Journal of Molecular Sciences
International Journal of Molecular Sciences, 3, 1.08%
International Journal of Molecular Sciences
3 publications, 1.08%
Briefings in Bioinformatics
Briefings in Bioinformatics, 3, 1.08%
Briefings in Bioinformatics
3 publications, 1.08%
Computational Intelligence and Neuroscience
Computational Intelligence and Neuroscience, 3, 1.08%
Computational Intelligence and Neuroscience
3 publications, 1.08%
International Journal of Environmental Research and Public Health
International Journal of Environmental Research and Public Health, 2, 0.72%
International Journal of Environmental Research and Public Health
2 publications, 0.72%
Water (Switzerland)
Water (Switzerland), 2, 0.72%
Water (Switzerland)
2 publications, 0.72%
Journal of Marine Science and Engineering
Journal of Marine Science and Engineering, 2, 0.72%
Journal of Marine Science and Engineering
2 publications, 0.72%
Scientific Reports
Scientific Reports, 2, 0.72%
Scientific Reports
2 publications, 0.72%
Multimedia Tools and Applications
Multimedia Tools and Applications, 2, 0.72%
Multimedia Tools and Applications
2 publications, 0.72%
Computational and Structural Biotechnology Journal
Computational and Structural Biotechnology Journal, 2, 0.72%
Computational and Structural Biotechnology Journal
2 publications, 0.72%
Journal of Petroleum Science and Engineering
Journal of Petroleum Science and Engineering, 2, 0.72%
Journal of Petroleum Science and Engineering
2 publications, 0.72%
Resources, Conservation and Recycling
Resources, Conservation and Recycling, 2, 0.72%
Resources, Conservation and Recycling
2 publications, 0.72%
Materials Today: Proceedings
Materials Today: Proceedings, 2, 0.72%
Materials Today: Proceedings
2 publications, 0.72%
Energy Reports
Energy Reports, 2, 0.72%
Energy Reports
2 publications, 0.72%
Mathematical Problems in Engineering
Mathematical Problems in Engineering, 2, 0.72%
Mathematical Problems in Engineering
2 publications, 0.72%
Communications in Computer and Information Science
Communications in Computer and Information Science, 2, 0.72%
Communications in Computer and Information Science
2 publications, 0.72%
Water Resources Research
Water Resources Research, 1, 0.36%
Water Resources Research
1 publication, 0.36%
Physics of Fluids
Physics of Fluids, 1, 0.36%
Physics of Fluids
1 publication, 0.36%
Journal of the Acoustical Society of America
Journal of the Acoustical Society of America, 1, 0.36%
Journal of the Acoustical Society of America
1 publication, 0.36%
1
2
3
4
5
6
7
8

Citations by publishers

5
10
15
20
25
30
35
40
45
50
Multidisciplinary Digital Publishing Institute (MDPI)
Multidisciplinary Digital Publishing Institute (MDPI), 46, 16.49%
Multidisciplinary Digital Publishing Institute (MDPI)
46 publications, 16.49%
Springer Nature
Springer Nature, 42, 15.05%
Springer Nature
42 publications, 15.05%
Elsevier
Elsevier, 40, 14.34%
Elsevier
40 publications, 14.34%
IEEE
IEEE, 13, 4.66%
IEEE
13 publications, 4.66%
Wiley
Wiley, 9, 3.23%
Wiley
9 publications, 3.23%
Hindawi Limited
Hindawi Limited, 8, 2.87%
Hindawi Limited
8 publications, 2.87%
Oxford University Press
Oxford University Press, 6, 2.15%
Oxford University Press
6 publications, 2.15%
Frontiers Media S.A.
Frontiers Media S.A., 5, 1.79%
Frontiers Media S.A.
5 publications, 1.79%
IOP Publishing
IOP Publishing, 5, 1.79%
IOP Publishing
5 publications, 1.79%
American Institute of Physics (AIP)
American Institute of Physics (AIP), 2, 0.72%
American Institute of Physics (AIP)
2 publications, 0.72%
IGI Global
IGI Global, 2, 0.72%
IGI Global
2 publications, 0.72%
IOS Press
IOS Press, 2, 0.72%
IOS Press
2 publications, 0.72%
Wolters Kluwer Health
Wolters Kluwer Health, 2, 0.72%
Wolters Kluwer Health
2 publications, 0.72%
World Scientific
World Scientific, 2, 0.72%
World Scientific
2 publications, 0.72%
Public Library of Science (PLoS)
Public Library of Science (PLoS), 2, 0.72%
Public Library of Science (PLoS)
2 publications, 0.72%
Taylor & Francis
Taylor & Francis, 2, 0.72%
Taylor & Francis
2 publications, 0.72%
Acoustical Society of America
Acoustical Society of America, 1, 0.36%
Acoustical Society of America
1 publication, 0.36%
SPIE
SPIE, 1, 0.36%
SPIE
1 publication, 0.36%
American Physical Society (APS)
American Physical Society (APS), 1, 0.36%
American Physical Society (APS)
1 publication, 0.36%
Thomas Telford
Thomas Telford, 1, 0.36%
Thomas Telford
1 publication, 0.36%
Emerald
Emerald, 1, 0.36%
Emerald
1 publication, 0.36%
Oceanside Publications, Inc., 1, 0.36%
Oceanside Publications, Inc.
1 publication, 0.36%
PagePress
PagePress, 1, 0.36%
PagePress
1 publication, 0.36%
American College of Allergy, Asthma, & Immunology
American College of Allergy, Asthma, & Immunology, 1, 0.36%
American College of Allergy, Asthma, & Immunology
1 publication, 0.36%
Optical Society of America
Optical Society of America, 1, 0.36%
Optical Society of America
1 publication, 0.36%
Royal Society of Chemistry (RSC)
Royal Society of Chemistry (RSC), 1, 0.36%
Royal Society of Chemistry (RSC)
1 publication, 0.36%
BMJ
BMJ, 1, 0.36%
BMJ
1 publication, 0.36%
Pleiades Publishing
Pleiades Publishing, 1, 0.36%
Pleiades Publishing
1 publication, 0.36%
ifmbe proceedings, 1, 0.36%
ifmbe proceedings
1 publication, 0.36%
5
10
15
20
25
30
35
40
45
50
  • We do not take into account publications that without a DOI.
  • Statistics recalculated only for publications connected to researchers, organizations and labs registered on the platform.
  • Statistics recalculated weekly.
Metrics
Share
Cite this
GOST |
Cite this
GOST Copy
Valueva M. et al. Application of the residue number system to reduce hardware costs of the convolutional neural network implementation // Mathematics and Computers in Simulation. 2020. Vol. 177. pp. 232-243.
GOST all authors (up to 50) Copy
Valueva M., Nagornov N. N., Lyakhov P., Valuev G., Chervyakov N. Application of the residue number system to reduce hardware costs of the convolutional neural network implementation // Mathematics and Computers in Simulation. 2020. Vol. 177. pp. 232-243.
RIS |
Cite this
RIS Copy
TY - JOUR
DO - 10.1016/j.matcom.2020.04.031
UR - https://doi.org/10.1016%2Fj.matcom.2020.04.031
TI - Application of the residue number system to reduce hardware costs of the convolutional neural network implementation
T2 - Mathematics and Computers in Simulation
AU - Valueva, Maria
AU - Nagornov, N N
AU - Lyakhov, Pavel
AU - Valuev, Georgii
AU - Chervyakov, Nikolay
PY - 2020
DA - 2020/11/01 00:00:00
PB - Elsevier
SP - 232-243
VL - 177
SN - 0378-4754
ER -
BibTex
Cite this
BibTex Copy
@article{2020_Valueva,
author = {Maria Valueva and N N Nagornov and Pavel Lyakhov and Georgii Valuev and Nikolay Chervyakov},
title = {Application of the residue number system to reduce hardware costs of the convolutional neural network implementation},
journal = {Mathematics and Computers in Simulation},
year = {2020},
volume = {177},
publisher = {Elsevier},
month = {nov},
url = {https://doi.org/10.1016%2Fj.matcom.2020.04.031},
pages = {232--243},
doi = {10.1016/j.matcom.2020.04.031}
}
Found error?