Mathematics and Computers in Simulation, volume 177, pages 232-243
Application of the residue number system to reduce hardware costs of the convolutional neural network implementation
Publication type: Journal Article
Publication date: 2020-11-01
Quartile SCImago
Q1
Quartile WOS
Q1
Impact factor: 4.6
ISSN: 03784754
Applied Mathematics
Theoretical Computer Science
General Computer Science
Numerical Analysis
Modeling and Simulation
Abstract
Convolutional neural networks are a promising tool for solving the problem of pattern recognition. Most well-known convolutional neural networks implementations require a significant amount of memory to store weights in the process of learning and working. We propose a convolutional neural network architecture in which the neural network is divided into hardware and software parts to increase performance and reduce the cost of implementation resources. We also propose to use the residue number system (RNS) in the hardware part to implement the convolutional layer of the neural network. Software simulations using Matlab 2018b showed that convolutional neural network with a minimum number of layers can be quickly and successfully trained. The hardware implementation of the convolution layer shows that the use of RNS allows to reduce the hardware costs on 7.86%–37.78% compared to the two’s complement implementation. The use of the proposed heterogeneous implementation reduces the average time of image recognition by 41.17%.
Citations by journals
Citations by publishers
- We do not take into account publications that without a DOI.
- Statistics recalculated only for publications connected to researchers, organizations and labs registered on the platform.
- Statistics recalculated weekly.
{"yearsCitations":{"type":"bar","data":{"show":true,"labels":[2020,2021,2022,2023,2024],"ids":[0,0,0,0,0],"codes":[0,0,0,0,0],"imageUrls":["","","","",""],"datasets":[{"label":"Citations number","data":[16,78,99,76,9],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":["5.73","27.96","35.48","27.24","3.23"],"barThickness":null}]},"options":{"indexAxis":"x","maintainAspectRatio":true,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"}},"x":{"ticks":{"stepSize":1,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"}}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Citations per year","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"journals":{"type":"bar","data":{"show":true,"labels":["Applied Sciences (Switzerland)","IEEE Access","Electronics (Switzerland)","Sensors","Lecture Notes in Computer Science","Remote Sensing","Neural Computing and Applications","Journal of Physics: Conference Series","Lecture Notes in Networks and Systems","Concurrency Computation Practice and Experience","Diagnostics","International Journal of Molecular Sciences","Briefings in Bioinformatics","Computational Intelligence and Neuroscience","International Journal of Environmental Research and Public Health","Water (Switzerland)","Journal of Marine Science and Engineering","Scientific Reports","Multimedia Tools and Applications","Computational and Structural Biotechnology Journal","Journal of Petroleum Science and Engineering","Resources, Conservation and Recycling","Materials Today: Proceedings","Energy Reports","Mathematical Problems in Engineering","Communications in Computer and Information Science","Water Resources Research","Physics of Fluids","Journal of the Acoustical Society of America"],"ids":[16650,25260,5130,18435,1022,22827,5072,3333,17269,770,18499,14627,23409,3579,1426,24405,839,13767,21526,4268,644,17195,24147,21458,11269,9768,21255,14994,2236],"codes":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"imageUrls":["\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/6scCJegesojp2jubwY3uKCzTAmgsaH2GIFlg6Hfk_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/LsKy6OnmmmRGcAU6CZgWQvNiP1polbaSLNrN7zqj_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/yNSijlgQghQF53VZuyFLA30CKDe4j3HK74Vtpnxa_medium.webp","\/storage\/images\/resized\/hqfzhQAjTGlNSRs6yzFNITgjSMm9Jr2QuotJHIvE_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/hqfzhQAjTGlNSRs6yzFNITgjSMm9Jr2QuotJHIvE_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/ARM4e6URKRsbRZvIF0vFis9DjxGloBjnBYJXbHmZ_medium.webp","\/storage\/images\/resized\/fUhUlF2pcXi7gZfIUvXwipy3ZBG9OrQe3mB4LWN3_medium.webp"],"datasets":[{"label":"","data":[8,8,5,5,5,4,4,4,4,3,3,3,3,3,2,2,2,2,2,2,2,2,2,2,2,2,1,1,1],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":[2.87,2.87,1.79,1.79,1.79,1.43,1.43,1.43,1.43,1.08,1.08,1.08,1.08,1.08,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.36,0.36,0.36],"barThickness":13}]},"options":{"indexAxis":"y","maintainAspectRatio":false,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"}},"x":{"ticks":{"stepSize":null,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"}}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Journals","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}},"publishers":{"type":"bar","data":{"show":true,"labels":["Multidisciplinary Digital Publishing Institute (MDPI)","Springer Nature","Elsevier","IEEE","Wiley","Hindawi Limited","Oxford University Press","Frontiers Media S.A.","IOP Publishing","American Institute of Physics (AIP)","IGI Global","IOS Press","Wolters Kluwer Health","World Scientific","Public Library of Science (PLoS)","Taylor & Francis","Acoustical Society of America","SPIE","American Physical Society (APS)","Thomas Telford","Emerald","Oceanside Publications, Inc.","PagePress","American College of Allergy, Asthma, & Immunology","Optical Society of America","Royal Society of Chemistry (RSC)","BMJ","Pleiades Publishing","ifmbe proceedings"],"ids":[202,8,17,6953,11,6921,19,208,2075,250,7845,29,32,23,344,18,871,7162,1539,6981,30,3730,7593,1269,375,123,6954,101,1125],"codes":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0],"imageUrls":["\/storage\/images\/resized\/MjH1ITP7lMYGxeqUZfkt2BnVLgjkk413jwBV97XX_medium.webp","\/storage\/images\/resized\/voXLqlsvTwv5p3iMQ8Dhs95nqB4AXOG7Taj7G4ra_medium.webp","\/storage\/images\/resized\/GDnYOu1UpMMfMMRV6Aqle4H0YLLsraeD9IP9qScG_medium.webp","\/storage\/images\/resized\/6scCJegesojp2jubwY3uKCzTAmgsaH2GIFlg6Hfk_medium.webp","\/storage\/images\/resized\/bRyGpdm98BkAUYiK1YFNpl5Z7hPu6Gd87gbIeuG3_medium.webp","\/storage\/images\/resized\/hqfzhQAjTGlNSRs6yzFNITgjSMm9Jr2QuotJHIvE_medium.webp","\/storage\/images\/resized\/yNSijlgQghQF53VZuyFLA30CKDe4j3HK74Vtpnxa_medium.webp","\/storage\/images\/resized\/4QWA67eqfcfyOiA8Wk7YnqroHFqQbTsmDJUYTCTg_medium.webp","\/storage\/images\/resized\/LsKy6OnmmmRGcAU6CZgWQvNiP1polbaSLNrN7zqj_medium.webp","\/storage\/images\/resized\/ARM4e6URKRsbRZvIF0vFis9DjxGloBjnBYJXbHmZ_medium.webp","\/storage\/images\/resized\/7FMNeB9SnnAZoNUlPrVuDf3sVkEkt74weJA9emBp_medium.webp","\/storage\/images\/resized\/KqWdDIHwzps3KNMz2kSZBC4SgMnkL3bwEKJqtZ2u_medium.webp","\/storage\/images\/resized\/6QE8LXWrLpkoy5A2te6hw7who46GeCoTYIstuoAz_medium.webp","\/storage\/images\/resized\/jZQkhOOcY9wrGwZm7XGRwMe8H7fThQu3KamISuun_medium.webp","\/storage\/images\/resized\/PRGhlgB4OKRltSNtT39eA6wlnOTGRap1QQ6FQHih_medium.webp","\/storage\/images\/resized\/5YZtvLvkPZuc2JHOaZsjCvGSHFCuC3drUwN3YAc5_medium.webp","\/storage\/images\/resized\/fUhUlF2pcXi7gZfIUvXwipy3ZBG9OrQe3mB4LWN3_medium.webp","\/storage\/images\/resized\/DBpVkewJngs3BK2gVqHayOcCZf2Czbxddw6ObU26_medium.webp","\/storage\/images\/resized\/nrK64iXHTzj43wMrfN1ZoUQ0vanswGzWPN45K3jA_medium.webp","\/storage\/images\/resized\/ljAuhpSMREOSIGmvHXfCUKFQbLqQkW0Ce2oBFgc8_medium.webp","\/storage\/images\/resized\/y1FWuXRlUNwpMiGVNlyhHQIrgjjPdJWmhKMZwpoB_medium.webp","","\/storage\/images\/resized\/Fg8hKh5G9a3oQTSv3rR8s19JEUrsZbW9P4nDNKZf_medium.webp","\/storage\/images\/resized\/lFP9M8jwCzWOjXixQv27KTSbstvc6l8wQedBRAdJ_medium.webp","\/storage\/images\/resized\/bypZPcr6C4twKiQVCUCGc0GF4cH6aUWmpClD3hsH_medium.webp","\/storage\/images\/resized\/leiAYcRDGTSl5B1eCnwpSGqmDEUEfDPPoYisFGhT_medium.webp","\/storage\/images\/resized\/hysFKdIDQMKHPbF1uLxJ3M6dQA4gPVuC6ZeA7m5a_medium.webp","\/storage\/images\/resized\/oZgeErrVFhuDksyqFURLvYS1wtVSBWczh001igGo_medium.webp",""],"datasets":[{"label":"","data":[46,42,40,13,9,8,6,5,5,2,2,2,2,2,2,2,1,1,1,1,1,1,1,1,1,1,1,1,1],"backgroundColor":["#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6","#3B82F6"],"percentage":[16.49,15.05,14.34,4.66,3.23,2.87,2.15,1.79,1.79,0.72,0.72,0.72,0.72,0.72,0.72,0.72,0.36,0.36,0.36,0.36,0.36,0.36,0.36,0.36,0.36,0.36,0.36,0.36,0.36],"barThickness":13}]},"options":{"indexAxis":"y","maintainAspectRatio":false,"scales":{"y":{"ticks":{"precision":0,"autoSkip":false,"font":{"family":"Montserrat"},"color":"#000000"}},"x":{"ticks":{"stepSize":null,"precision":0,"font":{"family":"Montserrat"},"color":"#000000"}}},"plugins":{"legend":{"position":"top","labels":{"font":{"family":"Montserrat"},"color":"#000000"}},"title":{"display":true,"text":"Publishers","font":{"size":24,"family":"Montserrat","weight":600},"color":"#000000"}}}}}
Metrics
Cite this
GOST |
RIS |
BibTex
Cite this
GOST
Copy
Valueva M. et al. Application of the residue number system to reduce hardware costs of the convolutional neural network implementation // Mathematics and Computers in Simulation. 2020. Vol. 177. pp. 232-243.
GOST all authors (up to 50)
Copy
Valueva M., Nagornov N. N., Lyakhov P., Valuev G., Chervyakov N. Application of the residue number system to reduce hardware costs of the convolutional neural network implementation // Mathematics and Computers in Simulation. 2020. Vol. 177. pp. 232-243.
Cite this
RIS
Copy
TY - JOUR
DO - 10.1016/j.matcom.2020.04.031
UR - https://doi.org/10.1016%2Fj.matcom.2020.04.031
TI - Application of the residue number system to reduce hardware costs of the convolutional neural network implementation
T2 - Mathematics and Computers in Simulation
AU - Valueva, Maria
AU - Nagornov, N N
AU - Lyakhov, Pavel
AU - Valuev, Georgii
AU - Chervyakov, Nikolay
PY - 2020
DA - 2020/11/01 00:00:00
PB - Elsevier
SP - 232-243
VL - 177
SN - 0378-4754
ER -
Cite this
BibTex
Copy
@article{2020_Valueva,
author = {Maria Valueva and N N Nagornov and Pavel Lyakhov and Georgii Valuev and Nikolay Chervyakov},
title = {Application of the residue number system to reduce hardware costs of the convolutional neural network implementation},
journal = {Mathematics and Computers in Simulation},
year = {2020},
volume = {177},
publisher = {Elsevier},
month = {nov},
url = {https://doi.org/10.1016%2Fj.matcom.2020.04.031},
pages = {232--243},
doi = {10.1016/j.matcom.2020.04.031}
}