QL-Net: Quantized-by-LookUp CNN

Kamila Abdiyeva, Kim Hui Yap, Wang Gang, Narendra Ahuja, Martin Lukac

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Convolutional Neural Networks (CNNs) have achieved a state-of-the-art performance in the different computer vision tasks. However, CNN algorithms are computationally and power intensive, which makes them difficult to run on wearable and embedded systems. One way to address this constraint is to reduce the number of computational operations performed. Recently, several approaches addressed the problem of the computational complexity in the CNNs. Most of these methods, however, require a dedicated hardware. We propose a new method for the computation reduction in CNNs that substitutes Multiply and Accumulate (MAC) operations with a codebook lookup and can be executed on the generic hardware. The proposed method called QL-Net combines several concepts: (i) a codebook construction, (ii) a layer-wise retraining strategy, and (iii) a substitution of the MAC operations with the lookup of the convolution responses at inference time. The proposed QL-Net achieves a 98.6% accuracy on the MNIST dataset with a 5.8x reduction in runtime, when compared to MAC-based CNN model that achieved a 99.2% accuracy.

Original languageEnglish
Title of host publication2018 15th International Conference on Control, Automation, Robotics and Vision, ICARCV 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages413-418
Number of pages6
ISBN (Electronic)9781538695821
DOIs
Publication statusPublished - Dec 18 2018
Event15th International Conference on Control, Automation, Robotics and Vision, ICARCV 2018 - Singapore, Singapore
Duration: Nov 18 2018Nov 21 2018

Publication series

Name2018 15th International Conference on Control, Automation, Robotics and Vision, ICARCV 2018

Other

Other15th International Conference on Control, Automation, Robotics and Vision, ICARCV 2018
CountrySingapore
CitySingapore
Period11/18/1811/21/18

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Control and Optimization

Fingerprint Dive into the research topics of 'QL-Net: Quantized-by-LookUp CNN'. Together they form a unique fingerprint.

  • Cite this

    Abdiyeva, K., Yap, K. H., Gang, W., Ahuja, N., & Lukac, M. (2018). QL-Net: Quantized-by-LookUp CNN. In 2018 15th International Conference on Control, Automation, Robotics and Vision, ICARCV 2018 (pp. 413-418). [8581119] (2018 15th International Conference on Control, Automation, Robotics and Vision, ICARCV 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICARCV.2018.8581119