Design and implication of a rule based weight sparsity module in HTM spatial pooler

Timur Ibrayev, Olga Krestinskaya, Alex Pappachen James

Research output: Chapter in Book/Report/Conference proceedingConference contribution

17 Citations (Scopus)

Abstract

Hierarchical Temporal Memory (HTM) is a neuromorphic algorithm that emulates the working principles of neocortex useful for solving image classification problems. Image pixels are transformed to binary HTM feature vectors following a set of weighted synaptic operations that combines the principles of sparsity, hierarchy, and modularity. The sparsity of input pixel selection and feature encoding is introduced by setting initial weights as random following a uniform distribution. In contrast to this approach, we propose that sparsity can be achieved by a deterministic approach of setting the input weights based on local mean intensity of pixels as a window operation. The initial binary weights are selected and are then multiplied by the original image pixels to either suppress inputs with low potential or preserve input pixels with high potential. Feature selection is then performed by selecting high potential pixels, which are preserved and are greater than the mean of neighbouring pixels, and suppressing the rest. The proposed design was verified on a face image recognition problem. Results show that proposed approach not only allow to preserve feature sparsity, but also to increase recognition accuracy for image classification with HTM.

Original languageEnglish
Title of host publicationICECS 2017 - 24th IEEE International Conference on Electronics, Circuits and Systems
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages274-277
Number of pages4
Volume2018-January
ISBN (Electronic)9781538619117
DOIs
Publication statusPublished - Feb 14 2018
Externally publishedYes
Event24th IEEE International Conference on Electronics, Circuits and Systems, ICECS 2017 - Batumi, Georgia
Duration: Dec 5 2017Dec 8 2017

Publication series

NameICECS 2017 - 24th IEEE International Conference on Electronics, Circuits and Systems
Volume2018-January

Conference

Conference24th IEEE International Conference on Electronics, Circuits and Systems, ICECS 2017
CountryGeorgia
CityBatumi
Period12/5/1712/8/17

Keywords

  • HTM
  • Permanence
  • Spatial pooler
  • Synapses

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Energy Engineering and Power Technology

Fingerprint Dive into the research topics of 'Design and implication of a rule based weight sparsity module in HTM spatial pooler'. Together they form a unique fingerprint.

Cite this