Skip to content
/ htm Public

Hierarchical Temporal Memory (HTM) applied to next token prediction.

Notifications You must be signed in to change notification settings

r-gould/htm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

An implementation of the Hierarchical Temporal Memory (HTM) system: a self-supervised, non-probabilistic, non-gradient-based prediction algorithm inspired by the neocortex in the brain.

Description of the approach: https://r-gould.github.io/2023/08/03/understanding-htm.html

Work in progress:

  • Vectorize spatial pooling and temporal memory algorithm?
  • Extend to include output layer, voting across columns
  • Performance analysis (currently limited by compute)

About

Hierarchical Temporal Memory (HTM) applied to next token prediction.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages