The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primates

TitleThe Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primates
Publication TypeJournal Article
Year of Publication2024
AuthorsKar, K, DiCarlo, JJ
JournalAnnual Review of Vision Science
Date PublishedJan-07-2024
Type of Articlereview
ISSN2374-4642
Keywordsartificial neural networks, inferior temporal cortex, neural mechanisms, object recognition, ventral stream, visual intelligence
Abstract

Inferences made about objects via vision, such as rapid and accurate categorization, are core to primate cognition despite the algorithmic challenge posed by varying viewpoints and scenes. Until recently, the brain mechanisms that support these capabilities were deeply mysterious. However, over the past decade, this scientific mystery has been illuminated by the discovery and development of brain-inspired, image-computable, artificial neural network (ANN) systems that rival primates in these behavioral feats. Apart from fundamentally changing the landscape of artificial intelligence, modified versions of these ANN systems are the current leading scientific hypotheses of an integrated set of mechanisms in the primate ventral visual stream that support core object recognition. What separates brain-mapped versions of these systems from prior conceptual models is that they are sensory computable, mechanistic, anatomically referenced, and testable (SMART). In this article, we review and provide perspective on the brain mechanisms addressed by the current leading SMART models. We review their empirical brain and behavioral alignment successes and failures, discuss the next frontiers for an even more accurate mechanistic understanding, and outline the likely applications.

URLhttps://www.annualreviews.org/content/journals/10.1146/annurev-vision-112823-030616
DOI10.1146/annurev-vision-112823-030616
Refereed DesignationRefereed

File: