Hostname: page-component-7c8c6479df-p566r Total loading time: 0 Render date: 2024-03-28T11:25:57.033Z Has data issue: false hasContentIssue false

Deictic codes for the embodiment of cognition

Published online by Cambridge University Press:  01 December 1997

Dana H. Ballard
Affiliation:
Computer Science Department, University of Rochester, Rochester, NY 14627 dana@cs.rochester.edumary@cs.rochester.edupook@isr.comrao@salk.edu www.cs.rochester.edu/urcs.html
Mary M. Hayhoe
Affiliation:
Computer Science Department, University of Rochester, Rochester, NY 14627 dana@cs.rochester.edumary@cs.rochester.edupook@isr.comrao@salk.edu www.cs.rochester.edu/urcs.html
Polly K. Pook
Affiliation:
Computer Science Department, University of Rochester, Rochester, NY 14627 dana@cs.rochester.edumary@cs.rochester.edupook@isr.comrao@salk.edu www.cs.rochester.edu/urcs.html
Rajesh P. N. Rao
Affiliation:
Computer Science Department, University of Rochester, Rochester, NY 14627 dana@cs.rochester.edumary@cs.rochester.edupook@isr.comrao@salk.edu www.cs.rochester.edu/urcs.html

Abstract

To describe phenomena that occur at different time scales, computational models of the brain must incorporate different levels of abstraction. At time scales of approximately 1/3 of a second, orienting movements of the body play a crucial role in cognition and form a useful computational level – more abstract than that used to capture natural phenomena but less abstract than what is traditionally used to study high-level cognitive processes such as reasoning. At this “embodiment level,” the constraints of the physical system determine the nature of cognitive operations. The key synergy is that at time scales of about 1/3 of a second, the natural sequentiality of body movements can be matched to the natural computational economies of sequential decision systems through a system of implicit reference called deictic in which pointing movements are used to bind objects in the world to cognitive programs. This target article focuses on how deictic bindings make it possible to perform natural tasks. Deictic computation provides a mechanism for representing the essential features that link external sensory data with internal cognitive programs and motor actions. One of the central features of cognition, working memory, can be related to moment-by-moment dispositions of body features such as eye movements and hand movements.

Type
Research Article
Copyright
© 1997 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)