|
To Afford or not to afford: A new formalization of affordances towards affordance-based robot control
This
web page summarizes the article which is published in journal of
Adaptive
Behavior. For details and discussions, please see the article
or an
early version of the work.
To
afford or not to afford: A
new formalization of affordances towards affordance-based robot
control Erol
Şahin, Maya
Çakmak, Mehmet
R. Doğar, Emre
Uğur and Göktürk
Üçoluk
|
Abstract:
The concept of affordances was introduced by J.J. Gibson to
explain how inherent 'values' and 'meanings' of things in the
environment can be directly perceived and how this information can
be linked to the action possibilities offered to the organism by
the environment. Although introduced in Psychology, the concept
influenced studies in other fields ranging from Human-Computer
Interaction to Autonomous Robotics. In this paper, we first
introduce the concept of affordances as conceived by J.J. Gibson
and review the use of the term in different fields, with
particular emphasis to its use in Autonomous Robotics. Then, we
summarize four of the major formalization proposals for the
affordance term. We point out that there are three, not one,
perspectives from which to view affordances and that much of the
confusion regarding discussions on the concept has arisen from
this. We propose a new formalism for affordances and discuss its
implications towards autonomous robot control. We report
preliminary results obtained with robots and link them with these
implications.
|
INTRODUCTION
AFFORDANCE
CONCEPT
PRIOR
FORMALIZATION OF AFFORDANCES
THREE
PERSPECTIVES OF AFFORDANCES
AN
EXTENDED AFFORDANCE FORMALIZATION
IMPLICATIONS
TOWARDS ROBOT CONTROL
TOWARDS
AFFORDANCE BASED ROBOT CONTROL
CONCLUSION
|
I.INTRODUCTION
The
affordance concept, from its beginnings, has been a misty one.
Despite the existence of a large body of literature on the concept,
upon reviewing the literature, one encounters different façades
of this term, sometimes contradictory, rather like the description of
an elephant by the six blind man in the famous Indian tale. We, as
roboticists, are interested in how the concept of
affordances can change our views about the control of an autonomous
robot and so we set forth to
develop an affordance-based robot control architecture. In our
quest, we reached an understanding of this elusive concept, such that
it can be formalized and used as a base for autonomous robot control.
The formalization presented in this paper summarizes our work on this
quest which was developed within the MACS project, but included
additional aspects of the affordance concept that went beyond the
core work.
II.
AFFORDANCE CONCEPT
|

|
(J.J.
Gibson, 1979/1986)
“The
affordances of the environment are what it offers the animal,
what it provides or furnishes, either for good or ill. The verb to
afford is found in the dictionary, but the noun affordance is not.
I have made it up. I mean by it something that refers to both the
environment and the animal in a way that no existing term does. It
implies the complementarity of the animal and the environment.”
“...
an
affordance is neither an objective property nor a subjective
property; or both if
you like. An affordance cuts across the dichotomy of
subjective-objective and helps us to understand its inadequacy. It
is equally a fact of the environment and a fact of behavior. It is
both physical and psychical, yet neither. An affordance points
bothways, to the environment and to the observer.”
“The
perceiving of an
affordance is not a process of perceiving a value-free physical
object to
which meaning is somehow added in a way that no one has been able
to agree upon; it is a process of perceiving a value-rich
ecological object.”
“The
theory of affordances rescues us from the philosophical muddle of
assumingfixed classes of objects, each defined by its common
features and then given a name...You
do
not have to classify and label things in order to perceive what
they afford.”
|
In
his early studies on visual perception, J.J. Gibson tried to
understand how the “meanings” of the environment were specified
in perception for certain behaviors. To this end, he identified
optical variables in the perceptual data that are meaningful. Based
on the studies of meaningful optical variables and the Gestaltist
conception of the immediate perception of meanings of the things,
J.J. Gibson built his own theory of perception and coined the term
affordance
to refer to the action possibilities that objects offer to an
organism in an environment. Although one may be
inclined to talk about affordances as if they were simply
properties of the environment,
they are not. J.J. Gibson believed that affordances are directly
perceivable (a.k.a. direct perception)
by the organism, thus the meaning of the objects in the environment
are directly apparent to the agent acting in it. This was different
from the contemporary view of the time that the meaning of objects
were created internally with further “mental calculation” of the
otherwise meaningless perceptual data.
To
date, there has been much confusion regarding the concept of
affordances. We believe that there are a number of reasons for this
confusion: 1- J.J. Gibson’s own understanding of affordances
evolved over time. 2- J.J. Gibson’s own ideas on the concept were
not finalized during his lifetime, as
Jones concludes in [Jones, 2003]. 3- J.J. Gibson’s idea of
affordance can be fully understood only in contrast to the background
of contemporary ideas on perception, rather than in isolation. 4-
J.J. Gibson defined affordances as a concept that relates the
perception of an organism to its action, whereas his main research
interest laid in the perception aspect.
5- J.J. Gibson’s own discussions on affordances were often blended
with his work on visual perception.
Affordance-Related
Research on Ecological Psychology
|

|
Following
the formulation of the theory of affordances, the Ecological
Psychology community started to conduct experiments in order to
verify that, people are able to perceive the
affordances of the environment, and to understand the
mechanisms underlying this perception. These experiments [Warren,
1984, Warren and Whang, 1987,Mark, 1987, Gibson et al., 1987,
Kinsella-Shaw et al., 1992, Chemero, 2000] aimed to show that
organisms (mostly human) can perceive whether a specific action is
do-able or not-do-able in an environment. This implies that, what
we perceive is not necessarily objects (e.g. stairs, doors,
chairs), but the action possibilities (e.g. climbable, passable,
sitable) offered by the environment. Although the number of these
experiments is quite high, their diversity is rather narrow. They
constitute a class of experiments characterized by two main
points: taking the ratio
of an environmental measure and a bodily measure of the
human subject; and, based on the value of this ratio, making
a binary judgment about whether a specific action is do-able or
not.
All
these experiments were performed in a one shot manner, and the
subject is either stationary or moving [Warren and Whang, 1987],
either monocular or binocular vision [Cornus et al., 1999] is
employed, either haptic or visual information [Gibson et al.,
1987] is used, either the critical or optimal points [Warren,
1984] are determined, and either searching for affordance or
change in the layout of an affordance [Chemero et al., 2003] is
examined. An overview of the experiments shows that they are
mostly focused on the perception aspect of affordances. Other
cognitive processes such as learning, high level reasoning and
inference mechanisms are not the subjects of these experiments,
and the link between affordances and these higher level processes
is not discussed.
|
Affordance-Related
Research on Cognitive Science E.J.
Gibson defined
learning as a perceptual process and named her theory of learning
“perceptual learning”. She argued that learning is neither the
construction of representations from smaller pieces, nor the
association of a response to a stimulus. Instead, she claimed,
learning is “discovering
distinctive features and invariant properties of things and events”
[Gibson, 2000] or “discovering
the information that specifies an affordance” [Gibson, 2003].
Studies
on affordance, reviewed so far, have not provided any ideas regarding
its relation to other higher-level cognitive processes. Neisser,
in his “Cognition and Reality” book [Neisser, 1976], tried to
place affordances and direct perception into a complete cognitive
system model and tried to link them with other cognitive processes
such as recognition. According to him, J.J. Gibson was right in
stating that the meanings of the environment are directly available,
and “information is not processed, but it is directly picked up
since it is already there (in the light)”. Invariance
attuned detectors are used for this purpose. However, he
claimed, the Gibsonian view of affordances of perception is
inadequate, since “it says so little about perceiver’s
contribution to the perception act”. Instead, he suggests a
perceptual system where a cycling activity continuous over time and
space occurs. Neisser also tried to integrate both constructive and
direct theories of perception. As a result, in [Neisser, 1994], he
constructed a three-layered perceptual system, whose first and third
layers correspond to direct perception and
recognition, respectively.
Affordance-Related
Research on Neurophysilogy and Neuropsychology
|
In
[Norman, 2002], J. Norman, in a similar vein to Neisser,
“attempted to reconcile
the constructivist and ecological approaches” in
one bigger system, using studies from neurophysiological and
neuropsychological studies. Based on evidence from human dorsal
and ventral systems, he suggested a perceptual system where two
different and interacting visual systems work. According to J.
Norman, it is straightforward to conclude that “the pickup of
affordances can be seen as the prime
activity of the dorsal system”.
Another
set of findings of neurophysiological and neuropsychological
research that is also associated with the idea of affordances came
from studies on mirror and canonical neurons which were discovered
in the pre-motor cortex of the monkey brain. During experiments
with monkeys [Rizzolatti et al., 1996] (later similar findings
were also found for human subjects [Fadiga et al., 1995]), mirror
neurons fired both
when the monkey was grasping an object, and when the monkey was
watching somebody else do the grasping. Rizzolatti and Gentilucci
[Rizzolatti and Gentilucci, 1988] discovered that canonical
neurons, normally
considered to be motor neurons for grasping actions, would fire
when the subject does not execute a grasping action, but only sees
a graspable object. Their discovery supports the view that says
action and perception are closely related. In [Humphreys, 2001],
Humphreys showed that, when presented with a tool, some patients,
who lacked the ability to name the tool, had no problem in
gesturing the appropriate movement for using it. According to
Humphreys, this suggested a direct
link from the visual input to the motor actions that
is independent from more abstract representations of the object,
e.g. its name.
|

|

|
Affordance-Related
Research on Autonomous Robotics
The concept of
affordances is highly related to autonomous robot control and it has
influenced studies in this field. We believe that, for a
proper discussion of the relationship of the affordance concept to
robot control, the
similarity of the arguments of J.J. Gibson’s theory and
reactive/behavior-based robotics
should first be noted. The concept of affordances and
behavior-based robotics emerged in very similar ways as opposing
suggestions to the then dominant paradigms in their fields. They are
both constructed based on the critisism of the
dominant models and methods which favored modeling and inference.
They both defend a direct relationship between agent and its
environment, and tight coupling between perception and action. They
are both on the side of “picking up only relevant information from
the environment”, and perceiving the environment economically.
Some
roboticists have already been explicitly using ideas on affordances
in designing behavior-based robots. For example, Murphy [Murphy,
1999] suggested that robotic design can benefit
from ideas in the theory of affordances such that complex
perceptual modeling can be eliminated without loss in capabilities.
She studied three case studies and drew attention to the importance
of the ecological niche in the design of behaviors. Likewise, Duchon
et al. [Duchon et al., 1998] benefited from J.J. Gibson’s ideas on
direct perception and optic flow in the design of behaviors and
coined the term Ecological Robotics for
the practice of applying ecological principles to the design of
mobile robots.
|

|

|

|
|
Fitzpatrick's
poking and learning experiments
|
Metta's
affordance experiments with BabyBot
|
Stoytchev's
tool affordances
|
The
use of affordances within Autonomous Robotics is mostly confined to
behavior-based control of the robots, and its use in deliberation
remains a rather unexplored area. In Cognitive Science, some
cognitive models related affordances only with low-level processes
[Norman, 2002], others viewed affordances as a part of a complete
cognitive model [Gibson, 2000, Neisser, 1994, MacDorman, 2000].
Similarly, in robotics, some hybrid architectures inherit properties
related to affordances only at their reactive
layer [Arkin and Balch, 1997, Connell, 1992]. Recently a
number of robotic studies focused on the
learning of affordances in robots. These studies mainly
tackled two major aspects. In one aspect, affordance learning is
referred to as the learning of the
consequences of a certain action in
a given situation [Fitzpatrick et al., 2003, Stoytchev, 2005b,
Stoytchev, 2005a]. In the other, studies focus on the learning
of the invariant properties of environments that afford a
certain behavior [MacDorman, 2000, Cos-Aguilera et al., 2003,
Cos-Aguilera et al., 2004]. Studies in this latter group also relate
these properties to the consequences of applying a behavior, but
these consequences are in terms of the internal values of the agent,
rather than changes in the physical environment.
|
We
would like to note that affordance theory has mostly been used as
a source of inspiration in robotics. Most of the studies reviewed
above preferred to refer to J.J. Gibson’s original ideas as
formulated in his books, ignoring modern discussions on the
concept. As a result, only certain aspects of the theory have
been used, and no attempts to consider the implications of the
whole theory towards autonomous robot control have been made.
|
III.
PRIOR FORMALIZATION OF AFFORDANCES
One of the
earliest attempts to formalize affordances came from Turvey [Turvey,
1992]. In his formalism, Turvey defined an affordance as a
disposition. Here, a disposition is a property of a thing that is a
potential, a possibility. These potentials become actualized if they
combine with their complements. In this formalism, although the
actualization of affordances requires an interaction of an agent on
the environment to produce a new dynamics,
Turvey explicitly attached affordances to the environment that the
organism is acting in. A criticism of Turvey’s formalism
came from Stoffregen [Stoffregen, 2003]. His view places affordances
in the organism-environment system as a whole instead of defining it
as a property of the environment: “Affordances
are properties of the animal-environment system, that is,
that they are emergent properties that do not inhere in either the
environment or the animal.” Chemero [Chemero, 2003] also criticized
Turvey’s view which placed affordances in the environment regarding
them as environmental properties. Partially in agreement with
Stoffregen’s proposal, Chemero suggested that: “Affordances
are relations between the abilities of organisms and features of the
environment.” One of the main differences between the
two similar formalisms of Stoffregen and Chemero, which both define
affordances at the organism-environment scale, is that while
Stoffregen’s definition of affordance does not include the behavior
exploiting the affordance, Chemero’s definition does include it.
Steedman’s
formalization [Steedman, 2002b] skips the
perceptual aspect of affordances (e.g. the invariants of the
environment that help the agent perceive the affordances, and the
nature of these invariants and the relation of them to the bodily
properties of the agent etc.), but instead it focuses on developing a
representation where object schemas are defined in relation to the
events and actions that they are involved in. For instance, Steedman
suggests that a door is linked with the actions of ‘pushing’ and
‘going-through’, and the pre-conditions and consequences of
applying these actions to the door. The different actions that are
associated with a particular kind of object constitute the
Affordance-set of that object schema,
and this set can be populated via learning. This makes the
formalization also suitable for planning,
for which Steedman argues that reactive/forward-chaining planning is
the best candidate. Steedman’s formalization is, as far as we know,
the first attempt to develop a formalization of affordances that
allows logical/computational manipulation and planning.
|
To
summarize, it can be said that Stoffregen’s and Chemero’s
formalizations, by defining affordances as a relation on
the scale of organism-environment system, differ from Turvey’s
formalization which defines affordances as environmental
properties. But there are also differences between Chemero’s
and Stoffregen’s definitions, one of them being the inclusion
of behaviors in the definition of affordances in Chemero’s
formalization. Steedman’s formalization differs from the other
three formalizations by providing an explicit link to action
possibilities offered by the environment, and by proposing the
use of the concept in planning.
|
IV.
THREE PERSPECTIVES OF AFFORDANCES
One
major axis of discussions on affordances is on where to place them.
In some discussions, affordances
are placed in the environment as extended properties that are
perceivable by the agent, whereas in others, affordances are said to
be a properties of the organism-environment system. We believe that
the source of the confusion is due to
the existence of three – not one! – perspectives to view
affordances. We argue
that in most discussions, authors, including J.J. Gibson himself,
often pose their arguments from different perspectives, neglecting to
explicitly mention the perspective that they are using. This has been
one of major sources that have made the arguments confusing, and
seemingly contradictory at times.
|

|
|
Agent
Perspective: The agent
interacts with environment and discovers the affordances in
its ecology. In this view, the affordance relationships reside
within the agent interacting in the environment through his
own behaviors. In Figure 1, the dog would “say”: “I
have push-ability affordance”,
upon seeing the ball.
|
|
Environmental
Perspective: Affordances
are attachee over the environment as extended properties that
can be perceivable by the agents. In our scene, the ball would
“say”: “I offer hide-ability affordance”
to an approaching dog. When
“interrogated to list all of its affordances, the same ball
may say: “I offer, push-ability (to a dog), throw-ability
(to a human), ..., affordances”.
|
|
Observer
Perspective: The
interaction of an agent with the environment is observed by a
third party. In our scene, we assume that the human is
observing the interaction of the dog with the ball. In this
case, the human would say: “There is push-ability
affordance” in the
dog-ball system.
|
|
|
In
most of the discussions of affordances, including some of J.J.
Gibson's own, environment or observer view is often implicitly
used, causing much of the existing confusion. This view is the
most essential one to be explored for using affordances in
autonomous robot control, and will be the central focus of our
formalization to be developed in the next section.
|
V.
AN EXTENDED AFFORDANCE FORMALIZATION
In
this section, we develop a formalism to describe our understanding of
affordances. Different from the prior formalizations
studies that we have reviewed, our motivation in attempting this task
stems from our interest in incorporating the affordance concept into
autonomous robot control.
First,
we use the term, entity, to denote the environmental relata of
the affordance instead of features (as used by Chemero) or object (as
generally used). Second, the agent’s relata should represent the
part of the agent that is generating the interaction with the
environment that produced the affordance, we chose the term behavior
to denote this. Third, the interaction between the agent and the
environment should produce a certain effect. More
specifically, a certain behavior applied on a certain entity should
produce a certain effect, e.g. a certain perceivable change in the
environment, or in the state of the agent. Based on the previous
discussions:
|
Definition:
An affordance is an acquired
relation between a certain effect and a (entity, behavior)
tuple, such that when the agent applies the behavior on the
entity, the effect is generated. It is formalized as:
(effect,
(entity, behavior))
|
The
proposed formalization, with its explicit
inclusion of effect, can be seen as a deviation from J.J.
Gibson’s view at its outset. It is not. In J.J. Gibson’s
writings, the issue of effect had always remained implicit. For
instance in the definition of the lift-ability affordance, the
expected effect of lifted is implicitly present. One question that
may be posed is whether this formalism has equated affordance with
effect. This is not the case. The formalism uses effect as the index
to (entity, behavior) tuples. In this sense, given a desired effect
to be achieved, the agent can directly access which (entity,
behavior) can be used to that purpose.
An
important aspect of affordances, which is also explicitly stated in
our definition, is that they are acquired
through the interaction of the agent with the entity.
Therefore it is essential to consider the acquisition aspect in order
to understand the nature of the three components of our formalism.
Note that, whether this acquisition is done through learning,
evolution or trial-and-error based design is irrelevant for our
discussion.
Affordance
Equivance Classes
A
relation instance
contains
knowledge obtained from a
single experiment and does not have any predictive ability over
future experiments, hence not a relation. As the robot explores its
environment, it will populate its knowledge database using such
relation instances. Such a database can hardly be called
affordances. Affordances should be relations with predictive
abilities, rather than a set of unconnected relation instances.
|

|

|

|

|
|
The
application of lift behavior on a can generated the effect of
being lifted, and this relation is called as lift-ability.
Lift-ability is shown as a “cloud” to indicate that it is just
a label for the relation used to make the discussions more
clear.
|
Entity
equivalence: Many different entities (red-can and a blue can)
can be used to generate the same effect (being lifted) upon the
application of a certain behavior (lift).
Invariants
(such as “cans of any color”), create a general relationship,
enable the robot to predict the effect of the lift-with-right-hand
behavior applied on a novel object, like a green-can. Such a
capability offers great flexibility to a robot. When in need, the
robot can search and find objects that would provide support for a
desired affordance.
|
Behavioral
equivalence: More than one behavior (lift-with-right-arm and
lift-with-left-arm) can be applied to a certain entity (blue can)
to generate a certain effect (lifted).
The
use of behavioral equivalence will bring in a similar flexibility
for the agent. a humanoid robot which lifted a can with one of its
arms, loses its ability to lift another can. However, through
behavioral equivalence it can immediately have a “change of
plan” and accomplish lifting using its other hand.
|
Affordance
equivalence: Different (entity, behavior) tuples
((river, swim) and (ground, walk)) can generate the same effect
(traversed).
This
formalization suggests that the entity (the sensory information)
is to be concatenated with behavior (the motor information) and
that the invariances are detected on this combined representation.
|
|
We
argue that the discovery of invariants in entity equivalence
classes can also produce abstractions over existing entities.
For instance, the invariant <*-can> denotes a can without
color, in an environment where all cans have color. In this
sense, if one restricts entity to only the perceptual
representation of the external world, the component <entity>
can be referred to as an affordance cue [Fritz et al., 2006],
which hints at the existence of a potential affordance. We would
also like to note that when the term entity includes also the
perceptual state of the agent itself, the term <entity> can
be considered to be equivalent to the term pre-condition in
deliberative planning. Finally, note that the question of how
these invariants can be discovered and represented is a challenge
that needs to be tackled.
|
VI.
DISCUSSIONS ON THE FORMALISM AND ITS IMPLICATIONS TOWARDS ROBOT
CONTROL
We
believe that the proposed formalism has laid out a good framework
over which the concept of affordance can be utilized
for autonomous robot control. Below, we will discuss the major
aspects of affordances as proposed within the formalism, and the
corresponding implications towards robot control:
Affordances
can be viewed from three perspectives, not one; namely, agent,
observer and environment. In our formalism, we defined affordance
from these perspectives with the hope that these different but
related definitions will be of help in clarifying the discussions
around the concept. We consider only the agent and observer
perspectives to be relevant and provide the environment perspective
only as a means to tie the proposed formalism to some philosophical
discussions on the concept.
Affordances
(agent and observer perspective) are relations that reside inside
the agent. At a first glance, this claim can be seen to go
against the common view of affordances in Ecological Psychology
which places affordances in the agent-environment system, rather
than in the agent or in the environment alone. However, we argue
that representing these relationships explicitly inside the agent
does not contradict the existence of these relations within the
agent-environment system. As discussed in the previous bullet, we
are interested in how the relations within the agentenvironment
system are viewed from the robot’s perspective. We argue that
these agent-environment relations can be internalized by the robot
as explicit (though not necessarily symbolic) relations and can
enable robots to perceive, learn, and act within their environment
using affordances.
Affordances
are acquired relations. The acquisition aspect is an essential
property of the formalization, yet the method of acquisition is
irrelevant. Here, acquisition is used as an umbrella term to denote
different processes that lead to the development of affordances in
agents including, but not limited to, evolution, learning and
trial-and-error based design.
The
formalism implies that in order to have robots acquire affordances
within their environment, first, relation instances that pertain to
the interaction of the robot with its environment need to be
populated, and then these relation instances should be merged
into relations through the formation of equivalence classes. The
issues of how relation instances can be generated, and how relation
instances can be merged into affordance relations are open problems
that beg to be studied.
Affordances
encode “general relations” pertaining to the agent,
environment interaction, such as: balls are rollable. Naturally,
exceptions to these general relations, such as
“the-red-ball-on-my-table is not rollable (since it is glued to
the table)” do exist. However, unlike affordance relations, these
“specific relations” possess little, if any, predictive help
over other cases, such as whether the-blue-ball-on-my-table is
rollable or not. The implication for autonomous robot control is the
existence of two control systems; an affordance-based one that
acquires and uses general relations, and a complementary add-on
system that complements the affordance-based system by learning its
exceptions.
Affordances
provide a framework for symbol formation. In the proposed
formalism, the categorization of raw sensory-motor perceptions into
equivalence classes can be considered as a symbol formation process.
As also argued in [Sun, 2000], these symbols would be “formed in
relation to the experience of agents, through their perceptual/motor
apparatuses, in their world and linked to their goals and actions”.
Affordances
provide support for planning. We argue that the proposed
formalism creates relations that can also be used as operators for
planning. An affordance relation is indexed by its effect and
include tuples which store how that particular effect can be
achieved. For instance, the <entity> and <behavior>
components in the proposed formalism, can be considered to
correspond to the pre-condition and action components in the STRIPS
representation. A major difference between the STRIPS representation
and the affordance representation is the way the operators are
indexed.
VII.
TOWARDS AFFORDANCE-BASED ROBOT CONTROL
We
have conducted a number of experiments with robots to implement and
evaluate certain aspects of the proposed formalism.
Specifically, we studied on generation of entity, effect and
affordance equivalcen classes. Affordance relations are learned from
relation-instances as proposed in this document.
VIII.
CONCLUSION
The
concept of affordances has been both inspirational and misty (which
may have contributed positively to its influence
over a wide-range of fields). In this paper, we have reviewed the
discussions around the concept and explored how the concept can be
formalized to be utilized in autonomous robot control. Towards this
end, we have taken the view that our thinking should be led towards
the point J.J. Gibson indicated, rather than backwards to the end
where he left. As a consequence, the proposed formalism extended the
Gibsonian notion of affordances in two major aspects. First, although
the proposed formalism agrees with the Gibsonian view that
affordances are relations within the agentenvironment system, it
differs by arguing that these relationships can also be projected
onto the agent. Hence, unlike the prior formalizations, the proposed
formalism stops short of providing any “perspective-free”
definitions for affordances, since it is not considered to be
relevant for using the concept in robot control. The philosophical
issue of whether an affordance can be defined without reference to
any perspectives is possible or not, and how much would such a
definition would contribute to the development of a “theory of
information pickup” in agents, which constituted J.J. Gibson’s
main motivation, will remain as topics towards further discussion.
Second,
different from the Gibsonian view, the proposed formalism argues that
affordances (for instance, as viewed from the agent perspective) can
be internalized and explicitly represented within the agent. The
Gibsonian view may reject this extension by arguing that J.J. Gibson
had developed the concepts of affordance and direct perception to
object the existence of “representations” in the organism. We do
not agree with such an argument. In our understanding, J.J. Gibson
objected to the view that perception has to create a generic world
model, which has been often referred as “representation”, over
which the organism infers whether an affordance exists or not. He
argued that affordances are directly perceivable, that is, without
using a world representation and without making inferences. The
proposed formalism represents relations, not world models, within the
robot and therefore, we claim that it does not conflict with the J.J.
Gibson’s line of thinking.
Extending
an already controversial term such as affordance is bound to be
subject to criticism. One of the previous commentators of our project
warned us of the dangers of being drawn into an already existing hot
debate over the term, and suggested that whether a related-sounding
but different term, such as “affoodance”, might relieve us from
such debates12. This difficult dilemma is expressed in our title
which begins with “to afford or not to afford”. We believe that
conceiving new terms without properly relating themto already
existing terms does more harm than good. Instead, in this paper, we
tried to propose properly our formalization and definition of our
understanding of the concept and leave the final judgement to the
readers.
Finally,
we would like to note that the implications of the proposed formalism
on the development and implementation of an affordance-based robot
control architecture is our current and on-going work in the MACS
project. Although we believe that there are many challenges ahead
towards this goal, the ideas proposed in this paper will be of help
to guide us on this quest.
REFERENCES
[Amant,
1999] Amant, R. (1999). User interface affordances in a planning
representation. Human Computer Interaction ,
14(3):317–354.
[Arkin,
1998] Arkin, R. (1998). Behavior-based Robotics . MIT Press,
Cambridge, MA, USA. ISBN:0262011654.
[Arkin
and Balch, 1997] Arkin, R. C. and Balch, T. (1997). AuRA: Principles
and practice in review. Journal of Experimental and Theoretical
Artificial Intelligence , 9(2):175–189.
[Brooks,
1991] Brooks, R. (1991). Intelligence without representation.
Artificial Intelligence , 47:139–159.
[Chemero,
2000] Chemero, A. (2000). What events are. Ecological Psychology ,
12(1):37–42. [Chemero, 2003] Chemero, A. (2003). An outline of a
theory of affordances. Ecological Psychology ,15(2):181–195.
[Chemero
et al., 2003] Chemero, A., Klein, C., and Cordeiro, W. (2003).
Events as changes in the layout of affordances. Ecological
Psychology , 15(1):19–28.
[Connell,
1992] Connell, J. (1992). Sss: A hybrid architecture applied to
robot navigation. In Proceedings of theIEEE International Conference
on Robotics and Automation , pages 2719–2724, Los Alamitos,
California.
[Cooper
and Glasspool, 2001] Cooper, R. and Glasspool, D. W. (2001).
Learning action affordances and action schemas. In French, R. M. and
Sougne, J. P., editors, Connectionist Models of Learning,
Development and Evolution , Perspectives in Neural Computing, pages
133–142, London. Sixth Neural Computation and Psychology Workshop,
Springer-Verlag.
[Cornus
et al., 1999] Cornus, S., Montagne, G., and Laurent, M. (1999).
Perception of a steppingacross affordance. Ecological Psychology ,
11(4):249–267.
[Cos-Aguilera
et al., 2003] Cos-Aguilera, I., Canamero, L., and Hayes, G. (2003).
Motivationdriven learning of object affordances: First experiments
using a simulated Khepera robot. In In Proceedings of the 9th
International Conference in Cognitive Modelling (ICCM’03) ,
Bamberg,Germany.
[Cos-Aguilera
et al., 2004] Cos-Aguilera, I., Canamero, L., and Hayes, G. (2004).
Using a SOFMto learn object affordances. In In Proceedings of the
5th Workshop of Physical Agents , Girona,Catalonia, Spain.
[Dorffner
et al., 2005] Dorffner, G., Irran, J., Kintzler, F., and Poelz, P.
(2005). Robotic learning architecture that can be taught by manually
putting the robot to action sequences. Technical report, The
Austrian Research Institute for Artificial Intelligence (OFAI). MACS
Project Deliverable 5.3.1.
[Duchon
et al., 1998] Duchon, A., Warren, W., and Kaelbling, L. (1998).
Ecological robotics. Adaptive Behavior , 6(3):473–507.
[Fadiga
et al., 1995] Fadiga, L., Fogassi, L., Pavesi, G., and Rizzolatti,
G. (1995). Motor facilitation during action observation: a magnetic
stimulation study. Journal of Neurophysiology ,
73:2608–2611.
[Fikes
and Nilsson, 1971] Fikes, R. and Nilsson, N. (1971). Strips: A new
approach to the application of theorem proving to problem solving.
Artificial Intelligence , 2(3/4):189–208.
[Firby,
1989] Firby, J. (1989). Adaptive Execution in Complex Dynamic Worlds
. Ph.d. thesis, yaleu/csd/rr #672, Yale University.
[Fitzpatrick
et al., 2003] Fitzpatrick, P., Metta, G., Natale, L., Rao, A., and
Sandini, G. (2003). Learning about objects through action -initial
steps towards artificial cognition. In Proceedings of the 2003 IEEE
International Conference on Robotics and Automation, ICRA , pages
3140–3145.
[Fritz
et al., 2006] Fritz, G., Paletta, L., Kumar, M., Dorffner, G.,
Breithaupt, R., and Rome, E. (2006). Visual learning of affordance
based cues. In Nolfi, S., Baldassarre, G., Calabretta,
R.,
Hallam, J., Marocco, D., Meyer, J.-A., and Parisi, D., editors, From
animals to animats 9: Proceedings of the Ninth International
Conference on Simulation of Adaptive Behaviour (SAB), LNAI. Volume
4095., pages 52–64, Roma, Italy. Springer-Verlag, Berlin.
[Gallese,
2000] Gallese, V. (2000). Agency and motor representations: new
perspectives on intersubjectivity. SC working papers 2000-6.
Workshop on autism and the Theory of Mind. Lyon.
[Gallese
et al., 1996] Gallese, V., Fadiga, L., Fogassi, L., and Rizzolatti,
G. (1996). Action recognition in the premotor cortex. Brain ,
119:593–609.
[Ghallab
et al., 2004] Ghallab, M., Nau, D., and Traverso, P. (2004).
Automated Planning Theory and Practise . Elsevier.
[Gibson,
2000] Gibson, E. (2000). Perceptual learning in development: Some
basic concepts. Ecological Psychology , 12(4):295–302.
[Gibson,
2003] Gibson, E. (2003). The world is so full of a number of things:
On specification and perceptual learning. Ecological Psychology ,
15(4):283–288.
[Gibson
et al., 1987] Gibson, E., Riccio, G., Schmuckler, M., Stoffregen,
T., Rosenberg, D., and Taromina, J. (1987). Detection of the
traversability of surfaces by crawling and walking infants. Journal
of Experimental Psychology , 13(4):533–544.
[Gibson,
1966] Gibson, J. (1966). The senses considered as perceptual systems
. Houghton Mifflin, Boston.
[Gibson,
1986] Gibson, J. (1986). The Ecological Approach to Visual
Perception . Lawrence Erlbaum Associates. Originally published in
1979.
[Greeno,
1994] Greeno, J. (1994). Gibson’s affordances. Psychological
Review , 101(2):336–342.
[Harnad,
1990] Harnad, S. (1990). The symbol grounding problem. Physica D .
[Humphreys,
2001] Humphreys, G. (2001). Objects, affordances ... action !!! The
Psychologist , 14(8):5.
[Irran
et al., 2006] Irran, J., Kintzler, F., and P¨olz, P.
(2006). Grounding affordances. In Trappl, R., editor, Cybernetics
and Systems . Austrian Society for Cybernetic Studies. ISBN: 3 85206
172 5.
[Jones,
2003] Jones, K. (2003). What is an affordance? Ecological Psychology
, 15(2):107–114.
[Kinsella-Shaw
et al., 1992] Kinsella-Shaw, J., Shaw, B., and Turvey, M. (1992).
Perceiving walkonable slopes. Ecological Psychology , 4(4):223–239.
[MacDorman,
2000] MacDorman, K. (2000). Responding to affordances: Learning and
projecting a sensorimotor mapping. In Proc. of 2000 IEEE Int. Conf.
on Robotics and Automation , pages 3253–3259, San Fransisco,
California, USA.
[Mark,
1987] Mark, L. (1987). Eyeheight-scaled information about
affordances: A study of sitting and stair climbing. Journal of
Experimental Psychology: Human Perception and Performance,
13(3):361–370.
[McGrenere
and Ho, 2000] McGrenere, J. and Ho,W. (2000). Affordances:
Clarifying and evolving a concept. In In Proceedings of the Graphics
Interface , pages 179–186, Toronto. Canadian Human-Computer
Communications Society.
[Murphy,
1999] Murphy, R. (1999). Case studies of applying gibson’s
ecological approach to mobile robots. IEEE Transactions on Systems,
Man, and Cybernetics , 29(1):105–111.
[Neisser,
1976] Neisser, U. (1976). Cognition and Reality: Principles and
Implications of Cognitive Psychology . 0716704773. W.H. Freeman and
Co.
[Neisser,
1994] Neisser, U. (1994). Multiple systems: A new approach to
cognitive theory. The European Journal of Cognitive Psychology ,
6:225–241.
[Norman,
1988] Norman, D. (1988). The Psychology of Everyday Things . Basic
Books.
[Norman,
1999] Norman, D. (1999). Affordance, conventions, and design.
Interactions , 6(3):38–42.
[Norman,
2001] Norman, J. (2001). Ecological psychology and the two visual
systems: Not to worry! Ecological Psychology , 13(2):135–145.
[Norman,
2002] Norman, J. (2002). Two visual systems and two theories.
Behavioral and Brain Sciences , 25:73–144.
[Oudejans
et al., 1996] Oudejans, R., Michaels, C., vanDort, B., and Frissen,
E. (1996). To cross or not to cross: The effect of locomotion on
street-crossing behavior. Ecological Psychology, 8(3):259–267.
[Rizzolatti
et al., 1996] Rizzolatti, G., Fadiga, L., Gallese, V., and Fogassi,
L. (1996). Premotor cortex and the recognition of motor actions.
Cognitive Brain Research , 3:131–141.
[Rizzolatti
and Gentilucci, 1988] Rizzolatti, G. and Gentilucci, M. (1988).
Motor and visual-motor functions of the premotor cortex , pages
269–284. Chichester: Wiley.
[Sanders,
1997] Sanders, J. (1997). An ontology of affordances. Ecological
Psychology , 9(1):97–112.
[Steedman,
2002a] Steedman, M. (2002a). Formalizing affordance. In Proceedings
of the 24th Annual Meeting of , Washington D.C. Lawrence
Erlbaum.
[Steedman,
2002b] Steedman, M. (2002b). Plans, affordances, and combinatory
grammar. Linguistics and Philosophy , 25.
[Stoffregen,
2003] Stoffregen, T. (2003). Affordances as properties of the animal
environment system. Ecological Psychology , 15(2):115–134.
[Stoytchev,
2005a] Stoytchev, A. (2005a). Behavior-grounded representation of
tool affordances. In In Proceedings of IEEE International Conference
on Robotics and Automation (ICRA) , pages 18–22, Barcelona, Spain.
[Stoytchev,
2005b] Stoytchev, A. (2005b). Toward learning the binding
affordances of objects: A behavior-grounded approach. In In
Proceedings of AAAI Symposium on Developmental Robotics, pages
21–23.
[Sun,
2000] Sun, R. (2000). Symbol grounding: A new look at an old idea.
Philosophical Psychology , 13(149–172).
[Szokolszky,
2003] Szokolszky, A. (2003). An interview with Eleanor Gibson.
Ecological Psychology , 15(4):271–281.
[Turvey,
1992] Turvey, M. (1992). Affordances and prospective control: an
outline of the ontology. Ecological Psychology , 4(3):173–187.
[U˘gur
et al., 2006] U˘gur, E., Do˘gar, M., C¸ akmak, M.,
and S¸ahin, E. (2006). The learning and use of
traversability affordance using range images on a mobile robot.
Technical Report METUCENG-TR-2006-03, Dept. of Computer Eng., Middle
East Technical University, Ankara, Turkey.
[U˘gur
et al., 2007] U˘gur, E., Do˘gar, M., C¸ akmak, M.,
and S¸ahin, E. (2007). The learning and use of
traversability affordance using range images on a mobile robot. In
to appear in Proceedings of IEEE Intl. Conf. on Robotics and
Automation (ICRA 07) .
[Warren,
1984] Warren, W. (1984). Perceiving affordances: Visual guidance of
stair climbing. Journal of Experimental Psychology , 105(5):683–703.
[Warren
and Whang, 1987] Warren, W. and Whang, S. (1987). Visual guidance of
walking through apertures: body-scaled information for affordances.
Journal of Experimental Psychology , 13(3):371–383.
[Wehner,
1987] Wehner, R. (1987). “Matched filters” - neural models of
the external world. Journal of Comparative Physiology A:
Neuroethology, Sensory, Neural, and Behavioral Physiology
,161(4):511 – 531.
Emre Ugur, 2007
|