Middle East Technical University
Department of Computer Engineering
Main Menu
Home
Members
Robots
Projects
Publications
Software
WebBibTex
Resources
Seminars
- - - - - - - - - - - - - - - - - - - -
Contact Us
Travel Info
Links
Login Form





Lost Password?
To afford or not to afford: A new formalization of affordance towards affordance-based robot control
To Afford or not to afford: A new formalization of affordances towards affordance-based robot control

This web page summarizes the article which is published in journal of Adaptive Behavior. For details and discussions, please see the article or an early version of the work.


To afford or not to afford:
A new formalization of affordances towards affordance-based robot control
Erol Şahin, Maya Çakmak, Mehmet R. Doğar, Emre Uğur and Göktürk Üçoluk

Abstract: The concept of affordances was introduced by J.J. Gibson to explain how inherent 'values' and 'meanings' of things in the environment can be directly perceived and how this information can be linked to the action possibilities offered to the organism by the environment. Although introduced in Psychology, the concept influenced studies in other fields ranging from Human-Computer Interaction to Autonomous Robotics. In this paper, we first introduce the concept of affordances as conceived by J.J. Gibson and review the use of the term in different fields, with particular emphasis to its use in Autonomous Robotics. Then, we summarize four of the major formalization proposals for the affordance term. We point out that there are three, not one, perspectives from which to view affordances and that much of the confusion regarding discussions on the concept has arisen from this. We propose a new formalism for affordances and discuss its implications towards autonomous robot control. We report preliminary results obtained with robots and link them with these implications.

INTRODUCTION

AFFORDANCE CONCEPT

PRIOR FORMALIZATION OF AFFORDANCES

THREE PERSPECTIVES OF AFFORDANCES

AN EXTENDED AFFORDANCE FORMALIZATION

IMPLICATIONS TOWARDS ROBOT CONTROL

TOWARDS AFFORDANCE BASED ROBOT CONTROL

CONCLUSION

I.INTRODUCTION

The affordance concept, from its beginnings, has been a misty one. Despite the existence of a large body of literature on the concept, upon reviewing the literature, one encounters different façades of this term, sometimes contradictory, rather like the description of an elephant by the six blind man in the famous Indian tale. We, as roboticists, are interested in how the concept of affordances can change our views about the control of an autonomous robot and so we set forth to develop an affordance-based robot control architecture. In our quest, we reached an understanding of this elusive concept, such that it can be formalized and used as a base for autonomous robot control. The formalization presented in this paper summarizes our work on this quest which was developed within the MACS project, but included additional aspects of the affordance concept that went beyond the core work.

II. AFFORDANCE CONCEPT


(J.J. Gibson, 1979/1986)

The affordances of the environment are what it offers the animal, what it provides or furnishes, either for good or ill. The verb to afford is found in the dictionary, but the noun affordance is not. I have made it up. I mean by it something that refers to both the environment and the animal in a way that no existing term does. It implies the complementarity of the animal and the environment.”

... an affordance is neither an objective property nor a subjective property; or both if you like. An affordance cuts across the dichotomy of subjective-objective and helps us to understand its inadequacy. It is equally a fact of the environment and a fact of behavior. It is both physical and psychical, yet neither. An affordance points bothways, to the environment and to the observer.”

The perceiving of an affordance is not a process of perceiving a value-free physical object to which meaning is somehow added in a way that no one has been able to agree upon; it is a process of perceiving a value-rich ecological object.”

The theory of affordances rescues us from the philosophical muddle of assumingfixed classes of objects, each defined by its common features and then given a name...You do not have to classify and label things in order to perceive what they afford.”

In his early studies on visual perception, J.J. Gibson tried to understand how the “meanings” of the environment were specified in perception for certain behaviors. To this end, he identified optical variables in the perceptual data that are meaningful. Based on the studies of meaningful optical variables and the Gestaltist conception of the immediate perception of meanings of the things, J.J. Gibson built his own theory of perception and coined the term affordance to refer to the action possibilities that objects offer to an organism in an environment. Although one may be inclined to talk about affordances as if they were simply properties of the environment, they are not. J.J. Gibson believed that affordances are directly perceivable (a.k.a. direct perception) by the organism, thus the meaning of the objects in the environment are directly apparent to the agent acting in it. This was different from the contemporary view of the time that the meaning of objects were created internally with further “mental calculation” of the otherwise meaningless perceptual data.

To date, there has been much confusion regarding the concept of affordances. We believe that there are a number of reasons for this confusion: 1- J.J. Gibson’s own understanding of affordances evolved over time. 2- J.J. Gibson’s own ideas on the concept were not finalized during his lifetime, as Jones concludes in [Jones, 2003]. 3- J.J. Gibson’s idea of affordance can be fully understood only in contrast to the background of contemporary ideas on perception, rather than in isolation. 4- J.J. Gibson defined affordances as a concept that relates the perception of an organism to its action, whereas his main research interest laid in the perception aspect. 5- J.J. Gibson’s own discussions on affordances were often blended with his work on visual perception.

Affordance-Related Research on Ecological Psychology


Following the formulation of the theory of affordances, the Ecological Psychology community started to conduct experiments in order to verify that, people are able to perceive the affordances of the environment, and to understand the mechanisms underlying this perception. These experiments [Warren, 1984, Warren and Whang, 1987,Mark, 1987, Gibson et al., 1987, Kinsella-Shaw et al., 1992, Chemero, 2000] aimed to show that organisms (mostly human) can perceive whether a specific action is do-able or not-do-able in an environment. This implies that, what we perceive is not necessarily objects (e.g. stairs, doors, chairs), but the action possibilities (e.g. climbable, passable, sitable) offered by the environment. Although the number of these experiments is quite high, their diversity is rather narrow. They constitute a class of experiments characterized by two main points: taking the ratio of an environmental measure and a bodily measure of the human subject; and, based on the value of this ratio, making a binary judgment about whether a specific action is do-able or not.

All these experiments were performed in a one shot manner, and the subject is either stationary or moving [Warren and Whang, 1987], either monocular or binocular vision [Cornus et al., 1999] is employed, either haptic or visual information [Gibson et al., 1987] is used, either the critical or optimal points [Warren, 1984] are determined, and either searching for affordance or change in the layout of an affordance [Chemero et al., 2003] is examined. An overview of the experiments shows that they are mostly focused on the perception aspect of affordances. Other cognitive processes such as learning, high level reasoning and inference mechanisms are not the subjects of these experiments, and the link between affordances and these higher level processes is not discussed.

Affordance-Related Research on Cognitive Science
E.J. Gibson defined learning as a perceptual process and named her theory of learning “perceptual learning”. She argued that learning is neither the construction of representations from smaller pieces, nor the association of a response to a stimulus. Instead, she claimed, learning is “discovering distinctive features and invariant properties of things and events[Gibson, 2000] or “discovering the information that specifies an affordance” [Gibson, 2003].

Studies on affordance, reviewed so far, have not provided any ideas regarding its relation to other higher-level cognitive processes. Neisser, in his “Cognition and Reality” book [Neisser, 1976], tried to place affordances and direct perception into a complete cognitive system model and tried to link them with other cognitive processes such as recognition. According to him, J.J. Gibson was right in stating that the meanings of the environment are directly available, and “information is not processed, but it is directly picked up since it is already there (in the light)”. Invariance attuned detectors are used for this purpose. However, he claimed, the Gibsonian view of affordances of perception is inadequate, since “it says so little about perceiver’s contribution to the perception act”. Instead, he suggests a perceptual system where a cycling activity continuous over time and space occurs. Neisser also tried to integrate both constructive and direct theories of perception. As a result, in [Neisser, 1994], he constructed a three-layered perceptual system, whose first and third layers correspond to direct perception and recognition, respectively.

Affordance-Related Research on Neurophysilogy and Neuropsychology

In [Norman, 2002], J. Norman, in a similar vein to Neisser, “attempted to reconcile the constructivist and ecological approachesin one bigger system, using studies from neurophysiological and neuropsychological studies. Based on evidence from human dorsal and ventral systems, he suggested a perceptual system where two different and interacting visual systems work. According to J. Norman, it is straightforward to conclude that “the pickup of affordances can be seen as the prime activity of the dorsal system.

Another set of findings of neurophysiological and neuropsychological research that is also associated with the idea of affordances came from studies on mirror and canonical neurons which were discovered in the pre-motor cortex of the monkey brain. During experiments with monkeys [Rizzolatti et al., 1996] (later similar findings were also found for human subjects [Fadiga et al., 1995]), mirror neurons fired both when the monkey was grasping an object, and when the monkey was watching somebody else do the grasping. Rizzolatti and Gentilucci [Rizzolatti and Gentilucci, 1988] discovered that canonical neurons, normally considered to be motor neurons for grasping actions, would fire when the subject does not execute a grasping action, but only sees a graspable object. Their discovery supports the view that says action and perception are closely related. In [Humphreys, 2001], Humphreys showed that, when presented with a tool, some patients, who lacked the ability to name the tool, had no problem in gesturing the appropriate movement for using it. According to Humphreys, this suggested a direct link from the visual input to the motor actions that is independent from more abstract representations of the object, e.g. its name.



Affordance-Related Research on Autonomous Robotics
The concept of affordances is highly related to autonomous robot control and it has influenced
studies in this field. We believe that, for a proper discussion of the relationship of the affordance concept to robot control, the similarity of the arguments of J.J. Gibson’s theory and reactive/behavior-based robotics should first be noted. The concept of affordances and behavior-based robotics emerged in very similar ways as opposing suggestions to the then dominant paradigms in their fields. They are both constructed based on the critisism of the dominant models and methods which favored modeling and inference. They both defend a direct relationship between agent and its environment, and tight coupling between perception and action. They are both on the side of “picking up only relevant information from the environment”, and perceiving the environment economically.

Some roboticists have already been explicitly using ideas on affordances in designing behavior-based robots. For example, Murphy [Murphy, 1999] suggested that robotic design can benefit from ideas in the theory of affordances such that complex perceptual modeling can be eliminated without loss in capabilities. She studied three case studies and drew attention to the importance of the ecological niche in the design of behaviors. Likewise, Duchon et al. [Duchon et al., 1998] benefited from J.J. Gibson’s ideas on direct perception and optic flow in the design of behaviors and coined the term Ecological Robotics for the practice of applying ecological principles to the design of mobile robots.




Fitzpatrick's poking and learning experiments

Metta's affordance experiments with BabyBot

Stoytchev's tool affordances

The use of affordances within Autonomous Robotics is mostly confined to behavior-based control of the robots, and its use in deliberation remains a rather unexplored area. In Cognitive Science, some cognitive models related affordances only with low-level processes [Norman, 2002], others viewed affordances as a part of a complete cognitive model [Gibson, 2000, Neisser, 1994, MacDorman, 2000]. Similarly, in robotics, some hybrid architectures inherit properties related to affordances only at their reactive layer [Arkin and Balch, 1997, Connell, 1992]. Recently a number of robotic studies focused on the learning of affordances in robots. These studies mainly tackled two major aspects. In one aspect, affordance learning is referred to as the learning of the consequences of a certain action in a given situation [Fitzpatrick et al., 2003, Stoytchev, 2005b, Stoytchev, 2005a]. In the other, studies focus on the learning of the invariant properties of environments that afford a certain behavior [MacDorman, 2000, Cos-Aguilera et al., 2003, Cos-Aguilera et al., 2004]. Studies in this latter group also relate these properties to the consequences of applying a behavior, but these consequences are in terms of the internal values of the agent, rather than changes in the physical environment.

We would like to note that affordance theory has mostly been used as a source of inspiration in robotics. Most of the studies reviewed above preferred to refer to J.J. Gibson’s original ideas as formulated in his books, ignoring modern discussions on the concept. As a result, only certain aspects of the theory have been used, and no attempts to consider the implications of the whole theory towards autonomous robot control have been made.

III. PRIOR FORMALIZATION OF AFFORDANCES
One of the earliest attempts to formalize affordances came from Turvey [Turvey, 1992]. In his formalism, Turvey defined an affordance as a disposition. Here, a disposition is a property of a thing that is a potential, a possibility. These potentials become actualized if they combine with their complements. In this formalism, although the actualization of affordances requires an interaction of an agent on the environment to produce a new dynamics, Turvey explicitly attached affordances to the environment that the organism is acting in. A criticism of Turvey’s formalism came from Stoffregen [Stoffregen, 2003]. His view places affordances in the organism-environment system as a whole instead of defining it as a property of the environment: “Affordances are properties of the animal-environment system, that is, that they are emergent properties that do not inhere in either the environment or the animal.” Chemero [Chemero, 2003] also criticized Turvey’s view which placed affordances in the environment regarding them as environmental properties. Partially in agreement with Stoffregen’s proposal, Chemero suggested that: “Affordances are relations between the abilities of organisms and features of the environment.” One of the main differences between the two similar formalisms of Stoffregen and Chemero, which both define affordances at the organism-environment scale, is that while Stoffregen’s definition of affordance does not include the behavior exploiting the affordance, Chemero’s definition does include it.

Steedman’s formalization [Steedman, 2002b] skips the perceptual aspect of affordances (e.g. the invariants of the environment that help the agent perceive the affordances, and the nature of these invariants and the relation of them to the bodily properties of the agent etc.), but instead it focuses on developing a representation where object schemas are defined in relation to the events and actions that they are involved in. For instance, Steedman suggests that a door is linked with the actions of ‘pushing’ and ‘going-through’, and the pre-conditions and consequences of applying these actions to the door. The different actions that are associated with a particular kind of object constitute the Affordance-set of that object schema, and this set can be populated via learning. This makes the formalization also suitable for planning, for which Steedman argues that reactive/forward-chaining planning is the best candidate. Steedman’s formalization is, as far as we know, the first attempt to develop a formalization of affordances that allows logical/computational manipulation and planning.

To summarize, it can be said that Stoffregen’s and Chemero’s formalizations, by defining affordances as a relation on the scale of organism-environment system, differ from Turvey’s formalization which defines affordances as environmental properties. But there are also differences between Chemero’s and Stoffregen’s definitions, one of them being the inclusion of behaviors in the definition of affordances in Chemero’s formalization. Steedman’s formalization differs from the other three formalizations by providing an explicit link to action possibilities offered by the environment, and by proposing the use of the concept in planning.

IV. THREE PERSPECTIVES OF AFFORDANCES

One major axis of discussions on affordances is on where to place them. In some discussions, affordances are placed in the environment as extended properties that are perceivable by the agent, whereas in others, affordances are said to be a properties of the organism-environment system. We believe that the source of the confusion is due to the existence of three – not one! – perspectives to view affordances. We argue that in most discussions, authors, including J.J. Gibson himself, often pose their arguments from different perspectives, neglecting to explicitly mention the perspective that they are using. This has been one of major sources that have made the arguments confusing, and seemingly contradictory at times.




Agent Perspective: The agent interacts with environment and discovers the affordances in its ecology. In this view, the affordance relationships reside within the agent interacting in the environment through his own behaviors. In Figure 1, the dog would “say”: “I have push-ability affordance, upon seeing the ball.

Environmental Perspective: Affordances are attachee over the environment as extended properties that can be perceivable by the agents. In our scene, the ball would “say”: “I offer hide-ability affordanceto an approaching dog. When “interrogated to list all of its affordances, the same ball may say: “I offer, push-ability (to a dog), throw-ability (to a human), ..., affordances”.

Observer Perspective: The interaction of an agent with the environment is observed by a third party. In our scene, we assume that the human is observing the interaction of the dog with the ball. In this case, the human would say: “There is push-ability affordance” in the dog-ball system.



In most of the discussions of affordances, including some of J.J. Gibson's own, environment or observer view is often implicitly used, causing much of the existing confusion. This view is the most essential one to be explored for using affordances in autonomous robot control, and will be the central focus of our formalization to be developed in the next section.

V. AN EXTENDED AFFORDANCE FORMALIZATION

In this section, we develop a formalism to describe our understanding of affordances. Different from the prior formalizations studies that we have reviewed, our motivation in attempting this task stems from our interest in incorporating the affordance concept into autonomous robot control.

First, we use the term, entity, to denote the environmental relata of the affordance instead of features (as used by Chemero) or object (as generally used). Second, the agent’s relata should represent the part of the agent that is generating the interaction with the environment that produced the affordance, we chose the term behavior to denote this. Third, the interaction between the agent and the environment should produce a certain effect. More specifically, a certain behavior applied on a certain entity should produce a certain effect, e.g. a certain perceivable change in the environment, or in the state of the agent. Based on the previous discussions:

Definition: An affordance is an acquired relation between a certain effect and a (entity, behavior) tuple, such that when the agent applies the behavior on the entity, the effect is generated. It is formalized as:

(effect, (entity, behavior))

The proposed formalization, with its explicit inclusion of effect, can be seen as a deviation from J.J. Gibson’s view at its outset. It is not. In J.J. Gibson’s writings, the issue of effect had always remained implicit. For instance in the definition of the lift-ability affordance, the expected effect of lifted is implicitly present. One question that may be posed is whether this formalism has equated affordance with effect. This is not the case. The formalism uses effect as the index to (entity, behavior) tuples. In this sense, given a desired effect to be achieved, the agent can directly access which (entity, behavior) can be used to that purpose.

An important aspect of affordances, which is also explicitly stated in our definition, is that they are acquired through the interaction of the agent with the entity. Therefore it is essential to consider the acquisition aspect in order to understand the nature of the three components of our formalism. Note that, whether this acquisition is done through learning, evolution or trial-and-error based design is irrelevant for our discussion.

Affordance Equivance Classes

A relation instance contains knowledge obtained from a single experiment and does not have any predictive ability over future experiments, hence not a relation. As the robot explores its environment, it will populate its knowledge database using such relation instances. Such a database can hardly be called affordances. Affordances should be relations with predictive abilities, rather than a set of unconnected relation instances.





The application of lift behavior on a can generated the effect of being lifted, and this relation is called as lift-ability. Lift-ability is shown as a “cloud” to indicate that it is just a label for the relation used to make the discussions more clear.

Entity equivalence: Many different entities (red-can and a blue can) can be used to generate the same effect (being lifted) upon the application of a certain behavior (lift).

Invariants (such as “cans of any color”), create a general relationship, enable the robot to predict the effect of the lift-with-right-hand behavior applied on a novel object, like a green-can. Such a capability offers great flexibility to a robot. When in need, the robot can search and find objects that would provide support for a desired affordance.

Behavioral equivalence: More than one behavior (lift-with-right-arm and lift-with-left-arm) can be applied to a certain entity (blue can) to generate a certain effect (lifted).

The use of behavioral equivalence will bring in a similar flexibility for the agent. a humanoid robot which lifted a can with one of its arms, loses its ability to lift another can. However, through behavioral equivalence it can immediately have a “change of plan” and accomplish lifting using its other hand.

Affordance equivalence: Different (entity, behavior) tuples ((river, swim) and (ground, walk)) can generate the same effect (traversed).

This formalization suggests that the entity (the sensory information) is to be concatenated with behavior (the motor information) and that the invariances are detected on this combined representation.

We argue that the discovery of invariants in entity equivalence classes can also produce abstractions over existing entities. For instance, the invariant <*-can> denotes a can without color, in an environment where all cans have color. In this sense, if one restricts entity to only the perceptual representation of the external world, the component <entity> can be referred to as an affordance cue [Fritz et al., 2006], which hints at the existence of a potential affordance. We would also like to note that when the term entity includes also the perceptual state of the agent itself, the term <entity> can be considered to be equivalent to the term pre-condition in deliberative planning. Finally, note that the question of how these invariants can be discovered and represented is a challenge that needs to be tackled.

VI. DISCUSSIONS ON THE FORMALISM AND ITS IMPLICATIONS TOWARDS ROBOT CONTROL

We believe that the proposed formalism has laid out a good framework over which the concept of affordance can be utilized for autonomous robot control. Below, we will discuss the major aspects of affordances as proposed within the formalism, and the corresponding implications towards robot control:

  • Affordances can be viewed from three perspectives, not one; namely, agent, observer and environment. In our formalism, we defined affordance from these perspectives with the hope that these different but related definitions will be of help in clarifying the discussions around the concept. We consider only the agent and observer perspectives to be relevant and provide the environment perspective only as a means to tie the proposed formalism to some philosophical discussions on the concept.

  • Affordances (agent and observer perspective) are relations that reside inside the agent. At a first glance, this claim can be seen to go against the common view of affordances in Ecological Psychology which places affordances in the agent-environment system, rather than in the agent or in the environment alone. However, we argue that representing these relationships explicitly inside the agent does not contradict the existence of these relations within the agent-environment system. As discussed in the previous bullet, we are interested in how the relations within the agentenvironment system are viewed from the robot’s perspective. We argue that these agent-environment relations can be internalized by the robot as explicit (though not necessarily symbolic) relations and can enable robots to perceive, learn, and act within their environment using affordances.

  • Affordances are acquired relations. The acquisition aspect is an essential property of the formalization, yet the method of acquisition is irrelevant. Here, acquisition is used as an umbrella term to denote different processes that lead to the development of affordances in agents including, but not limited to, evolution, learning and trial-and-error based design.

  • The formalism implies that in order to have robots acquire affordances within their environment, first, relation instances that pertain to the interaction of the robot with its environment need to be populated, and then these relation instances should be merged into relations through the formation of equivalence classes. The issues of how relation instances can be generated, and how relation instances can be merged into affordance relations are open problems that beg to be studied.

  • Affordances encode “general relations” pertaining to the agent, environment interaction, such as: balls are rollable. Naturally, exceptions to these general relations, such as “the-red-ball-on-my-table is not rollable (since it is glued to the table)” do exist. However, unlike affordance relations, these “specific relations” possess little, if any, predictive help over other cases, such as whether the-blue-ball-on-my-table is rollable or not. The implication for autonomous robot control is the existence of two control systems; an affordance-based one that acquires and uses general relations, and a complementary add-on system that complements the affordance-based system by learning its exceptions.

  • Affordances provide a framework for symbol formation. In the proposed formalism, the categorization of raw sensory-motor perceptions into equivalence classes can be considered as a symbol formation process. As also argued in [Sun, 2000], these symbols would be “formed in relation to the experience of agents, through their perceptual/motor apparatuses, in their world and linked to their goals and actions”.

  • Affordances provide support for planning. We argue that the proposed formalism creates relations that can also be used as operators for planning. An affordance relation is indexed by its effect and include tuples which store how that particular effect can be achieved. For instance, the <entity> and <behavior> components in the proposed formalism, can be considered to correspond to the pre-condition and action components in the STRIPS representation. A major difference between the STRIPS representation and the affordance representation is the way the operators are indexed.

VII. TOWARDS AFFORDANCE-BASED ROBOT CONTROL

We have conducted a number of experiments with robots to implement and evaluate certain aspects of the proposed formalism. Specifically, we studied on generation of entity, effect and affordance equivalcen classes. Affordance relations are learned from relation-instances as proposed in this document.




Learning entity equivalence classes using fixed effects.: See the web page The learning and use of traversability affordance on a mobile robot or ICRA'07 paper.

Discovering effect equivalences and affordance equivalences. See the web page From Primitive Behaviors to Goal Directed Behavior using Affordances or technical report of IROS'07 paper.

Affordance based robot planning: Affordances as a Framework for Robot Control paper in EPIROB'07.

VIII. CONCLUSION

The concept of affordances has been both inspirational and misty (which may have contributed positively to its influence over a wide-range of fields). In this paper, we have reviewed the discussions around the concept and explored how the concept can be formalized to be utilized in autonomous robot control. Towards this end, we have taken the view that our thinking should be led towards the point J.J. Gibson indicated, rather than backwards to the end where he left. As a consequence, the proposed formalism extended the Gibsonian notion of affordances in two major aspects. First, although the proposed formalism agrees with the Gibsonian view that affordances are relations within the agentenvironment system, it differs by arguing that these relationships can also be projected onto the agent. Hence, unlike the prior formalizations, the proposed formalism stops short of providing any “perspective-free” definitions for affordances, since it is not considered to be relevant for using the concept in robot control. The philosophical issue of whether an affordance can be defined without reference to any perspectives is possible or not, and how much would such a definition would contribute to the development of a “theory of information pickup” in agents, which constituted J.J. Gibson’s main motivation, will remain as topics towards further discussion.

Second, different from the Gibsonian view, the proposed formalism argues that affordances (for instance, as viewed from the agent perspective) can be internalized and explicitly represented within the agent. The Gibsonian view may reject this extension by arguing that J.J. Gibson had developed the concepts of affordance and direct perception to object the existence of “representations” in the organism. We do not agree with such an argument. In our understanding, J.J. Gibson objected to the view that perception has to create a generic world model, which has been often referred as “representation”, over which the organism infers whether an affordance exists or not. He argued that affordances are directly perceivable, that is, without using a world representation and without making inferences. The proposed formalism represents relations, not world models, within the robot and therefore, we claim that it does not conflict with the J.J. Gibson’s line of thinking.

Extending an already controversial term such as affordance is bound to be subject to criticism. One of the previous commentators of our project warned us of the dangers of being drawn into an already existing hot debate over the term, and suggested that whether a related-sounding but different term, such as “affoodance”, might relieve us from such debates12. This difficult dilemma is expressed in our title which begins with “to afford or not to afford”. We believe that conceiving new terms without properly relating themto already existing terms does more harm than good. Instead, in this paper, we tried to propose properly our formalization and definition of our understanding of the concept and leave the final judgement to the readers.

Finally, we would like to note that the implications of the proposed formalism on the development and implementation of an affordance-based robot control architecture is our current and on-going work in the MACS project. Although we believe that there are many challenges ahead towards this goal, the ideas proposed in this paper will be of help to guide us on this quest.


REFERENCES

  • [Amant, 1999] Amant, R. (1999). User interface affordances in a planning representation. Human Computer Interaction , 14(3):317–354.

  • [Arkin, 1998] Arkin, R. (1998). Behavior-based Robotics . MIT Press, Cambridge, MA, USA. ISBN:0262011654.

  • [Arkin and Balch, 1997] Arkin, R. C. and Balch, T. (1997). AuRA: Principles and practice in review. Journal of Experimental and Theoretical Artificial Intelligence , 9(2):175–189.

  • [Brooks, 1991] Brooks, R. (1991). Intelligence without representation. Artificial Intelligence , 47:139–159.

  • [Chemero, 2000] Chemero, A. (2000). What events are. Ecological Psychology , 12(1):37–42. [Chemero, 2003] Chemero, A. (2003). An outline of a theory of affordances. Ecological Psychology ,15(2):181–195.

  • [Chemero et al., 2003] Chemero, A., Klein, C., and Cordeiro, W. (2003). Events as changes in the layout of affordances. Ecological Psychology , 15(1):19–28.

  • [Connell, 1992] Connell, J. (1992). Sss: A hybrid architecture applied to robot navigation. In Proceedings of theIEEE International Conference on Robotics and Automation , pages 2719–2724, Los Alamitos, California.

  • [Cooper and Glasspool, 2001] Cooper, R. and Glasspool, D. W. (2001). Learning action affordances and action schemas. In French, R. M. and Sougne, J. P., editors, Connectionist Models of Learning, Development and Evolution , Perspectives in Neural Computing, pages 133–142, London. Sixth Neural Computation and Psychology Workshop, Springer-Verlag.

  • [Cornus et al., 1999] Cornus, S., Montagne, G., and Laurent, M. (1999). Perception of a steppingacross affordance. Ecological Psychology , 11(4):249–267.

  • [Cos-Aguilera et al., 2003] Cos-Aguilera, I., Canamero, L., and Hayes, G. (2003). Motivationdriven learning of object affordances: First experiments using a simulated Khepera robot. In In Proceedings of the 9th International Conference in Cognitive Modelling (ICCM’03) , Bamberg,Germany.

  • [Cos-Aguilera et al., 2004] Cos-Aguilera, I., Canamero, L., and Hayes, G. (2004). Using a SOFMto learn object affordances. In In Proceedings of the 5th Workshop of Physical Agents , Girona,Catalonia, Spain.

  • [Dorffner et al., 2005] Dorffner, G., Irran, J., Kintzler, F., and Poelz, P. (2005). Robotic learning architecture that can be taught by manually putting the robot to action sequences. Technical report, The Austrian Research Institute for Artificial Intelligence (OFAI). MACS Project Deliverable 5.3.1.

  • [Duchon et al., 1998] Duchon, A., Warren, W., and Kaelbling, L. (1998). Ecological robotics. Adaptive Behavior , 6(3):473–507.

  • [Fadiga et al., 1995] Fadiga, L., Fogassi, L., Pavesi, G., and Rizzolatti, G. (1995). Motor facilitation during action observation: a magnetic stimulation study. Journal of Neurophysiology ,

  • 73:2608–2611.

  • [Fikes and Nilsson, 1971] Fikes, R. and Nilsson, N. (1971). Strips: A new approach to the application of theorem proving to problem solving. Artificial Intelligence , 2(3/4):189–208.

  • [Firby, 1989] Firby, J. (1989). Adaptive Execution in Complex Dynamic Worlds . Ph.d. thesis, yaleu/csd/rr #672, Yale University.

  • [Fitzpatrick et al., 2003] Fitzpatrick, P., Metta, G., Natale, L., Rao, A., and Sandini, G. (2003). Learning about objects through action -initial steps towards artificial cognition. In Proceedings of the 2003 IEEE International Conference on Robotics and Automation, ICRA , pages 3140–3145.

  • [Fritz et al., 2006] Fritz, G., Paletta, L., Kumar, M., Dorffner, G., Breithaupt, R., and Rome, E. (2006). Visual learning of affordance based cues. In Nolfi, S., Baldassarre, G., Calabretta,

  • R., Hallam, J., Marocco, D., Meyer, J.-A., and Parisi, D., editors, From animals to animats 9: Proceedings of the Ninth International Conference on Simulation of Adaptive Behaviour (SAB), LNAI. Volume 4095., pages 52–64, Roma, Italy. Springer-Verlag, Berlin.

  • [Gallese, 2000] Gallese, V. (2000). Agency and motor representations: new perspectives on intersubjectivity. SC working papers 2000-6. Workshop on autism and the Theory of Mind. Lyon.

  • [Gallese et al., 1996] Gallese, V., Fadiga, L., Fogassi, L., and Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain , 119:593–609.

  • [Ghallab et al., 2004] Ghallab, M., Nau, D., and Traverso, P. (2004). Automated Planning Theory and Practise . Elsevier.

  • [Gibson, 2000] Gibson, E. (2000). Perceptual learning in development: Some basic concepts. Ecological Psychology , 12(4):295–302.

  • [Gibson, 2003] Gibson, E. (2003). The world is so full of a number of things: On specification and perceptual learning. Ecological Psychology , 15(4):283–288.

  • [Gibson et al., 1987] Gibson, E., Riccio, G., Schmuckler, M., Stoffregen, T., Rosenberg, D., and Taromina, J. (1987). Detection of the traversability of surfaces by crawling and walking infants. Journal of Experimental Psychology , 13(4):533–544.

  • [Gibson, 1966] Gibson, J. (1966). The senses considered as perceptual systems . Houghton Mifflin, Boston.

  • [Gibson, 1986] Gibson, J. (1986). The Ecological Approach to Visual Perception . Lawrence Erlbaum Associates. Originally published in 1979.

  • [Greeno, 1994] Greeno, J. (1994). Gibson’s affordances. Psychological Review , 101(2):336–342.

  • [Harnad, 1990] Harnad, S. (1990). The symbol grounding problem. Physica D .

  • [Humphreys, 2001] Humphreys, G. (2001). Objects, affordances ... action !!! The Psychologist , 14(8):5.

  • [Irran et al., 2006] Irran, J., Kintzler, F., and P¨olz, P. (2006). Grounding affordances. In Trappl, R., editor, Cybernetics and Systems . Austrian Society for Cybernetic Studies. ISBN: 3 85206 172 5.

  • [Jones, 2003] Jones, K. (2003). What is an affordance? Ecological Psychology , 15(2):107–114.

  • [Kinsella-Shaw et al., 1992] Kinsella-Shaw, J., Shaw, B., and Turvey, M. (1992). Perceiving walkonable slopes. Ecological Psychology , 4(4):223–239.

  • [MacDorman, 2000] MacDorman, K. (2000). Responding to affordances: Learning and projecting a sensorimotor mapping. In Proc. of 2000 IEEE Int. Conf. on Robotics and Automation , pages 3253–3259, San Fransisco, California, USA.

  • [Mark, 1987] Mark, L. (1987). Eyeheight-scaled information about affordances: A study of sitting and stair climbing. Journal of Experimental Psychology: Human Perception and Performance, 13(3):361–370.

  • [McGrenere and Ho, 2000] McGrenere, J. and Ho,W. (2000). Affordances: Clarifying and evolving a concept. In In Proceedings of the Graphics Interface , pages 179–186, Toronto. Canadian Human-Computer Communications Society.

  • [Murphy, 1999] Murphy, R. (1999). Case studies of applying gibson’s ecological approach to mobile robots. IEEE Transactions on Systems, Man, and Cybernetics , 29(1):105–111.

  • [Neisser, 1976] Neisser, U. (1976). Cognition and Reality: Principles and Implications of Cognitive Psychology . 0716704773. W.H. Freeman and Co.

  • [Neisser, 1994] Neisser, U. (1994). Multiple systems: A new approach to cognitive theory. The European Journal of Cognitive Psychology , 6:225–241.

  • [Norman, 1988] Norman, D. (1988). The Psychology of Everyday Things . Basic Books.

  • [Norman, 1999] Norman, D. (1999). Affordance, conventions, and design. Interactions , 6(3):38–42.

  • [Norman, 2001] Norman, J. (2001). Ecological psychology and the two visual systems: Not to worry! Ecological Psychology , 13(2):135–145.

  • [Norman, 2002] Norman, J. (2002). Two visual systems and two theories. Behavioral and Brain Sciences , 25:73–144.

  • [Oudejans et al., 1996] Oudejans, R., Michaels, C., vanDort, B., and Frissen, E. (1996). To cross or not to cross: The effect of locomotion on street-crossing behavior. Ecological Psychology, 8(3):259–267.

  • [Rizzolatti et al., 1996] Rizzolatti, G., Fadiga, L., Gallese, V., and Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research , 3:131–141.

  • [Rizzolatti and Gentilucci, 1988] Rizzolatti, G. and Gentilucci, M. (1988). Motor and visual-motor functions of the premotor cortex , pages 269–284. Chichester: Wiley.

  • [Sanders, 1997] Sanders, J. (1997). An ontology of affordances. Ecological Psychology , 9(1):97–112.

  • [Steedman, 2002a] Steedman, M. (2002a). Formalizing affordance. In Proceedings of the 24th Annual Meeting of , Washington D.C. Lawrence Erlbaum.

  • [Steedman, 2002b] Steedman, M. (2002b). Plans, affordances, and combinatory grammar. Linguistics and Philosophy , 25.

  • [Stoffregen, 2003] Stoffregen, T. (2003). Affordances as properties of the animal environment system. Ecological Psychology , 15(2):115–134.

  • [Stoytchev, 2005a] Stoytchev, A. (2005a). Behavior-grounded representation of tool affordances. In In Proceedings of IEEE International Conference on Robotics and Automation (ICRA) , pages 18–22, Barcelona, Spain.

  • [Stoytchev, 2005b] Stoytchev, A. (2005b). Toward learning the binding affordances of objects: A behavior-grounded approach. In In Proceedings of AAAI Symposium on Developmental Robotics, pages 21–23.

  • [Sun, 2000] Sun, R. (2000). Symbol grounding: A new look at an old idea. Philosophical Psychology , 13(149–172).

  • [Szokolszky, 2003] Szokolszky, A. (2003). An interview with Eleanor Gibson. Ecological Psychology , 15(4):271–281.

  • [Turvey, 1992] Turvey, M. (1992). Affordances and prospective control: an outline of the ontology. Ecological Psychology , 4(3):173–187.

  • [U˘gur et al., 2006] U˘gur, E., Do˘gar, M., C¸ akmak, M., and S¸ahin, E. (2006). The learning and use of traversability affordance using range images on a mobile robot. Technical Report METUCENG-TR-2006-03, Dept. of Computer Eng., Middle East Technical University, Ankara, Turkey.

  • [U˘gur et al., 2007] U˘gur, E., Do˘gar, M., C¸ akmak, M., and S¸ahin, E. (2007). The learning and use of traversability affordance using range images on a mobile robot. In to appear in Proceedings of IEEE Intl. Conf. on Robotics and Automation (ICRA 07) .

  • [Warren, 1984] Warren, W. (1984). Perceiving affordances: Visual guidance of stair climbing. Journal of Experimental Psychology , 105(5):683–703.

  • [Warren and Whang, 1987] Warren, W. and Whang, S. (1987). Visual guidance of walking through apertures: body-scaled information for affordances. Journal of Experimental Psychology , 13(3):371–383.

  • [Wehner, 1987] Wehner, R. (1987). “Matched filters” - neural models of the external world. Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology ,161(4):511 – 531.


Emre Ugur, 2007