Abstract
Agent teamwork (collaboration) is an important and challenging
topic of research. Increasingly, agent teams are used in realistic
and complex multi-agent environments. In such environments,
dynamic and complex changes in the environment require
appropriate adaptation on the part of team-members. As
RoboCup proposes to provide multi-agent researchers with a
standard test-bed for evaluation of methodologies for such
environments, it is only natural to use it for investigating this
essential capability. During the RoboCup-98 workshop and
competition a unique event took place: a comparative evaluation
of the teamwork adaptation capabilities of 13 of the top
competing teams. An evaluation attempt of this scale is a novel
undertaking, and presents many novel challenges to researchers
in the multi-agent community. This preliminary report describes
the data-collection session, the experimental protocol, and some
of the preliminary results from analysis of the data. Rather than
proposing solutions and well understood results, it seeks to
highlight key challenges in evaluation of multi-agent research in
general, and in the context of RoboCup in particular
Original language | American English |
---|---|
Title of host publication | RoboCup-99: Robot Soccer World Cup III (LNAI 1856)} (1856) |
Editors | G. Kaminka |
Publisher | Citeseer |
Pages | 345-356 |
State | Published - 1999 |