The RoboCup-98 teamwork evaluation session: A preliminary report

Gal A. Kaminka

doi:10.1007/3-540-45327-x_28

The RoboCup-98 teamwork evaluation session: A preliminary report

Gal A. Kaminka

University of Southern California

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Increasingly, agent teams are used in realistic and complex multiagent environments. In such environments, dynamic and complex changes in the environment require appropriate adaptation of the teamwork (collaboration) among team-members. As RoboCup proposes to provide multi-agent researchers with a standard test-bed for evaluation of methodologies, it is only natural to use it for investigating this essential capability. During the RoboCup-98 workshop and competition a unique event took place: a comparative evaluation of the teamwork adaptation capabilities of 13 of the top competing teams. An evaluation attempt of this scale is a novel undertaking, and presents many novel challenges to researchers in the multi-agent community. This preliminary report describes the data-collection session, the experimental protocol, and some of the preliminary results from analysis of the data. Rather than proposing solutions and well understood results, it seeks to highlight key challenges in evaluation of multi-agent research in general, and of teamwork in particular.

Original language	English
Title of host publication	RoboCup-99
Subtitle of host publication	Robot Soccer World Cup III
Editors	Manuela Veloso, Enrico Pagello, Hiroaki Kitano
Publisher	Springer Verlag
Pages	345-356
Number of pages	12
ISBN (Print)	9783540410430
DOIs	https://doi.org/10.1007/3-540-45327-x_28
State	Published - 2000
Externally published	Yes
Event	3rd Robot World Cup Soccer Games and Conferences, RoboCup 1999 - Stockholm, Sweden Duration: 27 Jul 1999 → 6 Aug 1999

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	1856
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	3rd Robot World Cup Soccer Games and Conferences, RoboCup 1999
Country/Territory	Sweden
City	Stockholm
Period	27/07/99 → 6/08/99

Bibliographical note

Publisher Copyright:
© Springer-Verlag Berlin Heidelberg 2000.

Access to Document

10.1007/3-540-45327-x_28

Cite this

Kaminka, G. A. (2000). The RoboCup-98 teamwork evaluation session: A preliminary report. In M. Veloso, E. Pagello, & H. Kitano (Eds.), RoboCup-99: Robot Soccer World Cup III (pp. 345-356). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1856). Springer Verlag. https://doi.org/10.1007/3-540-45327-x_28

@inproceedings{51ed0c24df5f40e483a60558c7f03901,

title = "The RoboCup-98 teamwork evaluation session: A preliminary report",

abstract = "Increasingly, agent teams are used in realistic and complex multiagent environments. In such environments, dynamic and complex changes in the environment require appropriate adaptation of the teamwork (collaboration) among team-members. As RoboCup proposes to provide multi-agent researchers with a standard test-bed for evaluation of methodologies, it is only natural to use it for investigating this essential capability. During the RoboCup-98 workshop and competition a unique event took place: a comparative evaluation of the teamwork adaptation capabilities of 13 of the top competing teams. An evaluation attempt of this scale is a novel undertaking, and presents many novel challenges to researchers in the multi-agent community. This preliminary report describes the data-collection session, the experimental protocol, and some of the preliminary results from analysis of the data. Rather than proposing solutions and well understood results, it seeks to highlight key challenges in evaluation of multi-agent research in general, and of teamwork in particular.",

author = "Kaminka, {Gal A.}",

note = "Publisher Copyright: {\textcopyright} Springer-Verlag Berlin Heidelberg 2000.; 3rd Robot World Cup Soccer Games and Conferences, RoboCup 1999 ; Conference date: 27-07-1999 Through 06-08-1999",

year = "2000",

doi = "10.1007/3-540-45327-x_28",

language = "אנגלית",

isbn = "9783540410430",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "345--356",

editor = "Manuela Veloso and Enrico Pagello and Hiroaki Kitano",

booktitle = "RoboCup-99",

address = "גרמניה",

}

Kaminka, GA 2000, The RoboCup-98 teamwork evaluation session: A preliminary report. in M Veloso, E Pagello & H Kitano (eds), RoboCup-99: Robot Soccer World Cup III. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 1856, Springer Verlag, pp. 345-356, 3rd Robot World Cup Soccer Games and Conferences, RoboCup 1999, Stockholm, Sweden, 27/07/99. https://doi.org/10.1007/3-540-45327-x_28

The RoboCup-98 teamwork evaluation session: A preliminary report. / Kaminka, Gal A.
RoboCup-99: Robot Soccer World Cup III. ed. / Manuela Veloso; Enrico Pagello; Hiroaki Kitano. Springer Verlag, 2000. p. 345-356 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1856).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - The RoboCup-98 teamwork evaluation session

T2 - 3rd Robot World Cup Soccer Games and Conferences, RoboCup 1999

AU - Kaminka, Gal A.

PY - 2000

Y1 - 2000

N2 - Increasingly, agent teams are used in realistic and complex multiagent environments. In such environments, dynamic and complex changes in the environment require appropriate adaptation of the teamwork (collaboration) among team-members. As RoboCup proposes to provide multi-agent researchers with a standard test-bed for evaluation of methodologies, it is only natural to use it for investigating this essential capability. During the RoboCup-98 workshop and competition a unique event took place: a comparative evaluation of the teamwork adaptation capabilities of 13 of the top competing teams. An evaluation attempt of this scale is a novel undertaking, and presents many novel challenges to researchers in the multi-agent community. This preliminary report describes the data-collection session, the experimental protocol, and some of the preliminary results from analysis of the data. Rather than proposing solutions and well understood results, it seeks to highlight key challenges in evaluation of multi-agent research in general, and of teamwork in particular.

AB - Increasingly, agent teams are used in realistic and complex multiagent environments. In such environments, dynamic and complex changes in the environment require appropriate adaptation of the teamwork (collaboration) among team-members. As RoboCup proposes to provide multi-agent researchers with a standard test-bed for evaluation of methodologies, it is only natural to use it for investigating this essential capability. During the RoboCup-98 workshop and competition a unique event took place: a comparative evaluation of the teamwork adaptation capabilities of 13 of the top competing teams. An evaluation attempt of this scale is a novel undertaking, and presents many novel challenges to researchers in the multi-agent community. This preliminary report describes the data-collection session, the experimental protocol, and some of the preliminary results from analysis of the data. Rather than proposing solutions and well understood results, it seeks to highlight key challenges in evaluation of multi-agent research in general, and of teamwork in particular.

UR - http://www.scopus.com/inward/record.url?scp=84944890114&partnerID=8YFLogxK

U2 - 10.1007/3-540-45327-x_28

DO - 10.1007/3-540-45327-x_28

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:84944890114

SN - 9783540410430

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 345

EP - 356

BT - RoboCup-99

A2 - Veloso, Manuela

A2 - Pagello, Enrico

A2 - Kitano, Hiroaki

PB - Springer Verlag

Y2 - 27 July 1999 through 6 August 1999

ER -

The RoboCup-98 teamwork evaluation session: A preliminary report

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this