loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 2 (AAMAS'04)
The Role of Reactivity in Multiagent Learning
New York City, New York, USA
July 19-July 23
ISBN: 0-7695-2092-8
Bikramjit Banerjee, Tulane University
Jing Peng, Tulane University
In this paper we take a closer look at a recently proposed classification scheme for multiagent learning algorithms. Based on this scheme an exploitation mechanism (we call it the Exploiter) was developed that could beat various Policy Hill Climbers (PHC) and other fair opponents in some repeated matrix games. We show on the contrary that some fair opponents may actually beat the Exploiter in repeated games. This clearly indicates a deficiency in the original classification scheme which we address. Specifically, we introduce a new measure called Reactivity that measures how fast a learner can adapt to an unexpected hypothetical change in the opponent?s policy. We show that in some games, this new measure can approximately predict the performance of a player, and based on this measure we explain the behaviors of various algorithms in the Matching Pennies game, which was inexplicable by the original scheme. Finally we show that under certain restrictions, a player that consciously tries to avoid exploitation may be unable to do so.
Citation:
Bikramjit Banerjee, Jing Peng, "The Role of Reactivity in Multiagent Learning," aamas, vol. 2, pp.538-545, Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 2 (AAMAS'04), 2004
Usage of this product signifies your acceptance of the Terms of Use.