This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Declarative Optimization-Based Drama Management in Interactive Fiction
May/June 2006 (vol. 26 no. 3)
pp. 32-41
Mark J. Nelson, Georgia Institute of Technology
Michael Mateas, Georgia Institute of Technology
David L. Roberts, Georgia Institute of Technology
Charles L. Isbell Jr., Georgia Institute of Technology
A drama manager guides a player through a story experience by modifying the experience in reaction to the player's actions. Declarative optimization-based drama management (DODM) casts the drama-management problem as an optimization problem: the author declaratively specifies a set of plot points in a story, a set of actions the drama manager can take, and an evaluation function that rates a particular story. The drama manager then takes the actions in a way that attempts to maximize story quality. Peter Weyhrauch reported good results using a variant of game-tree search to optimize the use of drama-manager actions. The authors attempt to replicate these results on another story, Anchorhead, and show that search does not perform well in general, especially on larger and more complex stories. However, they believe that this is a problem with the specific optimization method, not the general approach, and report some results demonstrating the plausibility of applying reinforcement-learning techniques to compute a policy instead of search.

1. M. Mateas and A. Stern, "Integrating Plot, Character, and Natural Language Processing in the Interactive Drama Façade," Proc. 1st Int'l Conf. Technologies for Interactive Digital Storytelling and Entertainment (TIDSE), Fraunhofer IRB Verlag, 2003.
2. P. Weyhrauch, Guiding Interactive Drama, doctoral dissertation, tech. report CMU-CS-97-109, School of Computer Science, Carnegie Mellon Univ., 1997.
3. R.S. Sutton, "Learning to Predict by the Methods of Temporal Differences," Machine Learning, vol. 3, no. 1, 1988, pp. 9–44.
4. G. Tesauro, "Practical Issues in Temporal Difference Learning," Machine Learning, vol. 8, nos. 3–4, 1992, pp. 257–277.
5. P. Dayan and T.J. Sejnowski, "TD(λ) Converges with Probability 1," Machine Learning, vol. 14, no. 3, 1994, pp. 295–301.
1. J. Bates, "Virtual Reality, Art, and Entertainment," Presence: The J. Teleoperators and Virtual Environments, vol. 2, no. 1, 1992, pp. 133–138.
2. P. Weyhrauch, Guiding Interactive Drama, doctoral dissertation, tech. report CMU-CS-97-109., School of Computer Science, Carnegie Mellon Univ., 1997.
3. A. Lamstein and M. Mateas, "A Search-Based Drama Manager," Proc. AAAI Workshop Challenges in Game AI, AAAI Press, 2004.
4. R.M. Young et al., "An Architecture for Integrating Plan-Based Behavior Generation with Interactive Game Environments," J. Game Development, vol. 1, no. 1, 2004, pp. 51–70.
5. B. Magerko and J. Laird, "Building an Interactive Drama Architecture," Proc. 1st Int'l Conf. Technologies for Interactive Digital Storytelling and Entertainment (TIDSE), Fraunhofer IRB Verlag, 2003.
6. M. Mateas and A. Stern, "Integrating Plot, Character, and Natural Language Processing in the Interactive Drama Façade," Proc. 1st Int'l Conf. Technologies for Interactive Digital Storytelling and Entertainment (TIDSE), Fraunhofer IRB Verlag, 2003.
7. M. Mateas, "An Oz-Centric Review of Interactive Drama and Believable Agents," AI Today: Recent Trends and Developments, Lecture Notes in AI 1600, M. Woodbridge and M. Veloso, eds., Springer, 1999, pp. 297–328.

Index Terms:
interactive drama, computer gaming, drama management, game-tree search, reinforcement learning
Citation:
Mark J. Nelson, Michael Mateas, David L. Roberts, Charles L. Isbell Jr., "Declarative Optimization-Based Drama Management in Interactive Fiction," IEEE Computer Graphics and Applications, vol. 26, no. 3, pp. 32-41, May-June 2006, doi:10.1109/MCG.2006.55
Usage of this product signifies your acceptance of the Terms of Use.