The Community for Technology Leaders
Autonomic and Autonomous Systems, International Conference on (2008)
Mar. 16, 2008 to Mar. 21, 2008
ISBN: 978-0-7695-3093-2
pp: 175-181
ABSTRACT
The planning process in autonomic software aims at selecting an action from a finite set of alternatives for adaptation. This is an abstruse problem due to the fact that software behavior is usually very complex with numerous number of control variables. This research work focuses on proposing a planning process and specifically an action selection technique based on "Reinforcement Learning" (RL). We argue why, how, and when RL can be beneficial for an autonomic software system. The proposed approach is applied to a simulated model of a news web application. Evaluation results show that this approach can learn to select appropriate actions in a highly dynamic environment. Furthermore, we compare this approach with another technique from the literature, and the results suggest that it can achieve similar performance in spite of no expert involvement.
INDEX TERMS
Self Adaptive Software, Reinforcement Learning, Action Selection
CITATION
Mehdi Amoui, Mazeiar Salehie, Siavash Mirarab, Ladan Tahvildari, "Adaptive Action Selection in Autonomic Software Using Reinforcement Learning", Autonomic and Autonomous Systems, International Conference on, vol. 00, no. , pp. 175-181, 2008, doi:10.1109/ICAS.2008.35
90 ms
(Ver 3.3 (11022016))