Autonomic and Autonomous Systems, International Conference on (2008)
Mar. 16, 2008 to Mar. 21, 2008
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICAS.2008.35
The planning process in autonomic software aims at selecting an action from a finite set of alternatives for adaptation. This is an abstruse problem due to the fact that software behavior is usually very complex with numerous number of control variables. This research work focuses on proposing a planning process and specifically an action selection technique based on "Reinforcement Learning" (RL). We argue why, how, and when RL can be beneficial for an autonomic software system. The proposed approach is applied to a simulated model of a news web application. Evaluation results show that this approach can learn to select appropriate actions in a highly dynamic environment. Furthermore, we compare this approach with another technique from the literature, and the results suggest that it can achieve similar performance in spite of no expert involvement.
Self Adaptive Software, Reinforcement Learning, Action Selection
M. Amoui, M. Salehie, S. Mirarab and L. Tahvildari, "Adaptive Action Selection in Autonomic Software Using Reinforcement Learning," 2008 4th International Conference on Autonomic and Autonomous Systems(ICAS), Gosier, 2008, pp. 175-181.