In modern world, children are interested in interacting with computers in many ways, for e.g. game playing, ELearning, chatting etc. This interest could be effectively exploited to develop their personality by creating interactive systems that adapt to different emotional states and intensities of children interacting with them. Many of the existing games are designed to beat the children rather than encourage them to win. Further, many of these systems do not take neither the emotional state nor the intensity of emotions into consideration. In this paper we present an interactive multi-agent based system that recognizes child?s emotion. A social agent uses cognitive and non-cognitive factors to estimate a child?s intensity of emotions in real time and an autonomous/intelligent agent uses cognitive and non-cognitive factors to estimate a child?s intensity of emotions in real time and an autonomous/intelligent agent uses an adaptation model based on the intensity of child?s emotion to change the game status. An animated pedagogical agent gives motivational help to encourage the adaptation of the system in an interactive manner. Results show that affective gesture recognition model recognizes a child?s emotion with a considerably higher rate of over 82.5% and the social agent (estimate intensity of emotion) has strong relationship with observers? feedback except in low intensity levels.