We have proposed a human-scale interaction system (i.e. Reactive Virtual Human System) with haptic sensation. This system is composed of a wire-based haptic interface and an immersive virtual environment(VE). Based on the framework, we realized Virtual Catch Ball that a user can play a virtual human with a feeling of contacting real ball. To make a database of virtual human?s natural reaction, we implemented ReactiveMotion Capture System that can capture movements with physical reaction in close interpersonal engagements. In this paper, we will further show the system?s extended function that new motions can reflect on virtual human?s behavioral structure by a on-line motion capture. It will be a practical way to produce various motion patterns during playing, and to enforce virtual human?s adaptive function.