In this paper, we discuss a vision-based real-time motion capture system, which is constructed on a PC-cluster. Vision-based motion capture is a merit that it does not impose any physical restrictions on humans, which provides a natural way of measuring human motion. However, there are several issues to be solved, which are robust estimation of human motion from limited number of visual cues, computation cost of the estimation algorithm.

To deal with these issues, we have developed multi-view-based algorithms using multiple cameras and we have implemented the algorithms on a PC-cluster to solve the computation problem. In this paper, we present our experimental study on vision-based real-time motion capture with emphasis on 3D human posture estimation.