We propose a novel approach for tracking of human joints based on anthropometric constraints. A human is modeled as a pictorial structure consisting of body landmarks (joints) and corresponding links between them. Anthropometric constraints relate the landmarks of two persons if they are in the same posture. Given a test video, where an actor performs the same action as in a model video, and joint locations in the model video, anthropometric constraints are used to determine the epipolar lines, where the potential joint locations are searched in the test video. The edge templates around joints and related links are used to locate joints in the test video. The performance of this method is demonstrated on several different human actions.