In recent years, with the rapid development of bio-medical techniques, incrementally scientists find that the study on human beings immune system is extremely important. It can facilitate the diagnosis and treatment of some deadly diseases like leukemia, cancer, AIDS and etc, as well as it is one of the critical factors to determine whether if the transplant operation is successful. The main function of immune system is to mark and eliminate the bacterium and fungus, lymphocyte is the most important immune cell. Therefore, potentially it is a direct and efficient method to estimate the patients immune system condition based on the lymphocyte shape changing analysis. In this paper, we address the problem of lymphocyte detection and tracking by the means of mathematic morphological and active contour techniques, pattern recognition method is utilized to analyze the detected lymphocyte image and ultimately achieve the aim of classification.