In this paper, a method for automatically detecting the end of lively broadcasted sports programs is proposed, which enables users to record the full TV programs when they run over time. Taking advantage of the property of relatively high content consistency within sports programs, this method is based on checking the break point of this content consistency. A scalable video segment similarity measure is proposed to measure content consistency of video segments in different similarity levels. Based on this measure, a two-round end detection scheme is applied, in which the first round, Candidate End Point Finding, is able to find a coarse candidate end point, and the second round, End Point Refining, is able to find a more accurate end. Experiments show that the proposed end detection scheme is able to detect the real ends with high accuracy.