H.264/SVC extends the hybrid video coding approach of H.264/AVC, which adopts a layered coding scheme to generate multi-layer bit stream for heterogeneous environments. For the network application of H.264/SVC, congestion control is a crucial issue. This paper proposes an end-to-end rate control mechanism for H.264/SVC based on binomial congestion control algorithm, which is called HBCC and supports the transmission of variable packet length SVC flows. It removes loss retransmission and changes the mechanism of sending an ACK for every packet received to reduce the variations in the frequency of the congestion window and makes real-time video be transmitted smoother. In the end, we use NS2 simulation and video quality metrics to evaluate the scheme. Result shows the scheme is effective