With the popularity of broadband networks, video streaming grows rapidly in the Internet. By the deployment of a caching proxies,the backbone bandwidth an be saved significantly. In this paper, we propose a packet-based a caching architecture for video streaming. The proposed a caching scheme is based the streamed packets instead of video files and the consideration of packet loss recovery. We also propose an effective cache replacement algorithm PLFU and evaluate the algorithm through simulation.