The developments of wired network technologies are significant rapidly, such as the IP-based network. These technologies can be used to develop wireless network directly. Recently, there are many communication systems brought up in order to offer mobile users with the best services. The combination of wired network and wireless network could be used to access data mutually. In this paper, the multi-tier architecture is based on IP network. Combining all these systems in a multi-tier IP-based wireless network is an important issue. In this paper, we propose a novel handoff algorithm of wireless communication for multi-tier IP-based network; the handoff algorithm is divided into two parts, which are Old-tier priority and New-tier priority algorithm. Making programs by C for simulating, and making sure that the algorithm is workable. The results of simulation show 11.99% of handoff frequency has been decreased and 8% of using rates of resource has been increased.