This paper presents a mobile-controlled handoff with an end-to-end communication architecture that helps to provide high mobility without requiring any special service from the visiting networks. The handoff utilizes the IP diversity created by dual network interfaces at the mobile node and exploits the overlapping area between subnets. The end-to-end network architecture is particularly suitable for low bit rate delay sensitive real time applications, where payload tends to be short and packet header overhead is particularly significant. We describe the network architecture and show the mobility support by prototype implementation and its performance evaluation. We also develop an analytical model of handoff and compare the performance of handoff in proposed network architecture and Mobile IPv6. Performance evaluation shows that the handoff quality not only depends on the location but also on the implementation design of the location database servers. We see significant latency improvement due to our implementation as compare to mobile IPv6.