In this paper we investigate the problem of designing load balancing mechanisms with verification for heterogeneous distributed systems. We derive a compensation and bonus type mechanism that solves the load balancing problem in distributed systems in which computers are characterized by linear latency functions. We prove that our mechanism is truthful and satisfies the voluntary participation condition. We present a simulation study to show the performance of our mechanism.