A growing number of inexpensive portable computing devices are becoming available that can access data and media services across heterogeneous networks and network standards. Concurrently, significant computational resources are being deployed offering diverse and innovative services to users of these networks. In such type of a pervasive environment, one of the critical issues for a mobile user would be locating an appropriate network, discovering and selecting appropriate services. In recognition of this, we propose a novel Distributed Service Discovery Architecture that consists of Service Clustered Servers (SCS) distributed across the network and form a Service Overlay Network (SoN) to provide seamless service discovery and access. The architecture is extended to address wide area service using multi-tier model with facilitators. The real time implementation of architecture is performed and parameters such as latency to find a service, precision, CBR and gain in wide area networks are measured and discussed.