Today?s Internet can only support "best effort" traffic while with fast emerging multimedia services, it will become clear that future Internet architecture will have to support various applications with different Quality of Service (QoS) requirements. Differentiated Services (Diffserv) model, as described in [1] allow the support of QoS differentiated services on an IP backbone network. The Diffserv model provides service classification by means of the Differentiated Service (DS) field in the IP header and the Per Hop Behavior (PHB) observable behavior at the node. In this paper we propose a fuzzy based Diffserv model to implement the differentiated services in the Internet. In the proposed model we use a fuzzy meter which is based on dynamic rate Leaky Bucket (LB) mechanism. Furthermore we use Random Early Discard (RED) mechanism to provide low loss probability for assured services. Simulation results show that the proposed fuzzy Diffserv model has better performance than the conventional Diffserv model with leaky bucket meter.