An algorithm using Bayesian on-line learning for object based video image segmentation is proposed in this paper. First the strengths of image pixel's spatial location, color and motion segments are fused in one framework for image clustering and segmentation. Here the appropriate modeling of Probability Distribution Functions(PDF) of each feature cluster is obtained through Gaussian Distribution. In this paper unsupervised Bayesian learning is implemented to identify these distribution parameters. The online Bayesian learning process is carried out with the previous clustered image pixels information and feature clusters Gaussian PDF information. This algorithm has shown good results on different video files.