The rapidly increasing number of image collections onthe Internet require improvements in our image retrieval systems if these collections are to be easily available forbrowsing and searching by information seekers. Current techniques for image retrieval have known shortcomings that make it difficult to search for images based on their semantic content. We propose that an increased use of image context information can improve identification of image semantics, and may thus contribute to closing the gap between user needs for semantic image retrieval and the capabilities of current image retrieval systems. In this paper we present a new category of image context, called Usage Context, describe how Usage Context from multiple source scan be combined, and show how Usage Context information can be specified using a new context descriptor vocabulary CTXT.