Visual representations are becoming more important for teaching, learning and communicating. This paper argues that a more profound understanding of the "vision competencies" constituting "Visual Literacy" will enable practitioners and researchers alike to produce more effective knowledge visualizations. The main contribution of this paper is to identify some of the core competencies of a visually literate person, by examining the abilities tested in visual intelligence tests.