In this paper, we present a multimedia map database system. The system is mainly employed for acquisition, storage and retrieval of the real-world urban images with viewpoint information. Here, the images and the viewpoint information are assumed to be collected from the mobile multimedia terminal users. By using the viewpoint information in the database system, an "Extended Visual Map" is proposed for presenting the images according to the actual viewpoint of any user; also a position information service is implemented to retrieval the map information by building images. To realize these objectives, the features of the regions containing a building in every real-world urban image are extracted and compared automatically by the proposed system.