Despite active research in Virtual and Augmented Reality, the emerging new technology of Augmented Virtuality (AV) has rarely been explored in the architecture arena. Augmented Virtuality, where a predominantly virtual environment is enhanced by the addition of real entities, provides a means to merge richly layered, multi-modal, 3D real context and experience acquired from the real world into virtual architectural designs. There are no noted investigations on principles of implementing AV concept in the context of architectural design with the purpose of maximizing its full potentials. This paper discusses issues and approaches in establishing scientific principles for applying AV technology in supporting architectural design comprehension. As an initial effort towards those issues, the paper also formulates a comprehensive taxonomy for specifying AV technology for architectural applications.