Augmented Reality (AR) systems suitable for use in everyday situations should not intrude unduly on their user?s lifestyle (or that of others around them). This paper argues that such systems should make use of technologies and devices such as mobile phones, PDAs, and portable entertainment units that people are likely to be already using for other purposes. However, such devices have limited capabilities, which present challenges when designing a system for interaction with a 3D world.

This paper describes a prototype lightweight AR system built from off-the-shelf components and discusses some of the techniques we are developing to enable effective interaction with the system.