We survey our research on verbal and nonverbal interactions between meeting participants. The participants meet in a smart environment where their activities are captured and interpreted by the environment. In this way the environment not only allows off-line access and retrieval of meeting information, but also real-time support of meeting activities. Since in our research our aim is to have real-time transformation of activities in the physical meeting environment to a virtual meeting environment, we also design our environment to allow real-time participation by remote meeting participants and by intelligent virtual meeting assistants that can support the meeting participants.