This paper presents a framework for aggregating and updating use activity data (called user profile in this paper) recognized by a cell phone equipped with active RFID transmitter/receiver. Each component of user profile information comes from a different source and is combined each other at the Profile Aggregator (PA), which is user profile management server. In the PA, a piece of information is connected to other related information and this info-linkage facilitates the retrieval of detailed information easily. This function has been implemented based on semantic web technology. The PA has also an important role of privacy control in terms of disseminating a subset of user profile, including a query interface, trigger interface. And we finally describe "Profile Blog," which is a visualization service of aggregated user profile, and a cell phone application called "Remembrance Viewer" through which the past user activities at each location can be seen.