Representing, associating, interpreting and learning behavioral patterns and rules from observation is always a challenging research problem for cognitive systems and human computer interaction. This problem becomes more difficult in complex environments with many unexpected behavioral patterns from objects, or cells, or individuals or small group of people acting under certain plans at the same time in different locations. This paper targets the development of a novel synergistic methodology for automatically monitoring, representing,, associating and interpreting behavioral patterns and activities, and learning rules from complex environments using videos.