In this paper, we discuss about massively multi-agent coordination mechanisms, which must be necessary for upcoming applications in ubiquitous computing environment. In this situation, each agent cannot have a macroscopic view, so, the agents cannot obtain the global information of the agents as a whole. But, each agent behavior indirectly influences the other agents behaviors and their behaviors influence its behavior cyclically. Therefore a certain information about the relative position of each agent among all the agents may be able to be extracted from both each agent behavior and relativity of behaviors between agents. We verified this possibility by using the competitive multi-agent simulation environment, and firstly succeeded in extracting the information for the relative position from each agent behavior. Then we succeeded to extract the relativity of behaviors between agents as the "agent coordination network", which had the characteristics of both scale free network and small world network.