This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Does Socio-Technical Congruence Have an Effect on Software Build Success? A Study of Coordination in a Software Project
May/June 2011 (vol. 37 no. 3)
pp. 307-324
Socio-technical congruence is an approach that measures coordination by examining the alignment between the technical dependencies and the social coordination in the project. We conduct a case study of coordination in the IBM Rational Team Concert project, which consists of 151 developers over seven geographically distributed sites, and expect that high congruence leads to a high probability of successful builds. We examine this relationship by applying two congruence measurements: an unweighted congruence measure from previous literature, and a weighted measure that overcomes limitations of the existing measure. We discover that there is a relationship between socio-technical congruence and build success probability, but only for certain build types, and observe that in some situations, higher congruence actually leads to lower build success rates. We also observe that a large proportion of zero-congruence builds are successful, and that socio-technical gaps in successful builds are larger than gaps in failed builds. Analysis of the social and technical aspects in IBM Rational Team Concert allows us to discuss the effects of congruence on build success. Our findings provide implications with respect to the limits of applicability of socio-technical congruence and suggest further improvements of socio-technical congruence to study coordination.

[1] M. Cataldo, P.A. Wagstrom, J.D. Herbsleb, and K.M. Carley, "Identification of Coordination Requirements: Implications for the Design of Collaboration and Awareness Tools," Proc. Conf. Computer-Supported Cooperative Work, Oct. 2006.
[2] K. Ehrlich, M. Helander, G. Valetto, S. Davies, and C. Williams, "An Analysis of Congruence Gaps and Their Effect on Distributed Software Development," Proc. Socio-Technical Congruence Workshop at ICSE Conf., 2008.
[3] I. Kwan, A. Schröter, and D. Damian, "A Weighted Congruence Measure," Proc. Socio-Technical Congruence Workshop at ICSE Conf., 2009.
[4] S. Sawyer, "Software Development Teams," Comm. ACM, vol. 47, no. 12, pp. 95-99, 2004.
[5] C.R.B. de Souza and D.F. Redmiles, "An Empirical Study of Software Developers' Management of Dependencies and Changes," Proc. Int'l Conf. Software Eng., May 2008.
[6] A.H.V.D. Ven, A.L. Delbecq, and J. Richard Koenig, "Determinants of Coordination Modes within Organizations," Am. Sociological Rev., vol. 41, no. 2, pp. 322-338, 1976.
[7] R. Kraut and L. Streeter, "Coordination in Software Development," Comm. ACM, vol. 38, no. 3, pp. 69-81, Mar. 1995.
[8] J. Holck and N. Jørgensen, "Continuous Integration and Quality Assurance: A Case Study of Two Open Source Projects," Australasian J. Information Systems, vol. 11, no. 1, pp. 40-53, 2003/2004.
[9] D. Damian, L. Izquierdo, J. Singer, and I. Kwan, "Awareness in the Wild: Why Communication Breakdowns Occur," Proc. Int'l Conf. Global Software Eng., pp. 81-90, Aug. 2007.
[10] M.A. Cusumano and R.W. Selby, "How Microsoft Builds Software," Comm. ACM, vol. 40, no. 6, pp. 53-61, 1997.
[11] J.D. Herbsleb, "Global Software Engineering: The Future of Socio-Technical Coordination," Proc. Future of Software Eng., pp. 188-198, 2007.
[12] T. Browning, "Applying the Design Structure Matrix to System Decomposition and Integration Problems: A Review and New Directions," IEEE Trans. Eng. Management, vol. 48, no. 3, pp. 292-306, Aug. 2001.
[13] R.M. Henderson and K.B. Clark, "Architectural Innovation: The Reconfiguration of Existing Product Technologies and the Failure of Established Firms," Administrative Science Quarterly, vol. 35, pp. 9-30, Mar. 1990.
[14] A. Sarma, J. Herbsleb, and A. von der Hoek, "Challenges in Measuring, Understanding, and Achieving Socio-Technical Congruence," Proc. Socio-Technical Congruence Workshop at ICSE Conf., May 2008.
[15] P. Hinds and C. McGrath, "Structures that Work: Social Structure, Work Structure and Coordination Ease in Geographically Distributed Teams," Proc. Conf. Computer Supported Cooperative Work, pp. 343-352, 2006.
[16] J. Herbsleb and A. Mockus, "An Empirical Study of Speed and Communication in Globally Distributed Software Development," IEEE Trans. Software Eng., vol. 29, no. 6, pp. 481-494, June 2003.
[17] R. Frost, "Jazz and the Eclipse Way of Collaboration," IEEE Software, vol. 24, no. 6, pp. 114-117, Nov./Dec. 2007.
[18] M. Conway, "How Do Committees Invent," Datamation, vol. 14, no. 4, pp. 28-31, 1968.
[19] M.E. Sosa, S.D. Eppinger, and C.M. Rowles, "The Misalignment of Product Architecture and Organizational Structure in Complex Product Development," Management Science, vol. 50, no. 12, pp. 1674-1689, 2004.
[20] G. Valetto, S. Chulani, and C. Williams, "Balancing the Value and Risk of Socio-Technical Congruence," Proc. Socio-Technical Congruence Workshop at ICSE Conf., May 2008.
[21] S. Carter, J. Mankoff, and P. Goddi, "Building Connections among Loosely Coupled Groups: Hebb's Rule at Work," Computer Supported Cooperative Work, vol. 13, nos. 3/4, pp. 305-327, 2004.
[22] S. Marczak, D. Damian, U. Stege, and A. Schröter, "Information Brokers in Requirement-Dependent Social Networks," Proc. Int'l Conf. Requirements Eng., Sept. 2008.
[23] K. Ehrlich and K. Chang, "Leveraging Expertise in Global Software Teams: Going Outside Boundaries," Proc. Int'l Conf. Global Software Eng., pp. 149-158, Oct. 2006.
[24] K. Nakakoji, Y. Ye, and Y. Yamamoto, Supporting Expertise Communication in Developer-Centered Collaborative Software Development Environments. Springer-Verlag, 2010.
[25] J.A. Espinosa, S.A. Slaughter, R.E. Kraut, and J.D. Herbsleb, "Team Knowledge and Coordination in Geographically Distributed Software Development," J. Management Information Systems, vol. 24, no. 1, pp. 135-169, 2007.
[26] S. Faraj and L. Sproull, "Coordinating Expertise in Software Development Teams," Management Science, vol. 46, no. 12, pp. 1554-1568, 2000.
[27] D.E. Perry, N.A. Staudenmayer, and L.G. Votta, "People, Organizations, and Process Improvement," IEEE Software, vol. 11, no. 4, pp. 36-45, July 1994.
[28] J.D. Herbsleb and R.E. Grinter, "Architectures, Coordination, and Distance: Conway's Law and Beyond," IEEE Software, vol. 16, no. 5, pp. 63-70, Sept./Oct. 1999.
[29] C.R.B. de Souza and D. Redmiles, "The Awareness Network: To Whom Should I Display My Actions? And, Whose Actions Should I Monitor?" Proc. European Conf. Computer Supported Cooperative Work, Sept. 2007.
[30] A.J. Ko, R. DeLine, and G. Venolia, "Information Needs in Collocated Software Development Teams," Proc. Int'l Conf. Software Eng., pp. 344-353, 2007.
[31] T. Wolf, A. Schröter, D. Damian, and T. Nguyen, "Predicting Build Failures Using Social Network Analysis on Developer Communication," Proc. Int'l Conf. Software Eng., pp. 1-11, May 2009.
[32] J.D. Herbsleb, A. Mockus, T.A. Finholt, and R.E. Grinter, "An Empirical Study of Global Software Development: Distance and Speed," Proc. 23rd Int'l Conf. Software Eng., pp. 81-90, 2001.
[33] C. Bird, N. Nagappan, P. Devanbu, H. Gall, and B. Murphy, "Does Distributed Development Affect Software Quality? An Empirical Case Study of Windows Vista," Proc. Int'l Conf. Software Eng., pp. 518-528, May 2009.
[34] N. Nagappan, B. Murphy, and V. Basili, "The Influence of Organizational Structure on Software Quality: An Empirical Case Study," Proc. Int'l Conf. Software Eng., pp. 521-530, May 2008.
[35] M. Cataldo and S. Nambiar, "Quality in Global Software Development Projects: A Closer Look at the Role of Distribution," Proc. Int'l Conf. Global Software Eng., pp. 163-172, July 2009.
[36] T. Nguyen, T. Wolf, and D. Damian, "Global Software Development and Delay: Does Distance Still Matter?" Proc. Int'l Conf. Global Software Eng., pp. 45-54, Aug. 2008.
[37] T. Niinimäki and C. Lassenius, "Experiences of Instant Messaging in Global Software Development Projects: A Multiple Case Study," Proc. Int'l Conf. Global Software Eng., pp. 55-64, July 2008.
[38] M. Cataldo, J.D. Herbsleb, and K.M. Carley, "Socio-Technical Congruence: A Framework for Assessing the Impact of Technical and Work Dependencies on Software Development Productivity," Proc. Symp. Empirical Software Eng. Measurement, 2008.
[39] C.R.B.d. de Souza, D. Redmiles, L.-T. Cheng, D. Millen, and J. Patterson, "How a Good Software Practice Thwarts Collaboration: The Multiple Roles of APIs in Software Development," Proc. Symp. Software Eng. Notes, pp. 221-230, 2004.
[40] B. Gokpinar, W.J. Hopp, and S.M.R. Iravani, "The Impact of Misalignment of Organizational Structure and Product Architecture on Quality in Complex Product Development," Management Science, vol. 56, pp. 468-484, http://mansci.journal.informs.org/cgi/content/ abstract/56/3468, 2010.
[41] M. Sosa, "A Structured Approach to Predicting and Managing Technical Interactions in Software Development," Research in Eng. Design, vol. 19, no. 1, pp. 47-70, 2008.
[42] D. Damian, I. Kwan, and S. Marczak, "Requirements-Driven Collaboration: Leveraging the Invisible Relationships between Requirements and People," Collaborative Software Eng., J. Whitehead, I. Mistrík, J. Grundy, and A. van der Hoek, eds., pp. 57-76, Springer-Verlag, 2010.
[43] S. Marczak, I. Kwan, and D. Damian, "Investigating Collaboration Driven by Requirements Investigating Collaboration Driven by Requirements in Cross-Functional Software Teams," Proc. Collaboration and Intercultural Issues on Requirements: Comm., Understanding and Softskills, Aug. 2009.
[44] T. Wolf, A. Schröter, D. Damian, L.D. Panjer, and T.H. Nguyen, "Mining Task-Based Social Networks to Explore Collaboration in Software Teams," IEEE Software, vol. 26, no. 1, pp. 58-66, Jan./Feb. 2009.
[45] D. Damian, S. Marczak, and I. Kwan, "Collaboration Patterns and the Impact of Distance on Awareness in Requirements-Centered Social Networks," Proc. Int'l Requirements Eng. Conf., Oct. 2007.
[46] L. Hossain, A. Wu, and K.K.S. Chung, "Actor Centrality Correlates to Project Based Coordination," Proc. Conf. Computer-Supported Cooperative Work, 2006.
[47] A. Mockus, R.T. Fielding, and J.D. Herbsleb, "Two Case Studies of Open Source Software Development: Apache and Mozilla," ACM Trans. Software Eng. Methodology, vol. 11, no. 3, pp. 309-346, 2002.
[48] G. Valetto, M. Helander, K. Ehrlich, S. Chulani, M. Wegman, and C. Williams, "Using Software Repositories to Investigate Socio-Technical Congruence in Development Projects," Proc. Int'l Conf. Software Engineering Workshops, 2007.
[49] The R Project for Statistical Computing. http:/www.r-project. org/, 2011.
[50] Design: Design Package. http://cran.r-project.org/web/packages/Design index.html, 2011.
[51] A. MacCormack, J. Rusnak, and C.Y. Baldwin, "Exploring the Structure of Complex Software Designs: An Empirical Study of Open Source and Proprietary Code," Management Science, vol. 52, no. 7, pp. 1015-1030, July 2006.
[52] K. Schmidt and C. Simone, "Coordination Mechanisms: Toward a Conceptual Foundation of CSCW Systems Design," Computer Supported Cooperative Work, vol. 5, pp. 155-200, 1996.
[53] F. Bolici, J. Howison, and K. Crowston, "Coordination without Discussion? Socio-Technical Congruence and Stigmergy in Free and Open Source Software Projects," Proc. Int'l Workshop Socio-Technical Congruence, May 2009.
[54] C. Gutwin, R. Penner, and K. Schneider, "Group Awareness in Distributed Software Development," Proc. Conf. Computer-Supported Cooperative Work, pp. 72-81, Nov. 2004.

Index Terms:
software development management,social aspects of automation,weighted measure,socio-technical congruence,software build success,software project,social coordination,congruence measurements,unweighted congruence measure,Software,Weight measurement,Programming,Software measurement,Collaboration,Software engineering,Context,integration.,Empirical software engineering,socio-technical congruence,coordination,awareness,software quality
Citation:
"Does Socio-Technical Congruence Have an Effect on Software Build Success? A Study of Coordination in a Software Project," IEEE Transactions on Software Engineering, vol. 37, no. 3, pp. 307-324, May-June 2011, doi:10.1109/TSE.2011.29
Usage of this product signifies your acceptance of the Terms of Use.