This Article 
 Bibliographic References 
 Add to: 
Experience Using Web-Based Shotgun Measures for Large-System Characterization and Improvement
April 1998 (vol. 24 no. 4)
pp. 268-277

Abstract—This article discusses our experience in using a World Wide Web-based shotgun measurement approach for mining and characterizing large software systems. The approach recognizes that measurement information is essentially management information, that different levels and functions of the organizational hierarchy require different information to make decisions, and that a measurement program is typically a discovery process about an organization's current modes of operations. What we found was the usefulness of a measurement program that also allows managers to dynamically formulate new goals and get answers to questions not specifically related to original goals but raised nonetheless by metric data. We describe three specific cases of decisions that were made using this approach and data collected from one large system and accessed using the company's intranet over the past two years.

[1] L. Belady and M. Lehman, "A Model of Large Program Development," IBM Systems J., no. 3, pp. 225-252, 1976.
[2] V.R. Basili and H.D. Rombach, "The TAME Project: Towards Improvement-Oriented Software Environments," IEEE Trans. Software Eng., Vol. 14, No. 6, 1988, pp. 758-773.
[3] V. Basili and H.D. Rombach, "Tailoring the Software Process to Project Goals and Environments," Proc. Ninth Int'l Conf. Software Eng., pp. 345-357, 1987.
[4] J. Canning, "The Application of Software Metrics to Large-Scale Systems," PhD dissertation, Virginia Polytechnic Inst., Apr. 1985.
[5] R.E. Courtney and D.A. Gustafson, “Shotgun Correlations in Software Measures,” Software Eng. J., vol. 8, no. 1, pp. 5-13, 1992.
[6] M.K. Daskalantonakis, "A Practical View of Software Management and Implementation Experiences within Motorola," IEEE Trans. Software Eng. Vol. 18, No. 11, 1992, pp. 998-1009.
[7] P. Devanbu, "GENOA—A Customizable, Language and Front-End Independent Code Analyzer," Proc. 14th Int'l Conf. Software Eng., May 1992.
[8] P. Devanbu, "On 'A Framework for Source Code Search Using Program Patterns'," IEEE Trans. Software Eng., vol. 21, pp. 1,009-1,010, Dec. 1995.
[9] N. Fenton, "Software Measurement: A Necessary Scientific Bias," IEEE Trans. Software Eng., vol. 20, pp. 199-206, Mar. 1994.
[10] D.R. Jeffery, G.C. Low, and M. Barnes, "A Comparison of Function Point Counting Techniques," IEEE Trans. Software Eng., vol. 19, no. 5, pp. 529-532, 1993.
[11] B.A. Kitchenham, S.L. Pfleeger, and N. Fenton, “Towards a Framework for Software Measurement Validation,” IEEE Trans. Software Eng., vol. 21, no. 12, pp. 929-944, Dec. 1995.
[12] D. Kafura and G. Reddy, "The Use of Software Complexity Metrics in Software Maintenance," IEEE Trans. Software Eng., vol. 13, no. 3, pp. 335-343, Mar. 1987.
[13] S. Paul and A. Prakash, "A Framework for Source Code Search Using Program Patterns," IEEE Trans. Software Eng., vol. 20, no. 6, pp. 463-474, June 1994.
[14] S. Rosenbaum and B. Du Castel, "Managing Software Reuse-An Experience Report," Proc. 17th Ann. Int'l Conf. Software Eng.Los Alamitos, Calif.: IEEE CS Press, 1995.
[15] N. Schneidewind, "Methodology for Validating Software Metrics," IEEE Trans. Software Eng., vol. 18, pp. 410-421, May 1992.
[16] G. Stark and R.C. Durst, "Using Metrics in Management Decision Making," Computer, pp. 42-48, Sept. 1994.
[17] J. Tian and M.V. Zelkowitz, "Complexity Measure Evaluation and Selection," IEEE Trans. Software Eng., vol. 21, pp. 641-650, Aug. 1995.
[18] C. Walrad and E. Moss, "Measurement: The Key to Application Development Quality," IBM Systems J., vol. 32, pp. 445-460, 1993.
[19] M. Wasmund, "Implementing Critical Success Factors in Software Reuse," IBM Systems J., vol. 32, p. 606, 1993.
[20] E.F. Weller, "Using Metrics to Manage Software Projects," Computer, Sept. 1994, pp. 27-34.
[21] H. Wohlwend and S. Rosenbaum, "Schlumberger's Software Improvement Program," IEEE Trans. Software Eng., vol. 36, pp. 833-839, Nov. 1994.

Index Terms:
Characterization, implementation experience, goal/question/metric paradigm, improvement paradigm, software mining, multidimensional view of measurement, practical view of measurement, software metrics, shotgun measures, software reuse, process improvement, scientific visualization, intranet, internet-based applications, World Wide Web, Java.
Sam McLellan, Al Roesler, Zongming Fei, Savita Chandran, Clay Spinuzzi, "Experience Using Web-Based Shotgun Measures for Large-System Characterization and Improvement," IEEE Transactions on Software Engineering, vol. 24, no. 4, pp. 268-277, April 1998, doi:10.1109/32.677184
Usage of this product signifies your acceptance of the Terms of Use.