Posted by Are Agile/DevOps Programs Doing Enough Systems Engineering?
From the Journal of Cost Analysis and Parametrics: Volume 10 | Issue 3 | November 2022
Downloadable File: JCAPv10i3-AgileDevOpsProgramsEnoughSystemsEngineering-Hira
Abstract: Agile and DevOps methodologies offer efficient processes to deliver high quality products and deploy them to the users quickly. Many commercial organizations have reported large savings in cost and increased productivity from implementing Agile and DevOps methodologies. MITRE completed a qualitative study of the cost impacts as a result of applying Agile methodologies and expected the Systems Engineering, Integration and Test, and Program Management (SEITPM) costs would either remain the same or slightly increase for Agile programs compared to Waterfall programs (Manring, 2016). However, this paper later demonstrates that data from Space Ground systems suggest that the SEITPM costs (as an entity) are approximately 30% lower for Agile/DevOps programs compared to Waterfall programs. In this research study, I analyze whether the difference in SEITPM costs between Agile/DevOps and Waterfall programs is statistically significant by comparing the means and evaluating the statistical significance of including a categorical variable in a regression. The results indicate that the decrease in SEITPM costs for Agile/DevOps programs is statistically significant. Reduced systems engineering could potentially lead to troubles while implementing the architecture/design or in the product quality of the completed system. Some examples of possible troubles are missing requirements, interface, and integration issues with other software and/or hardware modules/components, latent defects in the code, and high defect rates. To understand whether the reduced SEITPM costs has any adverse effects, I also conduct a survey with major industry prime contractors to determine if their observations reflect Space Ground systems data, what caused the reduction in SEITPM costs, and if they noticed any positive or negative changes in product quality as an effect. In general, organizations have experienced changes in SEITPM activities but have not experienced adverse effects in product quality as a result. Fortunately, Agile and DevOps methodologies provide a way to reduce costs without negative effects on the product’s quality.
Author: Anandi Hira is currently a Data Scientist/Researcher at the Carnegie Mellon University Software Engineering Institute (CMU SEI). Previously, Anandi performed several Agile and software cost estimation research projects as a cost analyst at Tecolote Research Inc. She received her PhD in software cost estimation under Dr. Barry Boehm at University of Southern California (USC), where she collected data and calibrated the COCOMO® II model to include functional size metrics. Her research interests include software metrics and its application to project management, software cost estimation, and software process improvement.