A conceptual framework for SPI evaluation
by M. Unterkalmsteiner, T. Gorschek, A.K.M. Moinul Islam, C.K. Cheng, R.B. Permadi and R. Feldt
Software Process Improvement (SPI) encompasses the analysis and modification of the processes within software development, aimed at improving key areas that contribute to the organizations’ goals. The task of evaluating whether the selected improvement path meets these goals is challenging. Based on the results of a systematic literature review on SPI measurement and evaluation practices, we developed a framework (SPI-MEF) that supports the planning and implementation of SPI evaluations. SPI-MEF guides the practitioner in scoping the evaluation, determining measures and performing the assessment. SPI-MEF does not assume a specific approach to process improvement and can be integrated in existing measurement programs, refocusing the assessment on evaluating the improvement initiative’s outcome. Sixteen industry and academic experts evaluated the framework’s usability and capability to support practitioners, providing additional insights that were integrated in the application guidelines of the framework.


  author =    {Michael Unterkalmsteiner and Tony Gorschek and A.K.M. Moinul Islam and Chow Kian Cheng and Rahadian Bayu Permadi and Robert Feldt},
  title =     {A conceptual framework for SPI evaluation},
  year =      {2013},
  month =     "September",
  journal =   {Journal of Software Maintenance and Evolution: Research and Practice},
  volume =    "26",
  issue =     "2",
  pages =     "251-279",
  publisher = {Wiley},
  keywords =  {Process implementation and change; Process measurement; Metrics/Measurement},
  url =       "",
  url =       "",