A Review on the Methods of Evaluating the New Approaches Proposed in the Agile Context
DOI:
https://doi.org/10.24203/ijcit.v10i1.54Keywords:
Agile methods; evaluation, new approach; review; software engineeringAbstract
In the recent years, Agile is being one of the emerging technologies adopted by numerous organizations. The Agile methods have not received a wide acceptance within the software development organizations (SDOs), but they are also being extensively employed in different fields and environments. Accordingly, new approaches have been proposed by researchers and practitioners based on the Agile context, however, there is scarce and – sometimes - absence of describing the evaluation process of these approaches. Therefore, this paper reports the findings of an extensive literature search on how the new proposed approaches are being evaluated. The narrative review methodology was employed to criticize and summarize a body of literature retrieved from various scientific sources. The results reveal that there are various methods used for evaluating the proposed Agile approaches. Nevertheless, this review focuses on explaining the five common methods, which are: (1) case study, (2) survey, (3) interview, (3) focus group, and (5) expert review. Thereafter, the authors discuss the key findings and highlight directions for future researches. This study tends to help researchers and practitioners to select the suitable evaluation methods when constructing new Agile approaches.
References
A. T. Al Ajeeli, “A framework for software development product methodology management,” International Journal of Emerging Trends & Technology in Computer Science (IJETTCS), vol. 5, pp. 43-57, July - August 2016.
I. Sommerville, Software Engineering, 10th ed. Harlow, United Kingdom: Pearson Education, 2016.
H. Alaidaros, M. Omar, and R. Romli, “Towards an improved software project monitoring task model of Agile Kanban method,” International Journal of Supply Chain Management (IJSCM), vol. 7, pp. 118-125, 2018.
Global Project Management, “Success in Disruptive Times, 10th Global Project Management Survey “Newtown Square: Project Management Institute, Inc2018.
Version One. (2018, 10 Feb 2019). 12th Annual State of Agile Development Survey.
Interop ITX Research Report. (2017, 22 Oct 2017). State of DevOps. Available: http://www.interop.com/
V. Bhatt, S. Chakraborty, and T. Chakravorty, “Importance of Digitech Adoption for Providing Efficient Healthcare Services during COVID-19,” International Journal on Emerging Technologies, vol. 11, pp. 01-13, 2020.
H. Alaidaros and M. Omar, “Software Project Management Approaches for Monitoring Work-In-Progress: A Review,” Journal of Engineering and Applied Sciences, vol. 12, pp. 3851-3857, 2017.
N. Nawaz and A. M. Gomes, “EDITTDA Approach for Agile Human Resource Performance in Bangalore Software Industry.,” International Journal on Emerging Technologies, vol. 10, pp. 413-417, 2019.
H. Alaidaros, M. Omar, and R. Romli, “The Key Factors of Evaluating Agile Approaches: A Systematic Literature Review,” International Journal of Supply Chain Management (IJSCM), vol. 8, pp. 954-964, 2019.
E. Papadakis and L. Tsironis, “Hybrid methods and practices associated with Agile methods, method tailoring and delivery of projects in a non-software context,” Procedia computer science, vol. 138, pp. 739-746, 2018.
V. Dattatreya, K. C. Rao, and V. Rayudu, “Applying Agile programming and design patterns in IT domain,” in Emerging Trends in Electrical, Communications and Information Technologies, Singapore, 2017, pp. 71-78.
V. B. Silva, F. Schramm, and A. C. Damasceno, “A multicriteria approach for selection of agile methodologies in software development projects,” in 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, 2016, pp. 002056-002060.
H. Alaidaros, M. Omar, and R. Romli, “A Theoretical Framework for Improving Software Project Monitoring Task of Agile Kanban Method,” in Recent Trends in Data Science and Soft Computing. IRICT 2018. Advances in Intelligent Systems and Computing. vol. 843, F. Saeed, N. Gazem, F. Mohammed, and A. Busalim, Eds., ed: Springer, Cham, 2019, pp. 1090-1099.
A. L. Ramos, J. V. Ferreira, and J. Barceló, “Model-based systems engineering: An emerging approach for modern systems,” Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 42, pp. 101-111, 2012.
H. Alaidaros, M. Omar, and R. Romli, “Improving the progress monitoring task of agile Kanban Method: An enhanced theoretical framework and its implication,” International Journal of Scientific and Technology Research (IJSTR), vol. 9, pp. 611-615, 2020.
H. AlDarmaki, A. Bhaumik, and I. AlRajawy, “Effect of Total Quality Management Practices in Private Organization in the UAE,” International Journal on Emerging Technologies, vol. 10, pp. 115-123, 2019.
H. Alaidaros, M. Omar, and R. Romli, “Identification of criteria affecting software project monitoring task of Agile Kanban method,” presented at the AIP Conference Proceedings, 2018.
L. A. Machi and B. T. McEvoy, The literature review: Six steps to success. United States: Corwin Press, 2016.
C. Auerbach and L. B. Silverstein, Qualitative data: An introduction to coding and analysis. USA: New York University press, 2003.
K. Krippendorff, Content analysis: An introduction to its methodology. United States: SAGE Publications, Inc, 2018.
J. W. Creswell, Research design: Qualitative, quantitative, and mixed methods approaches, 4th ed. Thousand Oaks, California: SAGE Publications, Inc., 2016.
S. Easterbrook, J. Singer, M.-A. Storey, and D. Damian, “Selecting empirical methods for software engineering research,” in Guide to advanced empirical software engineering, ed: Springer, 2008, pp. 285-311.
R. K. Yin, Case study research and applications: Design and methods, 6th ed. Thousand Oaks, United States: SAGE Publications, Inc, 2018.
R. Malhotra, Empirical research in software engineering: concepts, analysis, and applications. United States: CRC Press, 2016.
M. H. A. Altarawneh, “Monitoring oriented Agile based web applications development methodology for small software firms in Jordan,” PhD Thesis, UUM, 2016.
R. Hannemann, “Modifying senior design: A design review,” in American Society for Engineering Education Annual Conference and Exposition 2009, Austin, Texas, USA, 2009, pp. 10560-10568.
F. Malik, “Syntegrating city management,” in Institutional and Social Innovation for Sustainable Urban Development. vol. 258, ed: ROUTLEDGE in association with GSE Research, 2013, pp. 258-274.
U. Sekaran and R. J. Bougie, Research methods for business: A skill building approach, 7th ed. United States: Wiley, 2016.
R. Lovreglio, E. Ronchi, and M. J. Kinsey, “An Online Survey of Pedestrian Evacuation Model Usage and Users,” Fire Technology, vol. 56, pp. 1133-1153, 2019.
R. N. Pahurkar, B. V. Sangvikar, K. Khadke, and A. Kolte, “An Exploratory Study of Important Dimensions in Strengthening Buyer-Supplier Relationship. ,” International Journal on Emerging Technologies, vol. 11, pp. 803-810, 2020.
H. Alaidaros, Omar, M., Romli, R., Hussein, A., “The Development and Evaluation of A Progress Monitoring Prototype Tool for Software Project Management,” presented at the 2019 First International Conference of Intelligent Computing and Engineering (ICOICE), Hadhramout, Yemen, 2019.
P. Eriksson and A. Kovalainen, Qualitative methods in business research. United States: SAGE Publications, Inc, 2008.
H. Alaidaros, M. Omar, and H. H. Abdullah, “Requirements Modeling for University e-Ranking Dashboard System (e-RDS),” Journal of Engineering and Applied Sciences, vol. 12, pp. 6362-6370, 2017.
M. C. Harrell and M. A. Bradley, “Data collection methods. Semi-structured interviews and focus groups,” DTIC Document2009.
J. Bräuer, R. Plösch, M. Saft, and C. Körner, “Measuring object-oriented design principles: The results of focus group-based research,” Journal of Systems and Software, vol. 140, pp. 74-90, 2018.
S. F. P. Mohamed, F. Baharom, A. Deraman, and Y. Yusof, “The validation of extended software process assessment and certification model using focus group,” in Proceeding of the First International Conference on ICT for Transformation (IC-ICT4T 2016), Kota Kinabalu, Sabah, Malaysia, 2016, pp. 192-197.
A. Bhat. (2018, 16 Sept 2019). Qualitative research: Definition, types, methods and examples. Available: https://www.questionpro.com/blog/qualitative-research-methods/
J. Kontio, J. Bragge, and L. Lehtola, “The focus group method as an empirical tool in software engineering,” in Guide to advanced empirical software engineering, ed: Springer, 2008, pp. 93-116.
J. Singer, S. E. Sim, and T. C. Lethbridge, “Software engineering data collection for field studies,” in Guide to Advanced Empirical Software Engineering, ed: Springer, 2008, pp. 9-34.
S. F. P. Mohamed, “A process based approach software certification model for Agile and secure environment,” PhD Thesis, UUM, 2015.
R. A. Krueger and M. A. Casey, Focus groups: A practical guide for applied research. United States: SAGE Publications, Inc, 2014.
V. Wibeck, Focus groups: Focused group interviews as a research method. Lund, Sweden: Studentlitteratur AB, 2010.
J. K. Hummelvoll, “The multistage focus group interview: A relevant and fruitful method in action research based on a co-operative inquiry perspective,” Norsk Tidsskrift for Sykepleieforskning, vol. 10, pp. 3-14, 2008.
T. Nyumba, K. Wilson, C. J. Derrick, and N. Mukherjee, “The use of focus group discussion methodology: Insights from two decades of application in conservation,” Methods in Ecology and evolution, vol. 9, pp. 20-32, 2018.
D. L. Morgan, Focus groups as qualitative research, 2nd ed. Thousand Oaks, California, USA: SAGE Publications, Inc, 1996.
H. F. Atlam, A. Alenezi, R. K. Hussein, and G. B. Wills, “Validation of an adaptive risk-based access control model for the Internet of Things,” International Journal of Computer Network and Information Security, vol. 10, pp. 26-35, 2018.
S. M. Sarif, N. Ibrahim, and N. Shiratuddin, “Design model of computerized personal decision aid for youth: An expert review,” in AIP Conference Proceedings, Kedah, Malaysia, 2016.
S. A. Aziz, S. N. A. Salam, A. A. Mutalin, and S. Ismail, “Validating an integrated multimedia presentation conceptual model through expert reviews,” Journal of Telecommunication, Electronic and Computer Engineering (JTEC), vol. 8, pp. 161-163, 2016.
E. DeKock, J. Van Biljon, and A. Botha, “User experience of academic staff in the use of a learning management system tool,” in the Annual Conference of the South African Institute of Computer Scientists and Information Technologists (SAICSIT 2016), Johannesburg, South Africa, 2016, pp. 15-25.
M. Omar, H. Alaidaros, and R. Romli, “An Improved Software Project Monitoring Task Model of Agile Kanban Method: A Practitioners’ Perspective,” International Journal on Advanced Science, Engineering and Information Technology, vol. 10, pp. 120-127, 2020.
B. Shneiderman, C. Plaisant, M. Cohen, S. Jacobs, N. Elmqvist, and N. Diakopoulos, Designing the user interface: Strategies for effective human-computer interaction, 6th ed. Hoboken, United States: Pearson Education Inc., 2016.
R. Molich, & Jeffries, R., “Comparative expert reviews,” presented at the CHI'03 Extended Abstracts on Human Factors in Computing Systems, Lauderdale, USA, 2003.
Downloads
Published
Issue
Section
License
Copyright (c) 2021 Hamzah Alaidaros
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
The articles published in International Journal of Computer and Information Technology (IJCIT) is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
