Software quality is of utmost importance to the financial sector. Software testing plays a critical role in achieving software product quality. Financial institutions benefit from rigorous testing by having confidence in the reliability and performance of the software. This can lead to improved customer experience, increased operational efficiency, and reduced risks of system failures or security breaches. A questionnaire-based survey was designed and subsequently an international survey was conducted involving sixty financial institutions, e.g., banking, insurance companies and pension funds, from across the globe to understand their level of test maturity. As a reference framework against which to measure their test maturity, the Test Maturity Model integration (TMMi) was used. In this paper their motivations for doing test process improvement and the benefits they achieved are discussed. Concrete examples of the benefits achieved are provided. The role of test automation with test process improvement at the financial institutions is also reported upon in this paper. The most common level of test maturity achieved, measured against the TMMi, is TMMi level 3 “Defined” which represents a more than average level of test maturity. Benefits are reported by the financial institutions, especially in the areas of software quality and testing productivity. The benefits achieved show a high level of correlation with the motivations for investing in test process improvement. Almost all of financial institutions also use test automation to improve their testing in parallel with process improvement, with test automation at system level being by far the most popular.
Published in | American Journal of Computer Science and Technology (Volume 7, Issue 2) |
DOI | 10.11648/j.ajcst.20240702.13 |
Page(s) | 43-50 |
Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
Copyright |
Copyright © The Author(s), 2024. Published by Science Publishing Group |
Banking, Financial Domain, Insurance, Test Maturity Model Integration, TMMi, Test Process Improvement, Software Quality, Software Testing
[1] | TMMi Foundation. TMMi model specification (reference model), release 1.3. 2022 |
[2] | TMMi Foundation. TMMi 2nd worldwide user survey, version 1.2. 2023 |
[3] | TMMi Foundation, TMMi Benchmark Report Financial Domain, version 1.1. 2024 |
[4] | Gelperin, D. Hetzel, B. The growth in software testing. Communications of the ACM 31 (6), pp. 687-695. 1988. |
[5] | Burnstein. I. Suwanassart, I, Carlson C. R. Developing a Testing Maturity Model for software process evaluation and improvement. in: Proceedings International Test Conference Test and Design Validity. 1996. |
[6] | Farid, A., Fathy, E., Abd, M. Towards Agile Implementation of Test Maturity Model Integration (TMMI) Level 2 using Scrum Practices. in: International Journal of Advanced Computer Science and Applications. 2015. |
[7] | TMMi Foundation, TMMi in the Agile world, version 1.4. 2019 |
[8] | Unudulmaz, A., Cingiz, M., Kalıpsız, O. Adaptation of the Four Levels of Test Maturity Model Integration with Agile and Risk-Based Test Techniques. in: Electronics. 2022. |
[9] | Rungi, K., Matulevicius, R. Empirical analysis of the Test Maturity Model Integration (TMMi). in: Skersys, T., Butleris, R., Butkiene, R. (eds.) ICIST 2013. CCIS, 403, pp. 376–391. Springer Heidelberg. 2013. |
[10] | Afzal W., Alone S., Kerstin, G., Torkar, R. Software test process improvement approaches: A systematic literature review and an industrial case study. in: Journal of Systems and Software. 2016. |
[11] | Prastiti, R., Hidayanto, A. Evaluation of Maturity Level and Recommendations for Improvement of Software Testing Process Based on Test Maturity Model integration (TMMi): A Case Study. in: Jurnal Komtika (Komputasi dan Informatika), 6(2), pp. 145-154. 2023. |
[12] | Garousi, V., van Veenendaal, E. Test Maturity Model integration (TMMi): trends of worldwide test maturity and certifications, IEEE Software, 39(2), pp. 71-79. 2022. |
[13] | Garousi, V., Felderer, M., Hacaloglu, T. What we know about software test maturity and test process improvement. IEEE Software, 35(1), pp. 84-92. 2018. |
[14] | Leavitt, H. J. Applied Organization Change in Industry: structural, technical, and human approaches, in: New perspectives in organization research, pp. 55-71. Wiley. 1964. |
[15] | Cohn, M. Succeeding with Agile: Software Development Using Scrum. in: Journal of Object Technology. 2010. |
APA Style
Veenendaal, E. V. (2024). Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain. American Journal of Computer Science and Technology, 7(2), 43-50. https://doi.org/10.11648/j.ajcst.20240702.13
ACS Style
Veenendaal, E. V. Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain. Am. J. Comput. Sci. Technol. 2024, 7(2), 43-50. doi: 10.11648/j.ajcst.20240702.13
AMA Style
Veenendaal EV. Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain. Am J Comput Sci Technol. 2024;7(2):43-50. doi: 10.11648/j.ajcst.20240702.13
@article{10.11648/j.ajcst.20240702.13, author = {Erik Van Veenendaal}, title = {Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain }, journal = {American Journal of Computer Science and Technology}, volume = {7}, number = {2}, pages = {43-50}, doi = {10.11648/j.ajcst.20240702.13}, url = {https://doi.org/10.11648/j.ajcst.20240702.13}, eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajcst.20240702.13}, abstract = {Software quality is of utmost importance to the financial sector. Software testing plays a critical role in achieving software product quality. Financial institutions benefit from rigorous testing by having confidence in the reliability and performance of the software. This can lead to improved customer experience, increased operational efficiency, and reduced risks of system failures or security breaches. A questionnaire-based survey was designed and subsequently an international survey was conducted involving sixty financial institutions, e.g., banking, insurance companies and pension funds, from across the globe to understand their level of test maturity. As a reference framework against which to measure their test maturity, the Test Maturity Model integration (TMMi) was used. In this paper their motivations for doing test process improvement and the benefits they achieved are discussed. Concrete examples of the benefits achieved are provided. The role of test automation with test process improvement at the financial institutions is also reported upon in this paper. The most common level of test maturity achieved, measured against the TMMi, is TMMi level 3 “Defined” which represents a more than average level of test maturity. Benefits are reported by the financial institutions, especially in the areas of software quality and testing productivity. The benefits achieved show a high level of correlation with the motivations for investing in test process improvement. Almost all of financial institutions also use test automation to improve their testing in parallel with process improvement, with test automation at system level being by far the most popular. }, year = {2024} }
TY - JOUR T1 - Test Maturity Model integration (TMMi): Test Maturity in the Financial Domain AU - Erik Van Veenendaal Y1 - 2024/05/30 PY - 2024 N1 - https://doi.org/10.11648/j.ajcst.20240702.13 DO - 10.11648/j.ajcst.20240702.13 T2 - American Journal of Computer Science and Technology JF - American Journal of Computer Science and Technology JO - American Journal of Computer Science and Technology SP - 43 EP - 50 PB - Science Publishing Group SN - 2640-012X UR - https://doi.org/10.11648/j.ajcst.20240702.13 AB - Software quality is of utmost importance to the financial sector. Software testing plays a critical role in achieving software product quality. Financial institutions benefit from rigorous testing by having confidence in the reliability and performance of the software. This can lead to improved customer experience, increased operational efficiency, and reduced risks of system failures or security breaches. A questionnaire-based survey was designed and subsequently an international survey was conducted involving sixty financial institutions, e.g., banking, insurance companies and pension funds, from across the globe to understand their level of test maturity. As a reference framework against which to measure their test maturity, the Test Maturity Model integration (TMMi) was used. In this paper their motivations for doing test process improvement and the benefits they achieved are discussed. Concrete examples of the benefits achieved are provided. The role of test automation with test process improvement at the financial institutions is also reported upon in this paper. The most common level of test maturity achieved, measured against the TMMi, is TMMi level 3 “Defined” which represents a more than average level of test maturity. Benefits are reported by the financial institutions, especially in the areas of software quality and testing productivity. The benefits achieved show a high level of correlation with the motivations for investing in test process improvement. Almost all of financial institutions also use test automation to improve their testing in parallel with process improvement, with test automation at system level being by far the most popular. VL - 7 IS - 2 ER -