A Performance-Based Approach to Safety Management: Mapping Safety Indicators and Targets in Multi-Approval Training Organizations
DOI:
https://doi.org/10.37385/jaets.v7i2.8518Keywords:
Safety Management System, Safety Performance, Safety Indicators, Safety Targets, Approved Training OrganizationAbstract
Safety Management Systems (SMS) are formally required across aviation training organizations; however, institutions holding multiple operational approvals frequently encounter difficulties in translating regulatory requirements into coherent and measurable safety performance indicators and targets. In practice, safety performance monitoring is often fragmented, approval-specific, and insufficiently aligned with a performance-based oversight philosophy. This study addresses this gap by examining how safety indicators and targets can be systematically mapped within a unified SMS framework for multi-approval aviation training organizations. This research adopted a qualitative design-based approach, combining document analysis, internal stakeholder interviews, comparative benchmarking with peer training organizations, and focus group discussions involving regulators, operators, and safety managers. Data triangulation was applied to ensure consistency and analytical validity throughout the framework development process. The results demonstrate that safety performance expectations differ substantially across approvals due to distinct operational risk characteristics. Nevertheless, these differences can be integrated through a common safety assurance structure without compromising regulatory specificity. The study identifies approval-specific safety performance indicators and targets for pilot training, aircraft maintenance, and maintenance training activities, and shows that an integrated performance-based mapping improves safety oversight, strengthens compliance mechanisms, and enhances organizational accountability. From a theoretical perspective, this study extends performance-based safety management literature by situating safety performance measurement within a multi-approval governance context. Practically, it offers aviation training organizations and regulators a structured and adaptable framework for harmonizing safety performance monitoring across approvals. The study contributes a transferable model that supports resilient and performance-oriented SMS implementation in complex aviation training environments.
Downloads
References
Adjekum, D. K. (2014). Safety Culture Perceptions in a Collegiate Aviation Program: A Systematic Assessment. Journal of Aviation Technology and Engineering, 3(2), 44. https://doi.org/10.7771/2159-6670.1086
Adjekum, D. K. (2017). An Evaluation of the Relationships between Collegiate Aviation Safety Management System Initiative, Self-Efficacy, Transformational Safety Leadership and Safety Behavior mediated by Safety Motivation. International Journal of Aviation, Aeronautics, and Aerospace, 4(2), 4. https://doi.org/https://doi.org/10.15394/ijaa.2017.1169
Adjekum, D. K., & Tous, M. F. (2020). Assessing the relationship between organizational management factors and a resilient safety culture in a collegiate aviation program with Safety Management Systems (SMS). Safety Science, 131, 104909. https://doi.org/10.1016/J.SSCI.2020.104909
Bartulović, D. (2021). Predictive safety management system development. Transactions on Maritime Science, 10(1), 135–146. https://doi.org/10.7225/TOMS.V10.N01.010
Bartulović, D. (2020). Development of predictive safety management methodology in aviation [Doctoral dissertation, University of Zagreb]. Digitalni repozitorij Sveučilišta u Zagrebu. https://repozitorij.unizg.hr/object/fpz:2944
Blišťanová, M., Kešeľová, M., & Brůnová, Ľ. (2021). A Systematic Review Of Safety Management System (Sms) In Aviation With A Focus On The Safety Level. Scientific Journal of Silesian University of Technology. Series Transport, 113, 29–43. https://doi.org/10.20858/SJSUTST.2021.113.3
Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualitative Research Journal, 9(2), 27–40. https://doi.org/10.3316/QRJ0902027
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706QP063OA
Bzdyk, K., Harkness, P., Tufft, J., & Shaw, P. (2024). Investigation of the Operating Parameters and Performance of an Autophage, Hybrid Rocket Propulsion System. AIAA SciTech Forum and Exposition, 2024. https://doi.org/10.2514/6.2024-1604
Ceballos Martínez, G., & Krstikj, A. (2025). Psychological restoration and the 2030 Agenda: educational contributions and implications from a systematic review. Environmental Education Research. https://doi.org/10.1080/13504622.2025.2526524
Chai, J., Liu, X., Usdrowski, H., Deng, F., Li, Y., & Zhao, J. (2022). Geography, niches, and transportation influence bovine respiratory microbiome and health. Frontiers in Cellular and Infection Microbiology, 12, 961644. https://doi.org/10.3389/FCIMB.2022.961644/BIBTEX
Chen, M., Chen, Y., & Ma, S. (2021). Identifying Safety Performance Indicators for Risk Assessment in Civil Aviation. IOP Conference Series: Materials Science and Engineering, 1043(3), 032010. https://doi.org/10.1088/1757-899X/1043/3/032010)
Creswell, J. P. CN. (2018). Qualitative Inquiry and Research Design Choosing among Five Approaches.
Donkoh, S. (2023). Application of triangulation in qualitative research. Journal of Applied Biotechnology & Bioengineering, 10(1), 6–9. https://doi.org/10.15406/JABB.2023.10.00319
Elbardan, H., & Kholeif, A. O. R. (2017). An Interpretive Approach for Data Collection and Analysis. Enterprise Resource Planning, Corporate Governance and Internal Auditing, 111–165. https://doi.org/10.1007/978-3-319-54990-3_5
Faturachman, A., Lestary, D., & Satria, A. (2023). Safety Risk Management Bow-Tie Analysis And Safety Promotion In The Operations Of Small Unmanned Aircraft Systems. Journal of Theoretical and Applied Information Technology, 15(21). www.jatit.org
Gauthama, W., Hendra, O., Aswia, P. R., & Amalia, D. (2025). Updating aircraft maintenance education for the modern era: a new approach to vocational higher education. Higher Education, Skills and Work-Based Learning, 15(1), 46–61.
Guo, C., Jiang, F., Chen, T., & Li, Y. (2021). A Review of Research Topics of Safety Management Systems. Journal of Physics: Conference Series, 1827(1), 012052. https://doi.org/10.1088/1742-6596/1827/1/012052
Fischer, F., Miller, G. J., & Sidney, M. S. (Eds.). (2007). Handbook of public policy analysis: Theory, politics, and methods. CRC Press.
Herrera, I. A. (2012). Resilience engineering and indicators of resilience. International Risk Governance Council (IRGC). https://www.irgc.org/wp-content/uploads/2018/09/Herrera-Resilience-Engineering-and-Indicators-of-Resilience.pdf
Jennings, K., & Schulberg, F. (2009). Guidance on developing safety performance indicators. Process Safety Progress, 28(4), 362–366. https://doi.org/10.1002/PRS.10343
Verstraeten, J. G. (n.d.). ResearchGate profile. ResearchGate. Retrieved November 9, 2025, from https://www.researchgate.net/scientific-contributions/JG-Verstraeten-2154814919
Kartal, G., & Bayramoğlu, G. (2024). The Safety Management System (SMS) As A Tool for Building Safety Culture in Aviation: A Qualitative Research. Journal of Aviation, 8(3), 315–324. https://doi.org/10.30518/JAV.1493642
Kaspers, S., Karanikas, N., Roelen, A., Piric, S., & Boer, R. J. De. (2019). How does aviation industry measure safety performance Current practice and limitations. International Journal of Aviation Management, 4(3), 224. https://doi.org/10.1504/IJAM.2019.098372
Kıvanç, E., Tuzkaya, G., & Vayvay, Ö. (2025). Safety management system and risk-based approach in aviation maintenance: A systematic literature review. Safety Science, 184. https://doi.org/10.1016/J.SSCI.2024.106755
Kobaszyńska-twardowska, A., Krzyżanowski, M., Siwka, P., & O B A S Z Y Ń S K A -t W A R D O W S K A, A. K. (2023). Forecasting Trends of Safety Performance Indicators in Aviation. Safety & Defense, 9(2), 1–11. https://doi.org/10.37105/SD.201
Kurt, Y. (2021). Diffusion of the airport health accreditation program in the COVID-19 period: an assessment with institutional logic and legitimacy approach. Journal of Air Transport Management, 94, 102078.
Kwon, S. (2021). Real-world problem solving: A qualitative inquiry on how expert administrative professionals problem-solve in the workplace (Doctoral dissertation, University of Georgia). University of Georgia Libraries. https://openscholar.uga.edu/record/4589/files/Kwon_2021_Real-World%20Problem%20Solving.pdf
Lestary, D. (2020). Implementation Of Just Culture In Safety Policy And Safety Reporting Documentation At Air Navigation Service Provider. Journal of Theoretical and Applied Information Technology, 98(10), 1777–1790.
Lim, W. M. (2025). What is qualitative research? An overview and guidelines. Australasian Marketing Journal, 33(2), 199–229. https://doi.org/10.1177/14413582241264619
Meydan, C. H., & Akkaş, H. (2024). The role of triangulation in qualitative research: Converging perspectives. Principles of Conducting Qualitative Research in Multicultural Settings, 98–129. https://doi.org/10.4018/979-8-3693-3306-8.CH006
Morgan, H. (2024). Using triangulation and crystallization to make qualitative studies trustworthy and rigorous. The Qualitative Report, 29(7), 1844–1856. https://doi.org/10.46743/2160-3715/2024.6071
Na, I. K., & Choi, Y.-J. (2023). Developing Airport Safety Performance Indicators and Index. Journal of the Korean Society for Aviation and Aeronautics, 31(3), 103–118. https://doi.org/10.12985/KSAA.2023.31.3.103
Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2023). A step-by-step process of thematic analysis to develop a conceptual model in qualitative research. International Journal of Qualitative Methods, 22, 1–18. https://doi.org/10.1177/16094069231205789
Nguyen, T. L. P., Nguyen, T. T. H., & Ključnikov, A. (2023). The influence of socially responsible human resource management on green behaviours in the aviation industry. Journal of Competitiveness, 15(2), 188–206. https://doi.org/10.7441/joc.2023.02.10.
Nyumba, T. O., Wilson, K., Derrick, C. J., & Mukherjee, N. (2018). The use of focus group discussion methodology: Insights from two decades of application in conservation. Methods in Ecology and Evolution, 9(1), 20–32. https://doi.org/10.1111/2041-210X.12860
Orogun, B., & Issa, M. H. (2022). Developing, validating and implementing performance metrics to evaluate the health and safety performance of sustainable building projects. International Journal of Occupational Safety and Ergonomics, 28(4), 2125–2137. https://doi.org/10.1080/10803548.2021.1960701
Oster, C. V., Strong, J. S., & Zorn, C. K. (2013). Analyzing aviation safety: Problems, challenges, opportunities. Research in Transportation Economics, 43(1), 148–164. https://doi.org/10.1016/J.RETREC.2012.12.001
Paidisetty, M. K., Singh, S., & Sanal Kumar, V. R. (2024). State of the Art Digital Accountable and Customizable Aircraft Transit Inspection/Line Maintenance Toolbox for Enhancing the Aircraft Safety. AIAA SciTech Forum and Exposition, 2024. https://doi.org/10.2514/6.2024-1602
Robertson, M. F. (2018). Examining the Relationship Between Safety Management System Implementation and Safety Culture in Collegiate Flight Schools. Journal of Aviation Technology and Engineering, 7(2), 1. https://doi.org/10.7771/2159-6670.1169
Saliba, E. J. (2024). Perceived commitment to a safety management system (SMS) and its impact on safety culture in collegiate flight programs (Doctoral dissertation, Johnson & Wales University). Johnson & Wales University ScholarsArchive. https://scholarsarchive.jwu.edu/jwu_etd/22/
Schuster, R. C., Brewis, A., Wutich, A., Safi, C., Vanrespaille, T. E., Bowen, G., SturtzSreetharan, C., McDaniel, A., & Ochandarena, P. (2023). Individual interviews versus focus groups for evaluations of international development programs: Systematic testing of method performance to elicit sensitive information in a justice study in Haiti. Evaluation and Program Planning, 97, 102208. https://doi.org/10.1016/J.EVALPROGPLAN.2022.102208
Serey, J., Alfaro, M., Fuertes, G., Vargas, M., Ternero, R., Duran, C., Sabattin, J., & Gutierrez, S. (2023). Framework for the strategic adoption of Industry 4.0: A focus on intelligent systems. Processes, 11(10), 2973. https://doi.org/10.3390/pr11102973
Stolzer, A. J., Friend, M. A., Truong, D., Tuccio, W. A., & Aguiar, M. (2018). Measuring and evaluating safety management system effectiveness using Data Envelopment Analysis. Safety Science, 104, 55–69. https://doi.org/10.1016/J.SSCI.2017.12.037
Stolzer, A. J., Sumwalt, R. L., & Goglia, J. J. (2023). Safety Management Systems in Aviation. CRC Press.
Sugiyono. (2018). Metode penelitian kuatintatif, kualitatif dan R&D. Alfabeta.
Sultana, S., Andersen, B. S., & Haugen, S. (2019). Identifying safety indicators for safety performance measurement using a system engineering approach. Process Safety and Environmental Protection, 128, 107–120. https://doi.org/10.1016/J.PSEP.2019.05.047
Szabo, S., & Koblen, I. (2020). Safety Performance Indicators as Important Part of Safety Management System Implementation in Production Organizations of the Aviation Industry. NTinAD 2020 - New Trends in Aviation Development 2020 - 15th International Scientific Conference, Proceedings, 229–235. https://doi.org/10.1109/NTAD51447.2020.9379087
Wijaya, M. R. A., Lestary, D., Wagini, D., & Aswia, P. R. (2023). The Airport Wildlife Control Unit Design as the Safety Measure. Jurnal Manajemen Transportasi & Logistik (JMTRANSLOG), 9(2), 189–188. https://doi.org/10.54324/J.MTL.V9I2.981
Wollney, E. N., Bylund, C. L., Bedenfield, N., Parker, N. D., Rosselli, M., Curiel Cid, R. E., Kitaigorodsky, M., & Armstrong, M. J. (2024). Persons living with dementia and caregivers’ communication preferences for receiving a dementia diagnosis. PEC Innovation, 4. https://doi.org/10.1016/j.pecinn.2024.100253
Yeun, R., Bates, P., & Murray, P. (2014). Aviation safety management systems. World Review of Intermodal Transportation Research, 5(2), 168–196. https://doi.org/10.1504/WRITR.2014.067234
Zhang, H., Wang, C., & Wang, P. (2025). Research on Safe Multimodal Detection Method of Pilot Visual Observation Behavior Based on Cognitive State Decoding. Multimodal Technologies and Interaction, 9(10). https://doi.org/10.3390/MTI9100103
CITEDNESS IN SCOPUS
CITEDNESS IN WOS
