Skip to article
AHFE AHFE Discoveries AHFE International Open Access Journal
AHFE OPEN ACCESS OPEN ACCESS CONFERENCE PROCEEDINGS PAPER

A Review of the Application of FRAM and STAMP Approaches Combined with Other Methods

Department of Mechanical Engineering, École de technologie supérieure, Montreal, Quebec, Canada
Publication year
Digital Object Identifier10.54941/ahfe1002190

Abstract

When dealing with risks associated with complex sociotechnical systems, one needs to employ approaches that will make it possible to better understand the systems' complexity and analyze them more efficiently. Several approaches have been proposed and in the recent literature, the System-Theoretic Accident Model and Processes (STAMP) and Functional Resonance Analysis Method (FRAM) stand out. These have been applied both separately and integrated with other methods for risk analysis. This study aims to provide an overview of the literature related to the application of FRAM and STAMP integrated with other methods. Papers from various scientific resources, including Scopus, IEEE, Compendex and INSPEC, Google Scholar, and Espace ÉTS from 2004 to 2021, in English, were consulted. The keywords used to narrow our search were FRAM, STAMP, STPA, and risk analysis. The results show that FRAM and STAMP have been used in combination with other methods such as fuzzy logic, Monte Carlo Simulation, bow tie, and model checking. Their combination with other methods has enhanced their efficiency and capability in risk analysis and provides better and more precise outcomes for some specific contexts of study. These combined proposed approaches have been applied and validated for specific contexts in specific studies. Therefore, the generalization and validation of the combined methods in different contexts could be an outlook for future studies.

INTRODUCTION

Systems safety has always been an essential part of manufacturing. Over the years, the proposed methods for systems’ risk analysis have evolved both in response to the evolution of the systems and to address the new challen- ges and risks these systems face (Grabbe et al., 2020). Different methods, from classical to systemic, have been introduced over the past decades, and their usefulness and efficiency have been examined and evaluated within several contexts of study (Grabbe et al., 2020). As systems evolved, experts developed the concept of sociotechnical system, and findings have showed that classical methods are unable to provide adequate risk analysis for such systems (Adriaensen et al., 2019).

Therefore, finding appropriate approaches that provide a comprehensive analysis of the studied system has been an interesting subject for many © 2022. Published by AHFE Open Access. All rights reserved. 466

A Review of the Application of FRAM and STAMP Approaches Combined 467

researchers in recent decades. Among different approaches introduced by researchers, a considerable number of studies have been devoted to the appli- cation of Functional Resonance Analysis Method (FRAM) (Hollnagel, 2012) and System-Theoretic Accident Model and Process (STAMP) (Leveson, 2011) in different contexts. These methods look at the system from a systemic and non-linear perspective to identify component interactions that might lead to a hazard. By providing a good understanding of the system and its components, they enable the analyst to explore variabilities and hazardous interactions within the complex system.

However, even if many studies proved the worthiness of these methods in risk analysis, some researchers introduced novel approaches by combining FRAM (Pardo-Ferreira et al., 2019) or STAMP (Patriarca et al., 2022) with other methods. They found that when FRAM or STAMP were applied alone, there was a gap between the expected and the obtained result. Moreover, some analyses needed quantified results to achieve more precise results for a specific context. These innovations improve the obtained results and enh- ance these methods’ capabilities. This study aims to provide a review of the methods that have been combined with FRAM and STAMP. The results show that their combination with other methods improved the analysis within the study’s specific context. Many combinations have been proposed of other methods with FRAM and STAMP, but only one study considers a combina- tion of these two methods with each other. Applying FRAM and STAMP is a novel combination, which needs further study both to develop it and examine it in various specific contexts, and to validate its efficiency.

The remainder of this study is structured as follows. Section 2 discusses the methodology applied to retrieve the related studies. This is followed by the results in Section 3. Section 4 discusses the results and draws conclusions.

METHODOLOGY

To retrieve the related studies, various scientific databases, including Sco- pus, IEEE, Compendex and INSPEC, Google Scholar, and Espace ÉTS from 2004 to 2022, in English, were consulted. The keywords used to narrow the number of results were risk analysis, FRAM, STAMP, STPA, and combi- ned approach. The papers were chosen by their title, and then for screening, abstracts were studied to verify their relevance to the study’s objective. Finally, a brief review of the obtained papers through discussed methodology was presented in two tables, one for FRAM and one for STAMP, noting the obje- ctive of the study, applied methods, results of the application of the proposed method, and the domain of study. The results are shown in the next section.

RESULTS

By applying the methodology discussed in Section 2, we retrieved 59 papers. Thirty-three of them studied the application of FRAM combined with other methods (Table 1). The other 26 investigated the application of STAMP (mostly STPA) with other methods (Table 2). The proposed methods go by different names, such as integrated, combined, hybrid, development, and

468 Naeini and Nadeau

Table 1. FRAM application combined with other methods.

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods (Zheng and Tian, 2015)

Application of proposed methods with FRAM gave a new perspective about accidents and complemented the understanding of the system.

FRAM + finite state machine (FSM) and model checker NuSMV

Application of finite state machine and model checker to formally present FRAM.

Landing process of an airplane

Herald of Free Enterprise car ferry accident (Yang and Tian, 2015)

FRAM + MBSA -model checking

The combined approach was useful in verifying the FRAM analysis model by model checking and ensuring whether the safety requirements were upheld or needed further analysis.

Application of FRAM and the Model-Based Safety Assessment (MBSA) checking model to identify potential hazards.

Constru- ction

(Rosa et al., 2015)

FRAM + analy- tic hierarchy process (AHP)

Analyze risks through the application of FRAM and the AHP.

The combined application provided a new perspective of the system and a better understanding of critical functions.

FRAM + model checking

(Duan et al., 2015)

Aviation (air accident)

Develop FRAM by bridging theory and practice through model checking.

The proposed approach refined the results by redefining and categorizing couplings. It helped to identify more couplings and provide a better understanding of the system’s behavior.

FRAM + Fuzzy CREAM

(Hirose et al., 2016)

Analyze the feasibility of procedures for highly automated systems.

The proposed method was not only useful for the analysis of accidents but also for the pre-analysis of the safety of documented procedures.

Flight-deck procedures (Cali airport air crash accident) (Zheng et al., 2016)

FRAM + Finite State Machine (FSM)+ model checker SPIN

The application of the proposed approach showed its feasibility and effectiveness in refining process guidelines.

Aero engine blade forging (manufactu- ring)

Propose an approach to refine operation guidelines and to reduce the risk of producing unqualified products.

(Patriarca et al., 2017b)

FRAM + Monte Carlo Simulation (MCS)

Air Traffic Manage- ment (ATM)

Propose a semi-quantitative FRAM model based on the Monte Carlo Simulation.

The proposed approach helped highlight the most critical functions and facilitated the understanding of analysis through the provision of numerical results.

Railway domain

(Patriarca et al., 2017a)

FRAM + Abstraction Hierarchy (AH)

Use Abstraction Hierarchy (AH) to provide a detailed representation of functions at a different level.

The proposed approach provided an Abstraction/Agency framework presenting the studied system in a structured and systemic manner. The multilayer presentation of the system enhanced the knowledge of the system.

(Continued)

A Review of the Application of FRAM and STAMP Approaches Combined 469

Table 1. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods FRAM + Netw- ork analysis techniques (Bellini et al., 2017)

Urban Transport System (UTS)

The study concluded that the variability rate would be enhanced with the deployment of IoE.

Investigate and quantify resilience enhancement of Urban Transport System equipped with Internet of Everything (IoE).

Air Traffic Management

(Yang et al., 2017)

FRAM + formal verification tool SPIN

The results showed that achieving a successful design is possible through a comprehensive analysis of the system safety within system development.

Analyze and model (Minimum Safe Altitude Warning) MSAW-in-ATM system, formalizing variabilities and interactions.

Petrochemical company

(De Felice et al., 2017)

FRAM + HRA The method could evaluate quantitively the probability of human functions and their effect on downstream functions.

Develop a novel approach to Human Reliability Analysis (HRA) that evaluates the variability of the human error probability.

Lifting operation

(Jensen and Aven, 2017)

The combined approach provided creative methods for inventing potential hazards in complex systems.

FRAM + Anticipatory Failure Determination (AFD)

Propose a new hazard identification method by applying Anticipatory Failure Determination and FRAM.

(Toda et al., 2018)

Railroad crossing, Car lane changing

The application of four keywords of STPA analysis in the FRAM method.

FRAM + STPA The proposed approach was suitable for risk analysis in the concept and design phase. It could find more hazards compared to solely applying STPA.

Maritime domain

(Lee and Chung, 2018)

FRAM + human- system interaction (HSI)

Propose a new FRAM-based approach to improve the resolution of crew interactions.

The proposed approach assisted in analyzing the interaction of human and systems better and suggested critical parts at the HIS level to be considered in the strategy for variability management.

(Riccardo et al., 2018)

SkyWest Flight 5569 and USAir Flight 1493 accident

FRAM + RAM While FRAM is a powerful method in the variability analysis of operational scenarios, RAM provided a two-dimensional representation of couplings.

Enhance the strength of FRAM-based analyses through the application of the Resilience Analysis Matrix (RAM).

(Continued)

470 Naeini and Nadeau

Table 1. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods

Aircraft components production

(Sekeˇlová and Lališ, 2019)

Resilience Assessment Grid (RAG) + FRAM

The approach provided a model of a managed change process. It also helped develop better safety awareness and increase the organization’s resilience performance.

Apply a Resilience Assessment Grid (RAG) in aircraft components production to propose an approach specific to aviation.

FRAM + Fuzzy logic

(Slim and Nadeau, 2019)

Aircraft on-ground de-icing operations

The proposed approach provided a representation of the outcomes in numeric format and a comprehensive representation of potential performance variabilities.

Improve the descriptive FRAM results in the quantitative outcomes by integrating fuzzy logic.

FRAM + Acci- dent Causation Analysis and Taxonomy (ACAT)

Opening a valve on a gas pipeline - Coal shearer process

(Li et al., 2019) Integrate Accident Causation Analysis and Taxonomy (ACAT) with FRAM model to propose a closed-loop analysis method.

When applying the hybrid method, more functional constraints and factors that contribute to accidents could be found. It also provided more details that helped to understand systems even though its application was more complicated than when solely applying ACAT or FRAM.

The proposed approach provides a framework to aggregate the upstream variabilities quantitatively and proactively simulates the functions’ interaction.

FRAM + Human performance model (CREAM) + equi- pment performance model

(Yu et al., 2020) Propose a FRAM-based framework to help to overcome the dependency on expert elicitation for systemic hazard identification.

FRAM + Graph theory

Process industries (Methyl methacry- late (MMA) batch poly- merization process) (Eljaoued et al., 2020)

Propose a qualitative- quantitative approach to risk analysis.

The use of graph theory provided a quantitative assessment of the functions’ interactions and evaluates their effect on functions’ variability.

FRAM + cellu- lar automaton

Steel production line

A simulation of crisis organiza- tion (Hirose and Sawaragi, 2020)

Develop a tool to validate and verify safety based on the FRAM model.

The extended FRAM approach is helpful in providing insights into experienced workers’ operations characteristics and identification of critical points for safety management.

(Falegnami et al., 2020)

FRAM + Netw- ork theory

Represent the FRAM model in a multi-layer network.

The combined method made it possible to interpret the FRAM model in multilayer networks that could enable analysts to prioritize critical functions.

Industrial plant (A power-tool accessory production plant) (Continued)

A Review of the Application of FRAM and STAMP Approaches Combined 471

Table 1. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods

Offshore drilling systems

(França et al., 2020)

FRAM + AHP The proposed approach made it possible to model the “work as done” properly to identify critical functions and worker’s behavior that might be ignored in procedures.

Develop an approach to identify complexity level and critical human factors.

Propose a method to quantify FRAM results.

(Bellini et al., 2020)

H2020- RESOLUTE pilot definition

Q-FRAM The results were obtained with a robust and fast-forward method in a practical way and provided a good insight into the system’s status for decision-makers.

FRAM + rough sets/fuzzy logic

(Slim and Nadeau, 2020)

The number of rules was decreased considerably, and it was suitable especially for decision making regarding uncertain and incomplete data.

Aviation (Aircraft on-ground de-icing operations)

Improve the size of rules and classify outcomes for the use of fuzzy logic combined with FRAM.

FRAM + Asso- ciation rule mining

Polymerization process (process industry)

The application of association rule mining provided quantitative metrics for functions couplings. It was also helpful in identifying the path that leads to hazard.

(Yu et al., 2021) Propose a data-driven approach to provide quantitative results of functions’ couplings.

(Albogho- beish and Shirali, 2021)

FRAM + analytical hierarchy process (AHP)

Water reservoirs management in agriculture

The integrated approach was useful for risk analysis and identifying emerging risks based on “work as done”, not “work as imagined”.

Identify and prioritize emerging risks through an integrated application of FRAM and an AHP.

Healthcare case study

(Salehi et al., 2021)

Propose a dynamic FRAM-based tool for variability analysis.

DynaFRAM (programming FRAM via Python programming language)

DynaFRAM could capture the different variabilities’ characteristics and facilitate understanding and analyzing complex operations’ variability.

Layered FRAM

(de Souza et al., 2021)

Apply a layered FRAM to analyze work as done in HVAC system maintenance.

The proposed approach provided a better perspective of functions, decreased the analysis complexity by dividing the analysis into layers, and facilitated model analysis.

Maintenance of heating, ventilation, and air- conditioning (HVAC) systems (Zinetullina et al., 2021)

Quantify the FRAM’s analyzing resilience for a chemical process.

FRAM + Dyna- mic Bayesian Network (DBN)

The proposed approach provided a rigorous quantitative analysis of the system and assessed resilience in both probabilistic and temporal aspects.

Chemical process systems (a separator of an acid gas sweetening unit) (Continued)

472 Naeini and Nadeau

Table 1. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods Rule-based FRAM (Kim and Yoon, 2021)

The proposed method was useful for assessing potential risks in a crisis and supporting decision-makers in their response to a crisis.

Develop an approach to quantify FRAM results and variability propagation.

FRAM + N-K model

Emergency response system for infectious disease (COVID- 19) (Huang et al., 2022)

The proposed approach provided quantitative results for variabilities; however, the historical statistical frequency of every risk factor was required.

Formulate the variability mechanism of FRAM through the risk pulse theory.

An accident in railway hazardous goods tran- sportation (Liu et al., 2022)

FRAM– Moran’s I and CREAM

The proposed approach provided a systematic perspective regarding the ergonomic reliability of medical equipment.

Operation procedure of a medical equipment

Evaluate the safety of operating procedures of medical equipment.

Table 2. The application of STAMP combined with other methods.

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods

Washing machine system

(Colley and Butler, 2013)

STPA + Event-B Event-B applied with STPA helped provide a formal representation of safety constraints as “invariants” or “guards” in the formal model.

Propose an approach to hazard analysis for system requirements that are captured as monitored, controlled, mode, and commanded phenomena.

(Mason- Blakley et al., 2014)

Clinical Information Technology (CIT)

The combined approach addressed the weakness of the FMEA method in the qualitative aspect that compromises reproducibility and improves the obtained results.

Propose a combined approach of FMEA and STPA for hazard analysis of an information system.

STPA + Failure Modes and Effects Analysis (FMEA) = Infor- mation Systems Hazard analysis (ISHA)

A software

(Abdulk- haleq et al., 2015)

STPA + softw- are testing and model checking approach

Develop an STPA-based approach for comprehensive safety engineering of software.

The proposed approach could be integrated into software development processes. It was helpful in identifying unsafe control action and performing analysis in system levels. It improved workflow and communications between software and safety engineers.

(Continued)

A Review of the Application of FRAM and STAMP Approaches Combined 473

Table 2. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods STPA + Refined Controller (RC)

The U.S. Air Force product

The approach improved the results and identified additional unsafe behaviors that might affect inherent system safety.

(Montes, 2016) Product testing through the application of STPA to refine the human controllers’ analysis.

STPA + unsafe coordination analyses

Unmanned aircraft systems

(Johnson, 2016) Introduce an STPA extension called STPA- Coordination.

The extended approach helped to identify more hazardous coordination scenarios and recommendations.

(France, 2017) Propose a new approach to analyze the role of humans in complex automated systems.

STPA + Engine- ering for Humans (STPA- Engineering)

Automated driving system (Automated Parking Assist)

The approach guided analysts in identifying casual scenarios related to human interactions with automation and understanding why an unsafe behavior appears appropriate in an operational context. It also provided a special dialogue framework for communicating between human factors experts and engineers from other fields. It was useful in comparing the effect of human behaviors on different system designs.

The integrated approach was shown to be more comprehensive than the separate application of risk analysis methods.

(Thapaliya and Kwon, 2017)

Green Line Metro System (train control system)

Propose an integrated approach for safety analysis from the perspective of reliability and control theory.

STPA as revolutionary safety method + results of the application of hazard and operability study (HAZOP), failure mode and effect analysis (FMEA), and fault tree analysis (FTA) as evolutionary safety methods

(Howard et al., 2017)

Cyber- physical systems

Propose an approach for safety and security risk analysis of cyber-physical systems.

STPA + Event-B The inclusion of Event-B to STPA analysis provided integrated critical requirements that are represented formally (not simple text) as variants, guards, etc. These requirements could then be mitigated.

STAMP + Lean philosophy

Production system

(Sousa et al., 2017)

Apply STAMP and Lean philosophy to eliminate waste in a production system.

The combined application of Lean and STAMP provided more information through a better representation of the organizational structure of the production system compared to applying Lean alone for waste elimination.

(Continued)

474 Naeini and Nadeau

Table 2. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods

Power grid (synchronous- islanding)

(Friedberg et al., 2017)

Propose a novel approach to safety and security analysis of cyber-physical systems.

STPA-SafeSec The proposed approach provided a description of a generic component layer diagram and a generic casual factors diagram in the security domain. It could provide an in-depth security analysis of the critical system components.

STPA + model checking

Robotic flight simulator

(Dakwat and Villani, 2018)

Provide a formal and unambiguous representation of the studied system analysis and identified hazards using STPA.

Combining STPA and model checking improved the results and knowledge of the system being designed. It was also consistent with the design changes suggested to deal with identified safety constraints in the STPA analysis results.

Agile software development

(Wang and Wagner, 2018)

STPA + Beha- vior Driven Development (BDD)

The preliminary results showed that the combined STPA-BDD is capable of providing effective communications between developers and business analysts.

Propose an approach to agile development that addresses the lack of appropriate safety analysis and verification methods.

(Joung et al., 2018)

STPA + Hazard identification study (HAZID)

mooring system in Arctic condition

A comprehensive hazard analysis through the application of multiple hazard identification methods was recommended to benefit from each method’s capability and compensate for their weaknesses.

Develop an approach to risk and hazard identification of a Dynamic Positioning (DP) and mooring system in design and operation.

Autonomous boat

(Torkildson et al., 2019)

Improve co-analysis of safety and security by applying threat modeling approaches as a complementary strategy.

Among different approaches, the data flow diagram showed better results in combination with STPA-sec for the specific case study; however, other threat approaches could complement STPA-sec from different aspects. It also helped identify more unsafe control actions than if STPA-sec had been solely applied.

STPA- sec + Threat modeling approaches (Misuse of cases, data flow diagram, attack tree, Business Process Modelling Notation (BPMN)) STPA + Goal Structuring Notation (GSN)

The train door controller

(Hirata and Nadjm- Tehrani, 2019)

Investigate the combination of STPA and GSN for a safety risk analysis approach.

The use of GSN in combination with STPA was feasible for supporting certification decisions. This approach improved the safety engineers’ (Continued)

A Review of the Application of FRAM and STAMP Approaches Combined 475

Table 2. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods

Aviation

STPA + SMS = Active STPA

communication and was useful in importing the argumentation structure from the STPA method. It was a useful generic approach for documenting quality insurance cases in any system that applies STPA and GSN for risk analysis. (Silva Castilho, 2019)

Propose an integrated hazard analysis for Safety Management Systems (SMS).

The integrated approach enabled the proactive identification of leading indicators that showed risk increments. It also provided good qualitative information and helped to manage hazards in an SMS.

Multi-robot systems

(Bensaci et al., 2020)

STPA + Bowtie The combined approach provided detailed hazard identification and risk classification that improved STPA outcomes and facilitated decision-making on finding the most suitable approaches.

Apply a combination of STPA and Bowtie for safety assessments of robot collaborations for a better comparison of different controls.

An automatic door system

(Souza et al., 2020)

STPA + Systems Modeling Language (SysML) modeling activities

The combined approach was helpful to structure STPA analysis with clarification and clear specifications of assumptions, requirements, system boundaries, and their interactions through the application of SysML diagrams.

Propose a method for simulation and formal verification of system models through the combination of STPA and SysML modeling activities.

The rail sector

(Dunsford and Chatzimi- chailidou, 2020)

STPA + Com- mon Safety Method for Risk Evaluation and Assessment (CSM-RA)

The use of STPA with CSM-RA produced a powerful safety assessment process and saved money and time. However, there are still challenges regarding the limitation of CSM-RA framework bounds.

Embed the STPA application into CSM-RA as a supplement to ensure the understanding of safety requirements.

STPA + threat model

(de Souza et al., 2020)

The proposed approach provided a more complete analysis and identified loss scenarios.

Electronic voting system by smartphone

Apply STPA extension with threat model ((STRIDE= Spoofing, Tampering, Repudiation, Information Disclosure, Denial of Service, and Elevation of Privilege) for a

(Continued)

476 Naeini and Nadeau

Table 2. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods simultaneous safety and security risk analysis of system developments in the concept stage. (Carreras Guzman et al., 2021)

Both methods were useful for safety and security risk assessment. However, a combination of results obtained by both methods provided higher and more reliable levels of result completeness.

Cyber- physical systems- Case study: ReVolt, a conceptual autonomous ship

STPA-Extension (both safety and security analysis) + Uncontrolled Flows of Information and Energy (UFoI-E)

Compare a novel extension of STPA and Uncontrolled Flows of Information and Energy (UFoI-E) in terms of differences and potential for combination by applying it to the same case study.

(Liew et al., 2021)

The methods enabled analysts to oversee the correlation between safety and security.

STPA (for safety and security) + 8 Matrix Diagram presentation

Propose a safety and security (S&S) approach to use STPA for cyber-physical systems.

Autonomous Vehicles

Cloud-based monitoring and control system for residential energy storage systems (Xing et al., 2021)

STPA + Finite State Machine (FSM)

Introduce FSM to complement risk analysis results of STPA application.

The combination of STPA and FSM compensated for the weaknesses of the STPA method in the risk analysis of high-level autonomous vehicles, with several automated modes and functions. It also provided more details and found more hazardous events to generate testing scenarios.

STPA + formal modeling

(Dghaym et al., 2021)

Unmanned Surface Vehicle

Develop an approach to identify and analyze the mission requirements for autonomous missions in autonomous systems.

The proposed approach continuously reviewed factors that might affect formal modeling. On the other hand, formal modeling could improve system requirements by identifying new requirements, removing ambiguity and ensuring the consistency of the requirements.

STAMP + Risk Management Framework (RMF)

Tianjin Port fire and explosion accident

The proposed approach was powerful in providing a good explanation of the accident. It is a feasible approach for accident analysis.

(Ge et al., 2022) Proposing a new approach for risk analysis based on Systems-Theoretic Accident Model and Processes (STAMP) and

(Continued)

A Review of the Application of FRAM and STAMP Approaches Combined 477

Table 2. Continued

Table available in the original PDF paper.

Results Domain

Author & Year

Main Objective Applied Methods

STPA + model- based systems engineering (MBSE)

Autonomous Vehicle (autono- mous emergency braking system)

Risk Management Framework (RMF) fundamentals called Interaction Theory of Hazard-Target System (ITHTS), and proposing a new systemic accident analysis method of work systems (SAAMWS) since ITHTS cannot be applied directly to accident analysis. (Duan, 2022) Formalize the results of STPA application by integrating it with model-based systems engineering (MBSE)

The quantification of the outcome obtained by the proposed method showed that it is effective and feasible for the safety and risk analysis of the system designs. It linked system development and safety analysis.

extended. For this study, these are considered as the same. Also, these appro- aches have been applied in different domains such as software development, cyber-physical systems, rail transportation, process industry, manufacturing, construction, and aviation. Aviation is where the most references were found.

DISCUSSION AND CONCLUSION FRAM and STAMP were introduced to academia and industry about 20 years ago. Since then, a considerable number of studies have been devoted to the application of a combination of one of these methods with other meth- ods, which demonstrates the significant contribution these methods have to offer in risk analysis regarding a comprehensive understanding of the studied system (Riccardo et al., 2018, Patriarca et al., 2022). The FRAM and STAMP methods have been applied in various contexts proving they can be applied in different sociotechnical systems. They have also been applied with other methods in various contexts. The results of this review show that the propo- sed approaches are more effective combined with other methods than when used alone. They benefit analysts through the provision of a comprehensive and detailed perspective of the studied system. In addition, some proposed approaches provided quantified results for better result comparisons and provided a good insight into the studied system for decision-makers. This combined approach was often used for a specific context, and its application

478 Naeini and Nadeau

to other contexts would require further research. Among the different meth- ods studied, the combined application of FRAM and STAMP was studied in only one paper (Toda et al., 2018). Regarding the dynamic characteri- stics of complex sociotechnical systems, combining the application of both FRAM and STAMP with other methods, there is still room for improvement. Nevertheless, it is a promising development for risk analysis (de Linhares et al., 2021).

ACKNOWLEDGMENT

The authors would like to thank the National Sciences and Engineering Council of Canada (NSERC) for their support.

REFERENCES

Abdulkhaleq, A., Wagner, S. and Leveson, N. (2015) ‘A Comprehensive Safety Engineering Approach for Software-Intensive Systems Based on STPA’, Procedia Engineering, 128, pp. 2–11. doi: https://doi.org/10.1016/j.proeng.2015.11.498 Adriaensen, A., Decré, W. and Pintelon, L. (2019) ‘Can Complexity-Thinking Meth-

ods Contribute to Improving Occupational Safety in Industry 4.0? A Review of Safety Analysis Methods and Their Concepts’, Safety, 5(4), pp. 65. doi: https: //doi.org/10.3390/safety5040065 Alboghobeish, A. and Shirali, G. A. (2021) ‘Integration of Functional Resonance Analysis with Multicriteria Analysis for Sociotechnical Systems Risk Manage- ment’, Risk analysis : an official publication of the Society for Risk Analysis. doi: 10.1111/risa.13796 Bellini, E., Ceravolo, P. and Nesi, P. (2017) ‘Quantify resilience enhancement of UTS

through exploiting connected community and internet of everything emerging technologies’, ACM Transactions on Internet Technology (TOIT), 18(1), pp. 1–34. Bellini, E., Coconea, L. and Nesi, P. (2020) ‘A Functional Resonance Analysis Method Driven Resilience Quantification for Socio-Technical Systems’, IEEE Systems Journal, 14(1), pp. 1234–1244. doi: 10.1109/JSYST.2019.2905713 Bensaci, C., Zennir, Y., Pomorski, D., Innal, F., Liu, Y. and Tolba, C. (2020) ‘STPA and

Bowtie risk analysis study for centralized and hierarchical control architectures comparison’, Alexandria Engineering Journal, 59(5), pp. 3799–3816. doi: https: //doi.org/10.1016/j.aej.2020.06.036 Carreras Guzman, N. H., Zhang, J., Xie, J. and Glomsrud, J. A. (2021) ‘A Comparative Study of STPA-Extension and the UFoI-E Method for Safety and Security Co-analysis’, Reliability Engineering & System Safety, 211, pp. 107633. doi: https: //doi.org/10.1016/j.ress.2021.107633 Colley, J. and Butler, M. (2013) ‘A formal, systematic approach to STPA using Event-

B refinement and proof’. Dakwat, A. L. and Villani, E. (2018) ‘System safety assessment based on STPA and model checking’, Safety Science, 109, pp. 130–143. doi: https://doi.org/10.1016/ j.ssci.2018.05.009 De Felice, F., Zomparelli, F. and Petrillo, A. ‘Functional Human Reliability Analysis:

A Systems Engineering Perspective’. CIISE, 23-29. de Linhares, T. Q., Maia, Y. L. and Ferreira Frutuoso e Melo, P. F. (2021) ‘The phased application of STAMP, FRAM and RAG as a strategy to improve com- plex sociotechnical system safety’, Progress in Nuclear Energy, 131, pp. 103571. doi: https://doi.org/10.1016/j.pnucene.2020.103571

A Review of the Application of FRAM and STAMP Approaches Combined 479

de Souza, I. T., Rosa, A. C., Evangelista, A. C. J., Tam, V. W. Y. and Haddad, A.

(2021) ‘Modelling the work-as-done in the building maintenance using a layered FRAM: A case study on HVAC maintenance’, Journal of Cleaner Production, 320, pp. 128895. doi: https://doi.org/10.1016/j.jclepro.2021.128895 de Souza, N. P., César, C. d. A. C., Bezerra, J. d. M. and Hirata, C. M. (2020) ‘Extending STPA with STRIDE to identify cybersecurity loss scenarios’, Journal of Information Security and Applications, 55, pp. 102620. doi: https://doi.org/10. 1016/j.jisa.2020.102620 Dghaym, D., Hoang, T. S., Turnock, S. R., Butler, M., Downes, J. and Pritchard, B.

(2021) ‘An STPA-based formal composition framework for trustworthy autono- mous maritime systems’, Safety Science, 136, pp. 105139. doi: https://doi.org/10. 1016/j.ssci.2020.105139 Duan, G., Tian, J. and Wu, J. (2015) ‘Extended FRAM by Integrating with Model Checking to Effectively Explore Hazard Evolution’, Mathematical Problems in Engineering, 2015, pp. 196107. doi: 10.1155/2015/196107 Duan, J. (2022) ‘Improved Systemic Hazard Analysis Integrating With Systems

Engineering Approach for Vehicle Autonomous Emergency Braking System’, ASCE-ASME J Risk and Uncert in Engrg Sys Part B Mech Engrg, 8(3). Dunsford, R. and Chatzimichailidou, M. (2020) ‘Introducing a system theoretic framework for safety in the rail sector: supplementing CSM-RA with STPA’, Safety and Reliability, 39(1), pp. 59–82. doi: 10.1080/09617353.2019.1709289 Eljaoued, W., Yahia, N. B. and Ben Saoud, N. B. (2020) ‘A Qualitative-Quantitative

Resilience Assessment Approach for Socio-technical Systems’, Procedia Computer Science, 176, pp. 2625-2634. doi: https://doi.org/10.1016/j.procs.2020.09.305 Falegnami, A., Costantino, F., Di Gravio, G. and Patriarca, R. (2020) ‘Unveil key functions in socio-technical systems: mapping FRAM into a multilayer network’, Cognition, Technology & Work, 22(4), pp. 877-899. doi: 10.1007/s10111-019- 00612-0 França, J. E. M., Hollnagel, E., dos Santos, I. J. A. L. and Haddad, A. N. (2020)

‘FRAM AHP approach to analyse offshore oil well drilling and construction focu- sed on human factors’, Cognition, Technology & Work, 22(3), pp. 653–665. doi: 10.1007/s10111-019-00594-z France, M. E. (2017) Engineering for humans: A new extension to STPA. Massachusetts Institute of Technology. Friedberg, I., McLaughlin, K., Smith, P., Laverty, D. and Sezer, S. (2017) ‘STPA-

SafeSec: Safety and security analysis for cyber-physical systems’, Journal of Information Security and Applications, 34, pp. 183–196. doi: https://doi.org/10. 1016/j.jisa.2016.05.008 Ge, J., Zhang, Y., Xu, K., Li, J., Yao, X., Wu, C., Li, S., Yan, F., Zhang, J. and Xu, Q.

(2022) ‘A new accident causation theory based on systems thinking and its syste- mic accident analysis method of work systems’, Process Safety and Environmental Protection, 158, pp. 644-660. doi: https://doi.org/10.1016/j.psep.2021.12.036 Grabbe, N., Kellnberger, A., Aydin, B. and Bengler, K. (2020) ‘Safety of automated driving: the need for a systems approach and application of the Functional Resonance Analysis Method’, Safety science, 126, pp. 104665. Hirata, C. and Nadjm-Tehrani, S. ‘Combining GSN and STPA for Safety Argu-

ments’. Computer Safety, Reliability, and Security. Cham: Springer International Publishing, 5–15. Hirose, T. and Sawaragi, T. (2020) ‘Extended FRAM model based on cellular automaton to clarify complexity of socio-technical systems and improve their safety’, Safety Science, 123, pp. 104556. doi: https://doi.org/10.1016/j.ssci.2019.104556

480 Naeini and Nadeau

Hirose, T., Sawaragi, T. and Horiguchi, Y. (2016) ‘Safety Analysis of Aviation Flight- Deck Procedures Using Systemic Accident Model’, IFAC-PapersOnLine, 49(19), pp. 19–24. doi: https://doi.org/10.1016/j.ifacol.2016.10.455 Hollnagel, E. (2012) FRAM, the functional resonance analysis method: modelling

complex socio-technical systems. Ashgate Publishing, Ltd. Howard, G., Butler, M., Colley, J. and Sassone, V. ‘Formal Analysis of Safety and Security Requirements of Critical Systems Supported by an Extended STPA Meth- odology’. 2017 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW), 26–28 April 2017, 174–180. Huang, W., Yin, D., Xu, Y., Zhang, R. and Xu, M. (2022) ‘Using N-K Model to

quantitatively calculate the variability in Functional Resonance Analysis Method’, Reliability Engineering & System Safety, 217, pp. 108058. doi: https://doi.org/10. 1016/j.ress.2021.108058 Jensen, A. and Aven, T. (2017) ‘Hazard/threat identification: Using functional resonance analysis method in conjunction with the Anticipatory Failure Determination method’, Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 231(4), pp. 383–389. doi: Johnson, K. (2016) ‘Systems-theoretic safety analyses extended for coordination’,

Cambridge, MA: Massachusetts Institute of Technology. Joung, T., Kim, H., Kim, Y., Cho, S., Kang, K., Liu, Y. and Lundteigen, M.

(2018) ‘Hazard identification for a dynamic positioning and mooring system in Arctic condition: Complementary use of hazard identification study (HAZID) and Systems Theoretic Process Analysis (STPA)’, Safety and Reliability–Safe Societies in a Changing World: CRC Press, pp. 1735–1742. Kim, Y. C. and Yoon, W. C. (2021) ‘Quantitative representation of the functional resonance analysis method for risk assessment’, Reliability Engineering & System Safety, 214, pp. 107745. doi: https://doi.org/10.1016/j.ress.2021.107745 Lee, J. and Chung, H. (2018) ‘A new methodology for accident analysis with human

and system interaction based on FRAM: Case studies in maritime domain’, Safety Science, 109, pp. 57–66. doi: https://doi.org/10.1016/j.ssci.2018.05.011 Leveson, N. (2011) Engineering a safer world: Systems thinking applied to safety.

MIT press. Li, W., He, M., Sun, Y. and Cao, Q. (2019) ‘A proactive operational risk identification and analysis framework based on the integration of ACAT and FRAM’, Reliability Engineering & System Safety, 186, pp. 101-109. doi: https://doi.org/10.1016/j.re ss.2019.02.012 Liew, L.-S., Sabaliauskaite, G., Kandasamy, N. K. and Wong, C.-Y. W. (2021) ‘A

Novel System-Theoretic Matrix-Based Approach to Analysing Safety and Security of Cyber-Physical Systems’, Telecom, 2(4), pp. 536–553. Available at: https://ww w.mdpi.com/2673-4001/2/4/30 Liu, X., Liu, Z., Lin, K.-C., Huang, Z.-L., Ling, M.-Y., Chen, P.-Q., Huang, X.-M.

and Zhai, Y.-J. (2022) ‘Evaluation of the Operation Process of Medical Equipment to Enhance Ergonomic Reliability Based on FRAM–Moran’s I and CREAM’, Applied Sciences, 12(1), pp. 200. Available at: https://www.mdpi.com /2076-3417/12/1/200 Mason-Blakley, F., Weber, J. and Habibi, R. ‘Prospective Hazard Analysis for Information System’. 2014 IEEE International Conference on Healthcare Informatics, 15–17 Sept. 2014, 256–265. Montes, D. R. (2016) Using STPA to inform developmental product testing. Doctoral

dissertation, Massachusetts Institute of Technology.

A Review of the Application of FRAM and STAMP Approaches Combined 481

Pardo-Ferreira, M. d. C., Martínez-Rojas, M., Salguero-Caparrós, F. and Rubio- Romero, J. C. (2019) ‘Evolution of the Functional Resonance Analysis Method (FRAM) through the combination with other methods’, Dirección y Organiza- ción, pp. 41–50. Patriarca, R., Bergström, J. and Di Gravio, G. (2017a) ‘Defining the functional reso-

nance analysis space: Combining Abstraction Hierarchy and FRAM’, Reliability Engineering & System Safety, 165, pp. 34–46. doi: https://doi.org/10.1016/j.ress .2017.03.032 Patriarca, R., Chatzimichailidou, M., Karanikas, N. and Di Gravio, G. (2022) ‘The past and present of System-Theoretic Accident Model And Processes (STAMP) and its associated techniques: A scoping review’, Safety Science, 146, pp. 105566. doi: https://doi.org/10.1016/j.ssci.2021.105566 Patriarca, R., Di Gravio, G. and Costantino, F. (2017b) ‘A Monte Carlo evolution of

the Functional Resonance Analysis Method (FRAM) to assess performance vari- ability in complex systems’, Safety science, 91, pp. 49–60. doi: https://doi.org/10. 1016/j.ssci.2016.07.016 Riccardo, P., Gianluca, D. P., Giulio, D. G. and Francesco, C. (2018) ‘FRAM for systemic accident analysis: a matrix representation of functional resonance’, International Journal of Reliability, Quality and Safety Engineering, 25(01), pp. 1850001. Rosa, L. V., Haddad, A. N. and de Carvalho, P. V. R. (2015) ‘Assessing risk in sustai-

nable construction using the Functional Resonance Analysis Method (FRAM)’, Cognition, Technology & Work, 17(4), pp. 559-573. doi: 10.1007/s10111-015- 0337-z Salehi, V., Smith, D., Veitch, B. and Hanson, N. (2021) ‘A dynamic version of the FRAM for capturing variability in complex operations’, MethodsX, 8, pp. 101333. doi: https://doi.org/10.1016/j.mex.2021.101333 Sekeˇlová, F. and Lališ, A. (2019) ‘Application of resilience assessment grid in pro-

duction of aircraft components’, MAD-Magazine of Aviation Development, 7(4), pp. 6–11. Silva Castilho, D. (2019) Active STPA: integration of hazard analysis into a Safety Management System Framework. Massachusetts Institute of Technology. Slim, H. and Nadeau, S. (2019) ‘A proposal for a predictive performance assessment

model in complex sociotechnical systems combining fuzzy logic and the Functi- onal Resonance Analysis Method (FRAM)’, American Journal of Industrial and Business Management, 9(6), pp. 1345–1375. doi: https://doi.org/10.4236/ajibm. 2019.96089 Slim, H. and Nadeau, S. (2020) ‘A mixed rough sets/fuzzy logic approach for modelling systemic performance variability with FRAM’, Sustainability, 12(5), pp. 1918. doi: https://doi.org/10.3390/su12051918 Sousa, M. S. D., Torres, F. M. and Jorge, A. B. (2017) ‘Application of STAMP metho-

dology in one complex manufacturing system’, International Journal of Industrial and Systems Engineering, 27(3), pp. 311–339. Souza, F. G. R. d., Bezerra, J. d. M., Hirata, C. M., Saqui-Sannes, P. d. and Apvrille, L. ‘Combining STPA with SysML Modeling’. 2020 IEEE International Systems Conference (SysCon), 24 Aug.-20 Sept. 2020, 1-8. Thapaliya, A. and Kwon, G. (2017) ‘Reliability and control theory: an integra-

tion approach for safety analysis’, Advances in Computer Science and Ubiquitous Computing: Springer, pp. 1244–1249. Toda, Y., Matsubara, Y. and Takada, H. ‘FRAM/STPA: Hazard Analysis Method for FRAM Model’. Proceedings of the 2018 FRAM Workshop. Cardiff, Wales, 1–17.

482 Naeini and Nadeau

Torkildson, E. N., Li, J. and Johnsen, S. O. ‘Improving security and safety co-analysis of stpa’. Proceedings of the 29th European Safety and Reliability Conference (ESREL), 22–26. Wang, Y. and Wagner, S. ‘Poster: Combining STPA and BDD for Safety Analysis and

Verification in Agile Development’. 2018 IEEE/ACM 40th International Confe- rence on Software Engineering: Companion (ICSE-Companion), 27 May-3 June 2018, 286–287. Xing, X., Zhou, T., Chen, J., Xiong, L. and Yu, Z. ‘A Hazard Analysis Approach based on STPA and Finite State Machine for Autonomous Vehicles’. 2021 IEEE Intelligent Vehicles Symposium (IV), 11–17 July 2021, 150–156. Yang, Q. and Tian, J. ‘Model-based safety assessment using FRAM for complex

systems’. Proceedings of the 25th European Safety and Reliability Conference. Yang, Q., Tian, J. and Zhao, T. (2017) ‘Safety is an emergent property: Illustrating functional resonance in Air Traffic Management with formal verification’, Safety Science, 93, pp. 162–177. doi: https://doi.org/10.1016/j.ssci.2016.12.006 Yu, M., Erraguntla, M., Quddus, N. and Kravaris, C. (2021) ‘A data-driven approach

of quantifying function couplings and identifying paths towards emerging hazards in complex systems’, Process Safety and Environmental Protection, 150, pp. 464– 477. doi: https://doi.org/10.1016/j.psep.2021.04.037 Yu, M., Quddus, N., Kravaris, C. and Mannan, M. S. (2020) ‘Development of a FRAM-based framework to identify hazards in a complex system’, Journal of Loss Prevention in the Process Industries, 63, pp. 103994. doi: https://doi.org/10.1016/ j.jlp.2019.103994 Zheng, Z. and Tian, J. ‘Bridging the gap between FRAM and safety practice by appl-

ying FSM and model checking’. 2015 First International Conference on Reliability Systems Engineering (ICRSE), 21-23 Oct. 2015, 1–6. Zheng, Z., Tian, J. and Zhao, T. (2016) ‘Refining operation guidelines with modelchecking-aided FRAM to improve manufacturing processes: a case study for aeroengine blade forging’, Cognition, Technology & Work, 18(4), pp. 777–791. doi: 10.1007/s10111-016-0391-1 Zinetullina, A., Yang, M., Khakzad, N., Golman, B. and Li, X. (2021) ‘Quantita-

tive resilience assessment of chemical process systems using functional resonance analysis method and Dynamic Bayesian network’, Reliability Engineering & System Safety, 205, pp. 107232. doi: https://doi.org/10.1016/j.ress.2020.107232

Cover of the proceedings volume Human Factors and Systems Interaction

Explore the complete digital volume

Human Factors and Systems Interaction

Read this individual research paper free through the original publisher, or explore the full digital proceedings book.

ISBN 978-1-958651-28-5

Explore this ISBN in the AHFE Bookstore Listed in the July 2026 bookstore catalogue; search by ISBN to confirm current availability · Digital book purchase optional

Explore Related Research

Related research 8 matches

More papers from this volume

← Back to Research ExplorerBrowse the full library →