INTRODUCTION
The rapid advancement of artificial intelligence (AI) has transformed numerous industries by altering procedures and redefining human roles
© 2025. Published by AHFE Open Access. All rights reserved. 95
(Madhan & Deeraj, 2023). As automation has proven to enhance efficiency, improve quality control, and reduce errors for specific manufacturing related jobs, occupations including assembly line workers who perform repetitive tasks may face high risk of job displacement (Gurav et al., 2024). However, this shift does not imply the complete replacement of humans in these roles. Instead, workers are transitioning from routine, manual roles to supervisory positions that require higher use of decision-making and problem-solving skills (Ge et al., 2021; Downey, 2021). Humans retain a critical role in overseeing automation, ensuring safe and optimized operations. This shift naturally fosters a collaborative partnership between humans and machines, requiring the human to learn additional knowledge, skills, and abilities, such as trusting the system, understanding system limitations, and knowing when to intervene appropriately (Paschkewitz & Patt, 2020).
There is an increasing reliance on technology across many occupations. For instance, tax preparers once relied on manual calculations using calculators, but now, software programs assist with computations, enabling faster and more accurate results. While these roles are not traditionally considered ‘technology jobs,’ future professionals in these fields must develop technological skills to efficiently perform their respective tasks. Similar transformations have occurred across various industries, where most modern occupations now require some level of technological proficiency. MacCrory and colleagues (2014) found that the skill content of occupations has changed so significantly that the knowledge and skills required before the digital age differ fundamentally from those needed today.
As machines become increasingly prevalent, there is a growing emphasis on understanding the knowledge and skills in which humans excel. While automation surpasses human capabilities in tasks such as arithmetic and pattern recognition (Dreyfus & Dreyfus, 1986), human oversight remains essential in handling unforeseen or abnormal situations that automation cannot anticipate or adapt to. Additionally, tasks requiring novel solutions and creative problem-solving are better suited to be performed by humans, as machines do not reliably generate new information (Traumer et al., 2017). Therefore as automation becomes more integrated into the workforce, skills like creative thinking, critical thinking, and problem-solving will become increasingly valuable for human operator roles.
ADAPTING COMPETENCY MODELS FOR HUMAN-AI COLLABORATION With AI integration expanding across industries, systematically identifying the evolving knowledge and skills needed for updated human roles is essential. The military, for example, has leveraged automation to reduce training time and costs, such as in unmanned aerial vehicle (UAV) training for automated landings and takeoffs (Cummings et al., 2019). By allowing the automation to conduct higher-workload phases of flight like landing, UAV operators with minimal flight experience can train for the MQ-1 Predator, significantly reducing training time (Blacke, 2009). Consequently, the instructional material must reflect these changes—placing less emphasis
Competency Modeling in a Digital Age: Redefining Skills and Capabilities 97
on manual takeoff and landing skills and focusing more on supervisory related tasks, which require an updated set of knowledge and skills.
Further, a shift in human operator tasks has been demonstrated through the Aircrew Labor In-Cockpit Automation System (ALIAS) program, developed by the Defense Advanced Research Projects Agency (DARPA) to reduce pilot workload in the flight deck. This system aimed to integrate higher levels of automation into existing aircraft, alleviating crew workload. Paschkewitz & Patt (2020) assessed ALIAS’s effectiveness, particularly in scenarios where pilots were expected to compute energy requirements during landing with a failed engine, which is often taxing on the pilot-especially during a high workload phase of flight. The study found that the ALIAS effectively assisted the pilot in computing energy requirements, as the pilot handled the aircraft more safely and with greater ease. As ALIAS reduced the need for routine piloting skills, the system also highlighted the critical role of human pilots in managing unforeseen circumstances (Paschkewitz & Patt, 2020). While automation could handle standard piloting tasks, it could not replace the pilot’s cognitive adaptability required in unpredictable and ambiguous situations. These factors are often overlooked in programming due to their endless variability. Ultimately, the study reinforced the necessity of human-machine collaboration, where automation supports pilots rather than replaces them. In order to facilitate the training of the capabilities required to work in this new digital age and collaborate effectively with technology, we need to understand what roles the humans play, and the requirements to successfully fulfill these roles.
Competency models serve as structured frameworks that define the knowledge, skills, abilities, and other characteristics (KSAOs) required for effective job performance (Schippmann et al., 2000). Unlike traditional job analysis, which inductively identifies job tasks and required KSAOs, competency modeling is more deductive, focusing on desired outcomes and working backward to determine necessary competencies (Campion et al., 2011). This approach allows organizations to align competencies with strategic objectives, ensuring that employees develop attributes essential for success in evolving job roles. Moreover, competency models facilitate a broader understanding of job performance by encompassing not only task-specific skills but also softer attributes such as adaptability, teamwork, and creative thinking (Rodriguez et al., 2002). The Air Force does this by distinguishing between institutional and occupational competencies, with the former being KSAOs that are applicable to all Airmen, and the later targeting technical and mission-specific expertise (Roberson et al., 2017).
A key advantage of competency modeling over traditional job analysis is the ability to include future-oriented requirements, making it particularly valuable in dynamic and evolving environments. For example, the U.S. Department of State’s “Project Horizon,” included the use of future- oriented scenario workshops to identify important competencies in a future where China and the rest of Asia dominate the world. In this initiative, subject matter experts (SMEs) analyzed alternative global scenarios and identified emerging competencies necessary for diplomatic effectiveness. The U.S. Army has also employed forward-looking competency modeling to
define the skills required for 21st-century warfare, emphasizing adaptability, decision-making, and mission-essential competencies (Ford et al., 2000). The identification of these future-oriented competencies allows us to move beyond what current job performance requires and gain a better understanding of what training and development are needed to help servicemembers prepare for future situations.
In addition to applications in recruiting, selection, and performance appraisals, competency models can also be used to identify training gaps and guide learning and development programs toward well-defined outcomes. Unlike traditional training methods that emphasize course completion, competency-based training prioritizes the mastery of essential competencies. By systematically identifying the competencies needed for a job, one can ensure that learning resources align with the relevant KSAOs across competencies. This structured framework can also be used to categorize performance data into predefined standards, ensuring consistency in data collection and classification.
In contrast to traditional task-based models that emphasize discrete tasks and procedural knowledge, competency models provide a more comprehensive view by identifying the underlying knowledge and skills that drive effective performance (Schippmann et al., 2000). This broader perspective enhances flexibility and adaptability, preparing individuals to navigate evolving roles and unpredictable environments. As automation reshapes industries, competency models must remain dynamic, allowing instructional designers to identify emerging skill and knowledge requirements to proactively update competency models and training curricula. By incorporating emerging competencies and KSAOs while removing outdated ones, training programs remain relevant and comprehensive. This ensures that human operators are equipped with the necessary expertise to perform their jobs safely and effectively. For example, when operating an aircraft with newly installed automation, a pilot must be proficient in using the UI interface to monitor and manage automated systems safely. By integrating UI navigation skills into training curricula, instructional designers can ensure pilots receive consistent and comprehensive instruction, equipping them with the expertise needed to operate the aircraft safely and effectively.
COMPETENCY MODELLING APPROACHES Competency models can be structured in various ways. In the current example, a competency model was organized hierarchically with the competencies at the top, segmented into tasks, and then further categorized into knowledge (essential information for skill and attitude development), skills (measurable task performance capability), and abilities (current action performance capacity) (AFH 36-2647, 8 Feb 2022). To develop a flexible competency model that could easily accommodate updates and modifications to the human role, a cognitive work analysis (CWA; Vincenti, 1999) approach was used in creating a competency model for pilots to operate an eVTOL aircraft under development. Given the novelty of the aircraft, CWA was the ideal method as it accounted for unpredictable, non-routine operations. The
Competency Modeling in a Digital Age: Redefining Skills and Capabilities 99
unique challenges of this emerging technology required a flexible, iterative approach to competency modeling to meet evolving demands.
The process of developing the competency model began with domain familiarization to gain a better understanding of the pilot role. To further explore the eVTOL pilot role, multiple knowledge elicitation (KE) sessions were conducted with stakeholders. The data gathered from these sessions enabled the team to identify specific tasks and KSAOs applicable to the human role while also establishing connections between competencies, tasks, knowledge, and skills while eliminating redundancies to enhance model accuracy. Extensive collaboration with SMEs was necessary to iteratively refine and validate the model, ensuring the model correctly represented the pilot role. Once the key competencies, tasks, and KSAOs were defined, the team synthesized the information into a structured framework, mapping tasks across competencies and aligning knowledge and skills with relevant tasks. This transition to a task-based approach provided a clear blueprint for instructional designers, allowing them to adapt the competency model as the aircraft evolved.
To keep competency models relevant in the digital age, organizations must engage SMEs and industry leaders in continuous refinement. SMEs provide valuable insights into the changing nature of work and ensure that competency frameworks remain aligned with industry standards. Regular consultation with professionals across diverse fields allows organizations to identify emerging trends and skills gaps before they become critical deficiencies. Additionally, adopting a modular and adaptive framework enables competency models to remain flexible and responsive to industry shifts. By structuring competencies in a hierarchical fashion and tying them to tasks, organizations can update their models incrementally without requiring a complete overhaul. Another important approach is integrating future scenario planning into competency model development. This proactive method ensures that workforce development strategies remain robust even in the face of rapid technological advancements. Future scenario planning allows organizations to prepare employees for a range of possible changes, equipping them with versatile skills that will remain valuable despite uncertainty.
Expanding competency models to include interdisciplinary skills is another critical step in keeping them relevant. As job roles become increasingly cross-functional, employees must develop competencies that span multiple domains. For example, cybersecurity professionals must not only have technical expertise but also an understanding of legal regulations and ethical considerations. Similarly, healthcare providers using AI-assisted diagnostic tools require both medical knowledge and digital literacy. Organizations that integrate interdisciplinary competencies into their models will ensure their workforce is better prepared to handle complex, multi-faceted job demands. Competency development should also be embedded into training and talent management programs. Aligning competency models with career progression pathways allows employees to develop the necessary skills in a structured and strategic manner. AI-driven personalization in training can help tailor learning experiences based on an individual’s competency gaps, ensuring
that employees receive targeted development opportunities that enhance their proficiency in key areas.
Organizations must continuously monitor industry trends and regulatory changes that impact workforce competencies. As new regulations, technological advancements, and economic shifts emerge, competency models should be revisited and adjusted accordingly. By maintaining agility in competency frameworks, organizations can remain competitive and ensure that their workforce is equipped to navigate a rapidly evolving professional landscape.
CONCLUSION
As human-AI teams become increasingly prevalent in defense and other high-stakes domains, competency modeling must evolve to account for the unique challenges of human-machine collaboration. Effective team performance depends on both taskwork—the execution of technical tasks— and teamwork—the integration of interpersonal, and cognitive skills necessary for coordination (Eccles & Tanenbaum, 2004; Salas et al., 1992). In other words, competency models for human-AI teams should define technical proficiencies to interact with AI systems, along with cognitive and adaptive skills necessary for dynamic teaming. By structuring training and assessment around these competencies, organizations can ensure that personnel are equipped to operate effectively alongside AI, leveraging human strengths in decision-making, creativity, and ethical reasoning while maximizing AI-driven efficiencies.
Ultimately, the success of human-AI collaboration will depend on organizations’ ability to continuously refine competency models that support workforce adaptability. As job roles evolve alongside technological advancements, competency models must be updated to reflect these changes—removing outdated tasks, revising existing ones, and incorporating new technology-driven responsibilities. By leveraging AI to augment human expertise rather than replace it, industries can cultivate a resilient, future-ready workforce capable of thriving in complex, technology-driven environments.
REFERENCES
Air Force Handbook 36–2647 (2022, 8 Feb). Competency Modeling. Available at: https://static.e-publishing.af.mil/production/1/af_a1/publication/afh36-2647/ afh36-2647.pdf. Blacke, K. (2009). Tinker Airman graduates in first class of UAV operators.
Retrieved from https://www.tinker.af.mil/News/ Article-Display/Article/386504/ tinker-airman-graduates-infirst-class-of-uav-operators/. Cummings, M., Huang, L., Zhu, H., Finkelstein, D., & Wei, R. (2019). The impact of increasing autonomy on training requirements in a UAV supervisory control task. Journal of Cognitive Engineering and Decision Making, 13(4), 295–309. Campion, M. A., Fink, A. A., Ruggeberg, B. J., Carr, L., Phillips, G. M., &
Odman, R. B. (2011). Doing competencies well: Best practices in competency modeling. Personnel Psychology, 64, 225–262.
Competency Modeling in a Digital Age: Redefining Skills and Capabilities 101
Downey M (2021) Partial automation and the technology-enabled deskilling of routine jobs. Labour Econ. 69:101973. https://doi.org/10.1016/j.labeco.2021. 101973 Dreyfus, H., & Dreyfus, S. E. (1986). Mind over machine. Simon and Schuster. Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T.,... &
Williams, M. D. (2021). Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. International journal of information management, 57, 101994. Eccles, D. W., & Tenenbaum, G. (2004). Why an expert team is more than a team of experts: A social-cognitive conceptualization of team coordination and communication in sport. Journal of Sport and Exercise Psychology, 26(4), 542–560. Ford LA, Campbell RC, Campbell JP, Knapp DJ, Walker CB. (2000). 21st century
soldiers and noncommissioned officers: Critical predictors of performance (Technical Report 1102). Alexandria, VA: U. S. Army Research Institute for the Behavioral and Social Sciences. Gurav, V. S., Gugnani, A., Meena, Y. R., Marathe, V., Vijay, S. A. A., & Nanda, S.
(2024, June). The Impact of Industrial Automation on the Manufacturing Industry in the Era of Industry 4.0. In 2024 15th International Conference on Computing Communication and Networking Technologies (ICCCNT) (pp. 1–6). IEEE. Ge P, Sun W, Zhao Z (2021) Employment structure in China from 1990 to 2015. J.
Econ Behav Organ 185:168–190. https://doi.org/10.1016/j.jebo.2021.02.022 MacCrory, F., Westerman, G., Alhammadi, Y., & Brynjolfsson, E. (2014). Racing with and against the machine: Changes in occupational skill composition in an era of rapid technological advance. Paschkewitz, J., & Patt, D. (2020). Can AI make your job more interesting?. Issues
in Science and Technology, 37(1), 74–78. Roberson, D. L., Stafford, M. C., & Air University Press. (2017). The Redesigned Air Force Continuum of Learning (pp. 1–2). Air University Press. Rodriguez, D., Patel, R., Bright, A., Gregory, D., & Gowing, M. K. (2002).
Developing competency models to promote integrated human resource practices. Human Resource Management, 41, 309–324 Salas, Eduardo, Drew Rozell, Brian Mullen, and James E. Driskell. “The effect of team building on performance: An integration.” Small group research 30, no. 3 (1999): 309–329. Schippmann JS, Ash RA, Battista M, Carr L, Eyde LD, Hesketh B,... Sanchez I. (2000).
The practice of competency modeling. Personnel Psychology, 53, 703–740. Strauch, B. (2017). Ironies of automation: Still unresolved after all these years. IEEE Transactions on Human-Machine Systems, 48(5), 419–433. Vempati, L., Geffard, M., & Anderegg, A. (2021, October). Assessing human-
automation role challenges for urban air mobility (UAM) operations. In 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC) (pp. 1–6). IEEE. Vicente, K. J. (1999). Cognitive Work Analysis. Mahwah, NJ: Lawrence Erlbaum Associates. Zhang, X. Y., Liu, C. L., & Suen, C. Y. (2020). Towards robust pattern recognition:
A review. Proceedings of the IEEE, 108(6), 894–922. Zhang, W., Lai, K. H., & Gong, Q. (2024). The future of the labor force: Higher cognition and more skills. Humanities and Social Sciences Communications, 11(1), 1–9.