INTRODUCTION
In the era of digitalisation and large technological leaps being made almost daily in European industry, stressing the need for human centricity as is done in the EC white paper on Industry 5.0 (Renda et al., 2022) is essen- tial. As computerised systems of many kinds become more advanced and spread quickly among companies, remembering that in many cases, the effi- cient utilisation of these systems will often still require a human touch. The
© 2023. Published by AHFE Open Access. All rights reserved. 152
Information Display Preferences for Assembly Instructions in 6 Industrial settings 153
Operator 4.0 typology projects eight different types of industrial operators as they will emerge from the technological advancements made in the Indu- stry 4.0 paradigm (Romero et al., 2016) and is heavily cited in the Industry 5.0 white paper. It also highlights among other things the need for proper communication between systems and users to be able to utilise the coming technological advancements. Something that is even further highlighted in the cognitive operator 4.0 by Thorvald et al. (2021).
We detail results from a study into assembly worker preferences for infor- mation presented in assembly instructions. This study was comprised of company visits and interviews at six manufacturing companies in Sweden, and is a part of a research project, Digitalis (DIGITALa arbetsInStrukti- oner för kognitivt arbete, Eng. DIGITAL work InStructions for cognitive work) that aims to create support material for selecting appropriate types and modes of information presentation for assembly workers. The comple- xity of assembly at the collaborating companies varies from extremely low complexity where instructions are used to support workers with no expe- rience and in some cases with cognitive disabilities, to extremely complex assembly work requiring specialised skills and up to years of training. All but one of the companies must contend with product variation, ranging from infrequent variants, to nearly every assembly being unique.Two workers were interviewed at each company and the interviews transcribed and analysed.
The first stage, presented here, is to identify worker preferences for information presentation for the different assemblies, as well as analysing common strengths and weaknesses of the companies involved, as it pertains to supporting workers in assembly.
Some introduction is required as to the human aspect of assembly work and instruction use.
COGNITIVE ASPECT THAT AFFECT ASSEMBLY WORKERS The selection of instructions that are presented to operators affect time effi- ciency, errors, as well as human cognition (Berlin & Adams, 2017; Konz & Dickey, 1969: Li et al., 2018). Higher cognitive functions, located in the prefrontal cortex, are responsible for our ability to reason, think, plan, and make decisions (Funahashi, 2015; Miller, 2000). These functions are used in everyday life, as well as in work-related situations. Whatever we do, easy or complex, cognitive load is affected. This is exacerbated during prolonged, difficult, or complex tasks. This means that a task that in normal circumsta- nces creates a manageable cognitive load can cause excessive cognitive load when the task goes on for a longer time, which in turn can cause mental fati- gue (Mizuno et al., 2011). Fatigue and cognitive overload are known to limit central functions such as memory and attention. These advanced functions are required for interpreting and processing instructions in order to succes- sfully complete the task at hand (Berlin & Adams, 2017). Fatigue can further pose a great threat to workers’ safety as their ability to quickly respond to unexpected situations significantly slows down. However, the state of fatigue is generally considered inevitable and is not bound to specific professions or task assignments (Williamson et al., 2011).
One simple explanation of cognitive load is how much information wor- king memory can receive and hold simultaneously, and whether that infor- mation gets stored in long-term memory or not, thus affecting the capacity for learning (Baddeley, 1992). The working memory itself has a very limi- ted capacity for simultaneous processing. Information that is consciously received and unfamiliar information is only held temporarily in working memory and hence requires a lot of mental effort (Funahashi, 2017; Swel- ler, 2005). More so, working memory is greatly involved in cognitive tasks such as reading, problem solving, learning, and decision making (Baddeley & Hitch, 1974). If the received information is too complex and requires more than the current attention capacity then working memory storage overflows, causing cognitive overload (Paas, Renkl, & Sweller, 2003; Sweller & Chand- ler, 1994). On the other hand, long-term memory (LTM) seems to have no maximum capacity (Funahashi, 2017). Cognitive load affects performance in many different areas (Fridman et al., 2018), and work-related tasks are no exception. Hence why Kalyuga, Chandler, and Sweller (2003) state the importance of maintaining an appropriate level of cognitive load while pro- cessing new information in an attempt to not only involve working memory, but to allow encoding into long-term memory as well.
Cognitive Load Theory A widely used theory concerned with how humans process information, which is also critical during periods of learning, is the Cognitive Load Theory (CLT). CLT is widely used in the development of instructions, often with a focus on how the instructions should be formulated to make use of the limi- ted human cognitive capacity (Paas et al., 2016). The CLT framework allows cognitive load to be separated into different sub-types of cognitive load as outlined by Sweller, (1994). These are: extraneous-, intrinsic-, and germane cognitive load (Sweller, 1994). Sweller (1994) describes intrinsic load as the basis for understanding concepts, extraneous load as being sensitive to poor instructions since it entails the link between presentation and design, and finally germane load which is concerned with more subjective aspects such as interest and motivation. Each type of cognitive load thus focuses on a different aspect of cognition.
Cognition and Assembly Instructions It has further been shown that experience and prior knowledge are greatly related to the amount of cognitive load that the brain experiences (Cook, 2006; Kalyuga, Chandler, & Sweller, 1998; Kalyuga et al., 2003; Marcus, Cooper, & Sweller, 1996). One explanation for this is that schemas stored in long-term memory makes processing new information (such as instructi- ons) require significantly less effort (Marcus, Cooper, & Sweller, 1996). This makes sense at an intuitive level, since more knowledge and experience within a certain area often connects with other tasks that are relatable to the system. Despite this smart function, allowing for a lowered experienced cognitive load, other issues can arise due to the expertise reversal effect. The exper- tise reversal effect claims that using the same instructions for experienced
Information Display Preferences for Assembly Instructions in 6 Industrial settings 155
and inexperienced personnel can lead to negative consequences. As informa- tion from instructions is processed, it might be redundant for the experienced personnel and put unnecessary load upon them (Kalyuga et al., 2003); which is why instructional design (also known as instructional system design) is of importance. Not only does instructional design influence cognitive load but it also influences the learning curve. Multiple studies suggest that cognitive load can be improved by simply changing operators’ instructions. One solution for this could be by including pictures onto altogether text-based instructions as suggested by Li et al. (2018). This is often referred to as multimedia instru- ctions which include the use of pictures (illustrations, animations, etc.) and words (either printed or spoken) to speed up the learning process (see e.g., Mayer & Moreno, 2003). However, cognitive load, related to this field has not always been prioritised.
Common Instruction Types in Industry Traditionally, the most common way to carry out instructions and educate workers of their tasks has been word of mouth. The method requires more experienced personnel (or other knowledgeable staff) to verbally explain to new workers how to carry out the work-related task (Fox, 2010; McCalla et al., 1997). The second most commonly used method, historically and currently and for both unexperienced and experienced personnel, is paper instructions (Funk, Kosch, & Schmidt, 2016; Serván et al., 2012). According to Lai et al. (2020), industrial companies are currently experiencing problems with having too few experienced workers and a rapid increase in new person- nel simultaneously. This causes great variance in technical skills, culture, and educational level, within companies (Romero et al., 2016). Furthermore, as assembly workers’ tasks are becoming more complex and increasing in vari- ety due to global distribution requiring more customisation (ElMaraghy et al., 2012; Lai et al., 2020; Sand et al., 2016), methods adapted for human cogni- tion have become more attractive in the field of instructional design (Funk, Kosch, & Schmidt, 2016); sometimes referred to communication design in research (Fox, 2010).
Nowadays, instructions are also often shown on large computer screens near the assembly stations. These instruction can be quite similar to the old paper instructions, basically “paper on screen”, or may be adapted to show more images such as photos, static or interactive 3D images generated from CAD software, or videos (Berlin & Adams, 2017). These on-screen instructi- ons are more common in the companies being explored in this study, although paper instructions often exist as a backup, or to verify assembly tasks that have not yet been updated in the database for the on-screen instruction displays.
New technologies are also being explored for showing instructions, such as different forms of mixed reality, where instructions or virtual parts are overlaid in the worker’s field of vision. These are largely divided into a few different forms of head mounted displays (HMDs) that can generat virtual reality (VR) or augmented reality (AR), projector systems that project an image onto the object in the world, or handheld augmented reality (HAR)
devices where an image combined from the camera input and virtual objects is shown on screen.
These system may hold promise for certain applications, but results dif- fer when testing HMD devices. While Funk et al. (2016) showed HMD based instructions to cause less perceived cognitive load and minimise errors, Drouot et al. (2022) found AR to increase cognitive load and reduce workers’ ability to respond to external events, causing danger. However, Jasche et al. (2021), show handheld augmented reality (HAR) to generate fewer errors than HMD, inn addition to being more cost-effective (Sanna et al., 2015).
In addition to the possible limitations shown by Drouot et al. (2022) cur- rent HMDs have been found to cause discomfort such as nausea or headaches (Vávra et al., 2017). Based on this, mixed reality approaches will not be the focus of this work, due to limitations in their implementation at this time.
METHOD
Each company presented their requirements at project meetings. Each com- pany was subsequently visited, and presented in more detail the information presentation for assembly instructions on selected assembly stations, how assembly is performed, and processes for e.g. improvement and quality control. The facilities were then toured, and assembly operations were observed.
Two workers were interviewed at each company. Workers’ experience ran- ged between 2 to 25 years. Audio was recorded of each interview except at one company due to policies in place. In this case, extensive notes were taken. The interviews were transcribed verbatim, and coded. Codes were analysed to find similarities, or dissimilarities. Transcripts were also analysed from the standpoint of 3 main points: Worker experience (beginner/experie- nced), assembly complexity (simple/complex), and how common the variant is (common/rare).
FINDINGS The findings presented are general findings that applied to multiple areas, then as lists of preferences for the different focus groups, beginner/experie- nced, then for simple/complex assembly, and finally for whether it involves a common assembly or a more rare variant. These categorised preferences may replicate the general, in which case explanations mostly apply to the specifics of the preference as it pertains to the current category.
In General, Workers Preferred
- Simplified visual instructions as the focal point, and mentioned CAD images as being far preferable to photographs.
- A picture of the final, assembled product after the current assembly step
- Step-by-step, with suitably small steps.
- Show text as support where needed. In some cases by interacting with the instructions (e.g. clicking on a particular image).
Information Display Preferences for Assembly Instructions in 6 Industrial settings 157
- A viewpoint on the image that matches the assembly worker’s viewpoint was seen as being important.
- Clear and simple highlights on images.
- Standards, i.e. that all instructions follow the same standards for style and formatting. That highlights do not differ based on who made the instruction.
- Making the instructions representative of how the assembly is performed. If not, assembly workers find their own way.
- Integrating the assembly instructions into the task if verification is requi- red. Workers report that where they should read one instruction, perform an assembly step, go to the computer to verify, then read the next instru- ction etc. they instead glance at all the instructions, perform all the assembly steps, then go to the computer and verify all at once. They are aware that this increases risks of mistakes, but argue that the risks are low and that mistakes can be caught at the next station. Workers ask for easy, low mental/physical/time cost ways for verification.
- Photographs are disliked by interviewees, who mention photos unprom- pted as being inferior (although having a photo is seen as being better than no graphical support at all). Interviewees made comments to the effect of photographs being hard to read in good conditions, but in bad conditions (e.g. poor lighting in the photo) or at the typical assembly distance then the photographs are generally not seen as being helpful at all.
- A simple connection between parts/tools in instructions and in the world. Avoid parts numbers for screws or tools, use instead a concept that works with human attention and both short term and long term memory. Conce- pts such as “10mm socket wrench” or 8x10mm screw are helpful, part numbers cause problems.
Highlights on the CAD image that show WHERE the screws or objects should be mounted are particularly highlighted by workers where either vari- ants may have wildly differently mounted elements, or many points that need attention for screws, sealant, or other specific tasks to be performed or dou- ble checked. For this, the workers showed a preference for the clearest and simplest method used in their own company, in many cases red circles or the like.
Experience
- Beginners: Step-by-step instructions are seen as more important for beginners.
- Beginners: Require all steps to be included, in the correct order.
- Beginners: Video instructions, including looping video, is seen as being helpful.
- Experienced: Can handle more types of instructions and more complex assembly. Need little support for standard assemblies.
- Experienced: Prefer mostly images that can be seen from the assembly station, and avoid going to the screen for verification more than necessary.
- Experienced: Do not notice gaps in instructions or questionable order of operations. Assemble “their way” anytime instructions are unclear. More
precise instructions help with keeping a standard. Experienced workers mostly notice gaps or problems with assembly order when training new personnel.
Somewhat surprisingly, experienced assembly workers not only pointed out the benefits of simplified visual instructions for beginners, but also preferred those for themselves. The experienced workers showed a strong preference for simplified 3D images showing the product ready after the current assembly. The preference was particularly clear when it came to assembling variants that are less common or require unusual manoeuvring of objects. An extremely experienced worker said “I can work with text instru- ctions that say, for example ‘fasten clamp, connector inwards”’, but they then follow that by stating that having images is much better for beginners, and also better for themselves, and visual instructions for orientation of elements such as clamps or other fasteners is helpful.
Complexity of Task
- Low complexity: Detailed instructions only needed for beginners, then step-by-step graphical instructions are seen as better, or videos.
- High complexity: Interactive 3D CAD images were seen as being helpful for complex assembly work.
- High complexity: Markings highlighting location of screws, sealant, or other items that must be placed correctly is critical. Text instructions were described as being particularly unhelpful for this, even for highly experienced workers.
Higher task complexity, unsurprisingly, led to a preference for more detail, but also a better overview. Experienced workers with access to displays that showed the product ready in a main picture and steps in images below were extremely positive as to how useful that type of display is, while workers with simpler tasks pointed to that kind of display as being useful to train beginners.
Variants
- Rare variants: Getting CAD generated images of rare variants was requested by most workers.
- Rare variants: Video (including looping video) was also suggested by some workers as being helpful for rare variants to assist the memory, even for experienced worker
- Common variants: Minimising the information shown, after training. Workers reported not using instructions for common variants, except for verification after assembly.
Surprisingly many interviewees pointed out problems with getting visual instructions updated. The more complex visualisations such as CAD images animated CAD videos were particularly prone to be missing steps, not be updated quickly for the a version of the assembly, or even having less common variants missing, all of which was reported as being problematic. The workers further pointed out that situations where easy to use instructions were most
Information Display Preferences for Assembly Instructions in 6 Industrial settings 159
likely to be missing were the ones where good instructions make the most difference in assembly, such as with uncommon variants, new assemblies, or complex assemblies.
CONCLUSION
This study has had access to state-of-the-art manufacturing companies and highly experienced, and skilled personnel, both at the assembly tasks at hand but also in some cases experienced at training new personnel. As such, the findings are likely to apply to other companies of similar character. The inte- rviewees were open, forthcoming, and very willing to discuss aspects of their work with the goal of improving the workplace.
The findings were varied, with some being quite surprising. Among these surprising findings is workers’ strong preference for simplified images, and how they pointed to this being better not only for beginners but also for expe- rienced workers, if the instructions are well done. Another surprising finding was that across the companies, and across very different personalities, expe- rienced workers follow the instructions only so long as the instructions and associated systems are helpful in the work. If instructions are out of order, or require extra work (such as walking back and fort) for verifying, then workers will effectivise their work and rely on experience instead. This highlights the importance of designing, and indeed updating, instructions in collaboration with assembly workers, and suggests the need for a continuous process that involves technicians, CAD constructors, and assembly personnel at all times. In addition to this, workers’ discussion about even well designed instructions being confusing if they differ based on who makes them is interesting in light of the work of e.g. Marcus, Cooper, and Sweller, (1996) around schemas, and how they help with processing new information. Schemas suggest that begin- ners’ cognitive load is significantly affected by non-standard instructions, but the interview responses suggest that this also applies to experienced workers.
Further analysis will be performed on the collected data, as well as further studies being planned to test updates to instruction types in the collabora- ting companies, to then develop a theoretical framework for instruction type selection and instruction design.
ACKNOWLEDGMENT
The authors would like to acknowledge the project partners and the intervi- ewees, who were helpful and forthcoming in their answers.
The DIGITALIS project is funded by Swedish innovation agency Vinnova through their strategic innovation program Produktion2030.
REFERENCES
Baddeley, A. (1992). Working memory. Science, 255(5044), 556–559. Baddeley, A. D., & Hitch, G. (1974). Working memory. In Psychology of learning and motivation (Vol. 8, pp. 47–89). Academic press. Berlin, C., & Adams, C. (2017). Production ergonomics: Designing work systems to
support optimal human performance. Ubiquity press.
Cook, M. P. (2006). Visual representations in science education: The influence of prior knowledge and cognitive load theory on instructional design principles. Sci- ence education, 90(6), 1073–1091. Drouot, M., Le Bigot, N., Bricard, E., De Bougrenet, J. L. and Nourrit, V., 2022.
Augmented reality on industrial assembly line: Impact on effectiveness and mental workload. Applied Ergonomics, 103, p. 103793. ElMaraghy, W., ElMaraghy, H., Tomiyama, T., & Monostori, L. (2012). Complexity in engineering design and manufacturing. CIRP annals, 61(2), 793-814. European Commission. (2021). Industry 5.0 - Towards a sustainable, human-centric
and resilient European industry. Brussels Fox, S. (2010). The importance of information and communication design for manual skills instruction with augmented reality. Journal of Manufacturing Technology Management. Fridman, L., Reimer, B., Mehler, B., & Freeman, W. T. (2018). Cognitive load esti-
mation in the wild. In Proceedings of the 2018 chi conference on human factors in computing systems (pp. 1–9). Funahashi, S. (2015). Functions of delay-period activity in the prefrontal cortex and mnemonic scotomas revisited. Frontiers in systems neuroscience, 9, 2. Funahashi, S. (2017). Working memory in the prefrontal cortex. Brain sciences, 7(5),
49. Funk, M., Kosch, T., & Schmidt, A. (2016). Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 934–939). Jasche, F., Hoffmann, S., Ludwig, T., & Wulf, V. (2021). Comparison of different
types of augmented reality visualizations for instructions. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1–13). Kalyuga, S., Chandler, P., & Sweller, J. (1998). Levels of expertise and instructional design. Human factors, 40(1), 1–17. Kalyuga, S., Chandler, P., & Sweller, J. (2003). The Expertise Reversal Effect.
Educational Psychologist, 38:1, 23-31, Konz, S. A., & Dickey, G. L. (1969). Manufacturing assembly instructions; A summary. Ergonomics, 12(3), 370–382. Lai, Z. H., Tao, W., Leu, M. C., & Yin, Z. (2020). Smart augmented reality
instructional system for mechanical assembly towards worker-centered intelligent manufacturing. Journal of Manufacturing Systems, 55, 69–81. Li, D., Mattsson, S., Salunkhe, O., Fast-Berglund, Å., Skoogh, A., & Broberg, J. (2018). Effects of information content in work instructions for operator performance. Procedia Manufacturing, 25, 628–635. Marcus, N., Cooper, M., & Sweller, J. (1996). Understanding instructions. Journal
of educational psychology, 88(1), 49. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational psychologist, 38(1), 43–52. McCalla, G. I., Greer, J. E., Kumar, V. S., Meagher, P., Collins, J. A., Tkatch, R., &
Parkinson, B. (1997). A peer help system for workplace training. B. d. Boulay, & R. Mizoguchi (Eds.), AI-ED, 97(8), 183–190. Miller, E. K. (2000). The prefontral cortex and cognitive control. Nature reviews neuroscience, 1(1), 59–65. Mizuno, K., Tanaka, M., Yamaguti, K., Kajimoto, O., Kuratsune, H., & Wata-
nabe, Y. (2011). Mental fatigue caused by prolonged cognitive load associated with sympathetic hyperactivity. Behavioral and brain functions, 7(1), 1–7.
Information Display Preferences for Assembly Instructions in 6 Industrial settings 161
Nee, A. Y., Ong, S. K., Chryssolouris, G., & Mourtzis, D. (2012). Augmented reality applications in design and manufacturing. CIRP annals, 61(2), 657–679. Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional
design: Recent developments. Educational psychologist, 38(1), 1–4. Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. (2016). Cognitive load measurement as a means to advance cognitive load theory. In Educational psychologist (pp. 63–71). Routledge. Renda, A., Schwaag Serger, S., Tataj, D., Morlet, A., Isaksson, D., Martins, F., &
Giovannini, E. (2022). Industry 5.0, a transformative vision for Europe: governing systemic transformations towards a sustainable industry. European Commission, Directorate-General for Research and Innovation https://doi. org/10.2777/17322. Romero, D., Stahre, J., Wuest, T., Noran, O., Bernus, P., Fast-Berglund, Å., & Gorecky, D. (2016). Towards an operator 4.0 typology: a human-centric perspective on the fourth industrial revolution technologies. In proceedings of the inter- national conference on computers and industrial engineering (CIE46), Tianjin, China (pp. 29-31). Sand, O., Büttner, S., Paelke, V., & Röcker, C. (2016). smart. assembly–projection-
based augmented reality for supporting assembly workers. In International Con- ference on Virtual, Augmented and Mixed Reality (pp. 643–652). Springer, Cham. Sanna, A., Manuri, F., Lamberti, F., Paravati, G., & Pezzolla, P. (2015). Using handheld devices to sup port augmented reality-based maintenance and assem- bly tasks. In 2015 IEEE international conference on consumer electronics (ICCE) (pp. 178–179). IEEE. Serván, J., Mas, F., Menéndez, J. L., & Ríos, J. (2012). Assembly work instruction
deployment using augmented reality. In Key Engineering Materials (Vol. 502, pp. 25–30). Trans Tech Publications Ltd. Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and instruction, 4(4), 295–312. Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. The
Cambridge handbook of multimedia learning, 3(2), 19–30. Sweller, J., & Chandler, P. (1994). Why some material is difficult to learn. Cognition and instruction, 12(3), 185–233. Thorvald, P., Fast-Berglund, Å., & Romero, D. (2021). The Cognitive Operator
4.0. Paper presented at the International Conference on Manufacturing Research, Derby, UK. Vávra, P., Roman, J., Zonˇca, P., Ihnát, P., Nˇemec, M., Kumar, J.,... & El-Gendi, A.
(2017). Recent development of augmented reality in surgery: a review. Journal of healthcare engineering, 2017. Williamson, A., Lombardi, D. A., Folkard, S., Stutts, J., Courtney, T. K., & Connor, J. L. (2011). The link between fatigue and safety. Accident Analysis & Prevention, 43(2), 498–515.