{"id":718,"date":"2021-11-28T20:08:34","date_gmt":"2021-11-29T04:08:34","guid":{"rendered":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/?p=718"},"modified":"2021-11-28T20:34:31","modified_gmt":"2021-11-29T04:34:31","slug":"the-effects-of-audio-on-cognitive-load-in-immersive-virtual-reality-selecting-a-theoretical-framework","status":"publish","type":"post","link":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/the-effects-of-audio-on-cognitive-load-in-immersive-virtual-reality-selecting-a-theoretical-framework\/","title":{"rendered":"The Effects of Audio on Cognitive Load in Immersive Virtual Reality: Selecting a Theoretical Framework"},"content":{"rendered":"<p>Updated &#8211; November 28, 2021 at 8:09 pm<\/p>\n<p><span style=\"font-weight: 400\">My research topic has changed quite a bit since the onset of my applied research project. What began as an inquiry into interactivity in multimedia learning quickly shifted into a full-scale investigation into the effects of audio on learning in immersive virtual reality (IVR). Since this article is about selecting a theoretical framework for my research, I will spare the unnecessary detail over why I shifted my research direction. With that said, I feel it necessary to provide a brief overview of my research topic to inject some context around my choice of using the Cognitive Load Theory (CLT) as a theoretical framework to underpin my research.\u00a0<\/span><\/p>\n<p><b>Research Topic Overview\u00a0<\/b><\/p>\n<p><span style=\"font-weight: 400\">IVR simulates \u201creal and imagined worlds\u201d (p. p.938) by creating multisensory experiences where learners feel as if they are \u201cpresent\u201d in their virtual surroundings (Makransky &amp; Peterson, 2021). The more realism the learner perceives in the IVR world, the more they become immersed in the learning experience, commonly referred to as \u201cimmersion\u201d (Ghinea et al., 2012, p. xv). As is produced by head-mounted IVR technologies like the Oculus Quest 2, high-level immersion is a necessary condition of presence, a crucial influencer of learning in IVR (Brinkman et al., 2015; Haung et al., 2020). Accordingly, researchers devote plenty of resources to understanding the connections between instructional design, immersion, and learning in IVR. One major consensus is that high-level immersion comes with a price: Increased extraneous load (Albus et al., 2021; Mayer, 2021; Makransky, et al., 2019; Richards &amp; Taylor, 2015). Research suggests that the very elements used to create awe-inspiring IVR worlds distract the learner\u2019s attention away from their primary learning tasks (Kern &amp; Ellermeier, 2020; Mayer, 2021; Rogers et al., 2018). Considering IVR experiences are comprised of visual, auditory, and haptic stimuli, investigating which multisensory design strategies are most effective in fostering learning is a worthwhile pursuit. Since I have a background in sound design, I thought I\u2019d try my hand at investigating the impacts of audio on cognitive load in an attempt to shed light on the extraneous load issue in IVR. Thus, I have selected the Cognitive Load Theory (CLT) to underpin my research.\u00a0<\/span><\/p>\n<p><b>Cognitive Load Theory<\/b><\/p>\n<p><span style=\"font-weight: 400\">CLT (Sweller, 2011; 2019) is an instructional design theory that focuses on human cognition to explain the learning process and is considered an appropriate framework for evaluating which educational technologies are effective and how they should be used (Sweller, 2020, p.1). CLT embodies a \u201chuman cognitive architecture\u201d (p.2) that addresses how humans acquire, process, and use primary and secondary information (Sweller, 2020, p.2). The theory suggests that human short-term memory is limited in capacity and that there are \u201ccognitive effects&#8221; (p.9) that can enhance or hinder the process of transferring newly acquired information from working memory into usable long-term memory stores (Sweller, 2020). Most importantly for my research, CLT identifies various instructional design considerations that influence a learner&#8217;s cognitive capacity; most specifically, it provides a map for reducing extraneous load. For instance, CLT can be used to understand the effects of learning element interaction, like how various multisensory elements (e.g. audiovisual stimuli) in an IVR world impact the learner\u2019s cognitive capacity to receive, process, and activate learning material; however, as fitting as this may seem for my research, applying the CLT cognitive architecture to the complexities of IVR, such as the effects of immersion and presence on learning, may prove difficult. After some review of the literature, I now realize that applying the CLT framework to my research context will require additional models to make substantial connections between audio and IVR learning: Que Makransky and Peterson\u2019s (2021) Cognitive Affective Model of Immersive Learning (CAMIL).\u00a0<\/span><\/p>\n<p><b>The Cognitive Affective Model of Immersive Learning<\/b><\/p>\n<p><span style=\"font-weight: 400\">In short, CAMIL \u201csynthesizes existing immersive educational research to describe the process of learning in IVR\u201d (Makransky &amp; Peterson, 2021, p.1). The model argues that methods interact with media, meaning instantiating instructional design methods which facilitate the unique affordances of HMD-IVR technology, such as presence and agency, return positive learning outcomes. For example, ID methods that foster presence in IVR generate better learning outcomes than ID methods that do not foster presence (Makransky &amp; Peterson, 2021). Further, the model describes how IVR affordances influence several affective and cognitive factors that impact immersive learning, such as intrinsic motivation, embodiment, and, most importantly, cognitive load. All of the factors mentioned in CAMIL are associated with immersion and presence, which are influenced by multisensory stimuli, including audio (Brinkman et al., 2015; Kern &amp; Ellermeier, 2020; Rogers et al., 2018), so CAMIL will likely prove to be a valuable tool for making strong connections between sound design and cognitive load in IVR. Further, many of the conclusions I\u2019ve made thus far from reading the literature on game audio in IVR are supported by CAMIL, providing much-needed validation that my research is on the right track.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">In conclusion, I invite readers to weigh in on my research direction and choice in a theoretical framework. For example, do you feel CLT is a good choice for investigating sound design effects on cognitive load in IVR, or is there a more fundamental theory I missed that might be more beneficial to my investigation? Also, since there are so many great learning models, do you know of other models, like CAMIL, that may assist my research? I thank you in advance for your thoughts and considerations. <\/span><\/p>\n<p>&nbsp;<\/p>\n<p><b>References<\/b><\/p>\n<p><span style=\"font-weight: 400\">Albus, P., Vogt, A., &amp; Seufert, T. (2021). <\/span><i><span style=\"font-weight: 400\">Signaling in virtual reality influences learning outcome and cognitive load. Computers and Education<\/span><\/i><span style=\"font-weight: 400\">, <\/span><i><span style=\"font-weight: 400\">166<\/span><\/i><span style=\"font-weight: 400\">. https:\/\/doi.org\/10.1016\/j.compedu.2021.104154<\/span><\/p>\n<p><span style=\"font-weight: 400\">Brinkman, W. P., Hoekstra, A. R. D., &amp; van Egmond, R. (2015). The Effect of 3D Audio and Other Audio Techniques on Virtual Reality Experience. <\/span><i><span style=\"font-weight: 400\">Studies in Health Technology and Informatics, 219<\/span><\/i><span style=\"font-weight: 400\">, 44\u201348. https:\/\/doi.org\/10.3233\/978-1-61499-595-1-44<\/span><\/p>\n<p><span style=\"font-weight: 400\">Ghinea, G., Andres, F., &amp; Gulliver, S. (2012). Multiple sensorial media advances and applications; new developments in MulSeMedia. (2011). <\/span><i><span style=\"font-weight: 400\">Reference and Research Book News, 26<\/span><\/i><span style=\"font-weight: 400\">(5). https:\/\/ezproxy.royalroads.ca\/login?url=https:\/\/www.proquest.com\/trade-journals\/multiple-sensorial-media-advances-applications\/docview\/894459535\/se-2?accountid=8056<\/span><\/p>\n<p><span style=\"font-weight: 400\">Huang, C. L., Luo, Y. F., Yang, S. C., Lu, C. M., &amp; Chen, A. S. (2020). Influence of Students\u2019 Learning Style, Sense of Presence, and Cognitive Load on Learning Outcomes in an Immersive Virtual Reality Learning Environment. <\/span><i><span style=\"font-weight: 400\">Journal of Educational Computing Research, 58<\/span><\/i><span style=\"font-weight: 400\">(3), 596\u2013615. <\/span><a href=\"https:\/\/doi.org\/10.1177\/0735633119867422\"><span style=\"font-weight: 400\">https:\/\/doi.org\/10.1177\/0735633119867422<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400\">Kern, A. C., &amp; Ellermeier, W. (2020). Audio in VR: Effects of a Soundscape and Movement-Triggered Step Sounds on Presence. <\/span><i><span style=\"font-weight: 400\">Frontiers in Robotics and AI, 7<\/span><\/i><span style=\"font-weight: 400\">. https:\/\/doi.org\/10.3389\/frobt.2020.00020<\/span><\/p>\n<p><span style=\"font-weight: 400\">Makransky, G., Terkildsen, T. S., &amp; Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. <\/span><i><span style=\"font-weight: 400\">Learning and Instruction, 60<\/span><\/i><span style=\"font-weight: 400\">, 225\u2013236.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Makransky, G., &amp; Petersen, G. B. (2021). The cognitive affective model of immersive learning (camil): a theoretical research-based model of learning in immersive virtual reality. <\/span><i><span style=\"font-weight: 400\">Educational Psychology Review, 33<\/span><\/i><span style=\"font-weight: 400\">(3).<\/span><\/p>\n<p><span style=\"font-weight: 400\">Mayer, R. (2021). <\/span><i><span style=\"font-weight: 400\">Multimedia Learning: Vol. 3rd Edition<\/span><\/i><span style=\"font-weight: 400\">. Cambridge University Press. UK.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400\">Richards, D., &amp; Taylor, M. (2015). A Comparison of learning gains when using a 2D simulation tool versus a 3D virtual world: An experiment to find the right representation involving the Marginal Value Theorem. <\/span><i><span style=\"font-weight: 400\">Computers and Education, 86<\/span><\/i><span style=\"font-weight: 400\">, 157\u2013171. <\/span><a href=\"https:\/\/doi.org\/10.1016\/j.compedu.2015.03.009\"><span style=\"font-weight: 400\">https:\/\/doi.org\/10.1016\/j.compedu.2015.03.009<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400\">Rogers, K., Ribeiro, G., Wehbe, R. R., Weber, M., &amp; Nacke, L. E. (2018). Vanishing importance: Studying immersive effects of game audio perception on player experiences in virtual reality. <\/span><i><span style=\"font-weight: 400\">Conference on Human Factors in Computing Systems<\/span><\/i><span style=\"font-weight: 400\">. <\/span><a href=\"https:\/\/doi.org\/10.1145\/3173574.3173902\"><span style=\"font-weight: 400\">https:\/\/doi.org\/10.1145\/3173574.3173902<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400\">Sweller, J., Ayres, P., &amp; Kalyuga, S. (2011). <\/span><i><span style=\"font-weight: 400\">Cognitive load theory<\/span><\/i><span style=\"font-weight: 400\">. New York: Springer<\/span><\/p>\n<p><span style=\"font-weight: 400\">Sweller, J. (2020). Cognitive load theory and educational technology. <\/span><i><span style=\"font-weight: 400\">Educational Technology Research and Development, 68<\/span><\/i><span style=\"font-weight: 400\">(1), 1\u201316.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Sweller, J., van Merri\u00ebnboer, J., &amp; Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. <\/span><i><span style=\"font-weight: 400\">Educational Psychology Review, 31<\/span><\/i><span style=\"font-weight: 400\">, 261\u2013292.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Updated &#8211; November 28, 2021 at 8:09 pm My research topic has changed quite a bit since the onset of my applied research project. What began as an inquiry into interactivity in multimedia learning quickly shifted into a full-scale investigation into the effects of audio on learning in immersive virtual reality (IVR). Since this article [&hellip;]<\/p>\n","protected":false},"author":185,"featured_media":711,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12,18],"tags":[],"class_list":["post-718","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lrnt622","category-research"],"_links":{"self":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/posts\/718","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/users\/185"}],"replies":[{"embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/comments?post=718"}],"version-history":[{"count":3,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/posts\/718\/revisions"}],"predecessor-version":[{"id":721,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/posts\/718\/revisions\/721"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/media\/711"}],"wp:attachment":[{"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/media?parent=718"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/categories?post=718"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/malat-webspace.royalroads.ca\/rru0163\/wp-json\/wp\/v2\/tags?post=718"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}