Introduction

The Value of AR/VR in Education

Current Applications of AR/VR Technologies in Education

Considerations and Recommendations for Policymakers

Conclusion

Endnotes

Introduction

Digital technologies are continually transforming the field of education. In a 2019 Gallup survey, 65 percent of U.S. public school teachers said they used digital tools every day, while 13 percent used them a few days a week—and 85 percent saw “great value” in using them in the future.[1] As momentum for educational technologies continues to grow, educators and institutions are looking for new ways to integrate digital solutions into classroom experiences. Augmented reality and virtual reality (AR/VR)—immersive technologies that enable users to experience digitally rendered content in both physical and virtual spaces—offer notable potential for edtech innovation. These technologies expand the possibilities of learning environments from K-12 classrooms to medical schools by reducing barriers from physical space, enhancing collaboration and hands-on learning, and providing individualized learning approaches that can help students at all levels thrive.

AR/VR as an educational tool is hardly a novel concept. But immersive learning has only recently transitioned from small-scale experimentation to a multimillion-dollar market with rapidly growing use.[2] Classrooms across the country use AR/VR for virtual field trips, science experiments, immersive simulations, and more. Many basic experiences are compatible with mobile devices, and advanced headsets simultaneously improve in quality and decrease in cost. The technologies necessary to develop and access immersive content are also becoming easier to use and more affordable.[3] This report explores the current state and potential contributions of AR/VR in education and highlights a sampling of the solutions across subjects and learning levels that are building the foundation for the immersive classrooms of the future.

Policymakers can play a valuable role in accelerating adoption and encouraging innovation to realize the full potential of AR/VR technologies in education. Congress should direct the Department of Education to help to bridge existing knowledge and content gaps by:

• investing in research into best practices to mitigate health and safety concerns for young children, and providing guidance on age-appropriate use;
• providing resources and opportunities for educators to develop the skills and knowledge needed to successfully deploy these technologies, and developing resources and guidance to integrate AR/VR technologies into digital literacy initiatives to reduce the “learning curve” for students at all levels;
• accelerating the development of quality, relevant, and age-appropriate immersive educational content by investing in government educational content for AR/VR and expanding AR/VR innovation in colleges and universities; and
• supporting initiatives to expand access to AR/VR devices and applications.

The Value of AR/VR in Education

Researchers have been exploring the potential of immersive technologies as an educational tool since at least the 1990s.^[4] AR/VR technologies are a promising addition to the growing field of education technology because of their immersive experiences, their ability to share information in new and engaging ways, and their potential to offer virtual experiences that expand access to educational opportunities that would otherwise be limited by cost or physical distance. However, AR/VR devices and applications have only recently become affordable and user-friendly enough for these solutions to actually be implemented in classrooms.

AR/VR technologies offer a wide range of capabilities to present information in more interactive ways than their two-dimensional counterparts. At the highest level, advanced VR systems can fully immerse users in a virtual environment, where they can interact with virtual objects as well as other individuals in real time. This kind of experience lends itself to hands-on learning that either simulates real-world experiences or presents complex information in ways that would not otherwise be possible. For example, students can view microscopic objects in 3D, or stand in the middle of a physics simulation. VR also offers the ability for users to enter pre-recorded 360-degree visual experiences—either still images or video—they can view but not manipulate or interact with. This less-immersive (but often lower-cost) approach can be beneficial when the visual presentation or sense of presence is the most important element of a given experience, such as visiting a historical site.

With AR, or mixed reality (MR), users can interact with virtual objects that appear within their physical surroundings. This is most beneficial for scenarios wherein users need to interact with virtual objects while also maintaining situational awareness of their physical environment. For example, students could follow digital overlays of instructions for complex activities such as learning how to repair a complex machine or conducting a medical procedure. Much like VR, AR also offers less-interactive experiences, allowing users to view static virtual objects or information within physical space. This is most beneficial when the object itself holds the most educational value—such as placing a virtual model of a sculpture or historic artifact in a classroom, or overlaying additional text or images on a historical site.

There is growing enthusiasm among students and educators—as well as parents, administrators, and institutions—around using immersive technologies as educational tools.

• In a 2016 survey of 1,000 U.S. teachers conducted by Samsung Electronics and GfK, 93 percent said their students would be excited to use VR, and 83 percent believed these technologies could help improve learning outcomes.^[5]
• In a 2017 joint report from digital and VR content companies and the DigiLitEY academic network, 70 percent of U.S. children ages 8 to 15 and 64 percent of parents expressed interest in VR experiences.^[6]
• In a 2018 study from Common Sense Media, 62 percent of parents overall—and 84 percent of parents who had used it themselves—believed VR could provide their children with educational experiences.^[7]
• Another 2018 survey finds that just under 50 percent of higher education institutions have either partially or fully engaged in VR deployment.^[8]
• In a 2020 survey from Perkins Coie and the XR Association, respondents named education as the second most likely sector to be disrupted by immersive technologies in the near future.^[9]

AR/VR-based education tools offer enormous potential to transform the way students of varying ages and disciplines learn. Indeed, although research into the value and efficacy of AR/VR in education is ongoing, several studies indicate that AR/VR tools can enhance learning outcomes in both K-12 and higher education settings.^[10] Immersive solutions can present opportunities for educational experiences that would otherwise require significant travel or resources, such as visiting a faraway location or performing experiments in a laboratory. These experiences can also transcend physical space limitations to create educational opportunities that would not otherwise be physically possible, such as visiting another planet or period in history or manipulating enlarged models of microscopic objects. Further, AR/VR experiences can engage students in hands-on, gamified approaches to learning in a variety of subjects—which have been shown to support cognitive development and increase classroom engagement.^[11]

In addition to offering new types of experiences for all learners, AR/VR tools can improve overall learning outcomes for students.^[12] Immersive experiences have been shown to reduce cognitive load and distance, encourage higher engagement, and improve memory recall for complex or abstract topics, such as STEM (science, technology, engineering, and mathematics) subjects that often rely on two-dimensional representations of otherwise intangible concepts.^[13] And individual-level immersive learning allows for more personalized approaches that can accommodate different learning styles, speeds, and abilities.^[14] For certain types of learning, they can also provide feedback to students and educators and adjust individual learning objectives to meet students where they are—helping students realize their full potential and leaving fewer of them behind.^[15]

AR/VR in K-12 Education

Due to the unique capabilities of these technologies, immersive solutions are gaining popularity among K-12 educators and administrators. AR/VR solutions can either enhance, partially replace, or fully substitute for traditional classroom learning. Perhaps the most common use in K-12 settings currently is enhancing classroom experiences. For example, teachers can walk students through immersive virtual field trips or allow students to interact with 3D models using AR. However, schools are also turning to AR/VR solutions for blended and distance learning. The pivot to online and hybrid learning during the COVID-19 pandemic highlighted the value of teaching tools not being tethered to a physical location.^[16]

Immersive technologies allow students to passively participate in remote learning experiences and engage with instructors and peers in real time using shared virtual elements.^[17] For example, mobile AR allows students to view a painting on their wall or an object in their living room, while AR/VR-based virtual labs would allow them to conduct hands-on experiments regardless of whether they are present in a fully equipped classroom or laboratory. Fully immersive VR experience also have the advantage of reducing distractions during remote learning, thereby encouraging students to be fully present during lessons.

AR/VR technologies also offer promising tools to engage students—both in the classroom and remotely—with autism spectrum disorder (ASD), attention deficit hyperactivity disorder (ADHD), dyslexia, or other cognitive or learning disabilities.^[18] For example, VR experiences can help treat phobias in young people with ASD.^[19] Meanwhile, AR can assist students with learning disabilities by altering or enhancing physical learning tools such as textbooks or flash cards.

AR/VR in Higher Education

AR/VR technologies are equally valuable in more advanced learning environments. College and university educators across disciplines are implementing immersive technologies in their courses.[20] In a 2018 survey of higher education institutions from Internet2, over two-thirds of institutions had either partially or fully deployed AR/VR solutions, and one-third were testing them.[21] Some academic institutions have even introduced dedicated spaces that allow students and faculty to access AR/VR devices and develop their own content. These dedicated labs, as well as hardware students either own or borrow, create new opportunities for students and educators to experiment with immersive learning (see box 1).

Box 1: AR/VR Access and Content Development at Higher Education Institutions

AR/VR labs, lending programs, and similar efforts can accelerate adoption of AR/VR edtech solutions at colleges and universities. These programs often provide students with their first hands-on experience with immersive technologies, and serve as a resource for faculty looking to integrate AR/VR solutions into their lessons. Interest in these offerings is growing: In the same Internet2 survey, although less than one-third of institutions (27 percent) were using AR/VR as part of their production IT environment, about half (53 percent) planned to deploy these technologies within the next three years.^[22]

The following are three examples of existing programs introducing students and faculty to immersive learning.

The Harvard Innovation Labs AR/VR Studio is open to all full-time, degree-seeking Harvard students.^[23] The studio includes a selection of AR/VR devices as well as content production equipment and software, and offers open sessions as well as guided workshops that encourage students to explore the potential of this technology.

Colorado State University launched an Immersive Reality Training Lab in 2019 to accommodate up to 100 students for simultaneous immersive learning experiences.^[24] Part of the university’s Health Education Outreach Center, the lab was designed to enhance biomedical education with immersive simulations—without burdening students or faculty with the necessary equipment costs.

The University of Michigan XR Initiative, part of the university’s Center for Academic Innovation, provides funding and guidance for faculty projects that implement AR/VR technologies across disciplines.^[25] The university also has several onsite labs with AR/VR devices and offers an equipment checkout service.^[26]

One well-established use of AR/VR in higher education is immersive simulations. Virtual simulations offer relatively low-cost alternatives to more traditional in-person scenarios while maintaining a level of immersion that makes participants feel like they are “really there.”[27] This is particularly useful for high-cost or high-risk scenarios, such as in health care education.[28] Indeed, the cost of requisite software for a virtual simulation can be as low as one-tenth the cost of physical alternatives in medical education.[29] Beyond medical education, virtual simulations can also facilitate soft-skills training, such as negotiation and communication skills.[30]

Immersive learning can also supplement career and technical education. Much like scenario-based simulations, AR/VR solutions allow individuals to build skills through hands-on experience while also minimizing both the cost and risk associated with field training.[31] For example, students can practice operating or repairing 3D models of complex machinery to build familiarity and safety awareness before handling the real thing. Immersive tools for technical education can also better prepare students to utilize these and other emerging technologies in their chosen fields.[32] This baseline knowledge will be increasingly valuable as industries such as construction and advanced manufacturing continue to adopt AR/VR and other advanced technologies.

Finally, AR/VR solutions can enhance research collaboration as well as hybrid learning models.[33] Immersive environments allow students and instructors to interact face to face and in real time, regardless of where they might be physically located. Immersive collaboration could mitigate many of the factors that contribute to “Zoom fatigue”—a growing concern, as long-distance collaboration and communications increasingly rely on videoconferencing—such as cognitive load, restricted mobility, and prolonged eye contact.[34] In fully digital environments, all participants can also interact with virtual objects, including complex 3D models that would be costly to reproduce in the real world. MR solutions can also enhance hybrid collaboration and learning models that combine both in-person and virtual interactions; for example, by allowing an instructor to communicate with remote students by video chat while simultaneously conducting an in-person demonstration.

AR/VR for Educators and Administrators

Immersive technologies can enhance not just learning environments but also broader education systems. Just as immersive solutions can improve learning outcomes for students, they can also serve as valuable tools to better equip teachers for success.[35] Virtual training allows educators to hone their skills with simulated, virtual students first before doing so in a real-world classroom where their actions could significantly impact students’ lives.[36] As the technology continues to grow and develop, administrators and officials may also find value in leveraging immersive solutions for collaboration, communication, and community engagement.

Current Applications of AR/VR Technologies in Education

AR/VR technologies offer significant potential to enhance learning at all levels and across disciplines. As immersive technologies evolve, new use cases in educational contexts are continually emerging. This section highlights some of the recent innovations that are building the foundation for the future of immersive educational technologies.

K-12 Education: Enriching Classroom Experiences and Expanding Opportunities

Immersive technologies have the potential to create more engaging, effective, and equitable learning environments for children. Current solutions in this space include libraries of immersive content suitable for educational use, specialized content for targeted subjects and learning levels, and tools developed specifically to support students with learning disabilities.

Immersive Learning Curricula and Resource Collections

Many existing AR/VR products for K-12 learning offer preset curricula and collections of immersive experiences teachers can adapt to specific learning objectives. Existing offerings include publicly available resources from government agencies, education-focused collections from libraries of immersive content, and specialized services from companies focusing specifically on implementing AR/VR in immersive experiences.

Public Resources

The Smithsonian Institution offers a repository of open-access 3D models that allow users to view items from Smithsonian museums’ collections in their physical surroundings using AR on a mobile device.[37] Unlike print or digital two-dimensional representations, these models give the viewer a sense of scale and allow them to interact with them in three-dimensional space. Educators can use these resources to enhance classroom learning in subjects such as natural and U.S. history. The initial collection comprises 10 items, including full-size skeletons, cultural objects, and statues, all available with any camera-enabled mobile device on the web-based Voyager platform.[38]

Figure 1: The Smithsonian Institution's AR tools allow users to view life-size replicas of popular exhibits—such as this mammoth skeleton from the Museum of Natural History—in their own physical surroundings. Image source: Smithsonian Institution via Instagram.[39]

The National Aeronautics and Space Administration (NASA) also offers publicly available immersive educational resources instructors can integrate into lesson plans or broader learning experiences in museums or planetariums. These immersive experiences can place students in scenarios that would otherwise be impossible—such as experiencing life onboard the International Space Station or exploring another planet.[40] In 2018, NASA released a VR experience that allows users to view a rocket launch from the launchpad.[41] The agency also offers a collection of web-accessible 360° videos users can view on either a headset, computer, or mobile device.[42]

Content Collections

The New York Times guide to “VR in the Classroom” includes lesson plans that integrate the publication’s collection of 360° videos.[43] The guide includes lesson plans for STEM and humanities subjects and step-by-step instructions for teachers who may not have extensive experience integrating immersive content in their classrooms. Although the lesson plans offer a beneficial resource, teachers can also use the 360° videos as standalone tools. The videos can be viewed on a computer or mobile device or using a head-mounted display.

Figure 2: The “NASA SLS Oculus Rift Experience” lets users explore a virtual model of the Space Launch System (SLS) rocket and watch a simulated launch from the launchpad—an experience that would not be possible in the real world. Image source: National Aeronautics and Space Administration (NASA).[44]

The Google Arts and Culture platform hosts many of the experiences that were previously part of Expeditions, which is an app that allows teachers to build and lead virtual field trips.[45] The platform contains 360° experiences, including artwork, space exploration, natural history, musical performances, and cultural and historical sites around the world.[46] Educators can use these experiences to build full virtual excursions or enhance classroom lessons.

Edtech Services

ClassVR is a full-service immersive education platform from edtech provider Avantis.[47] The service includes both the requisite hardware (plastic VR headsets) and a library of curriculum-aligned immersive educational content, which teachers can control from a centralized management system on a single computer.[48] Unlike decentralized libraries that do not allow teachers to control the experience once students are in-headset, this system allows teachers to integrate VR into guided lessons.

Kai XR is a subscription-based immersive learning platform that was developed to address opportunity gaps in education—namely access to field trips and other off-site enrichment activities.[49] The platform offers guided, multilingual virtual field trips to museums, monuments, historical sites, and even outer space.[50] The company offers affordable headsets, but the platform is also accessible on computers and mobile devices. In addition to field trips, the platform includes tools to teach students how to build their own immersive spaces and virtual experiences.

Figure 3: With basic headsets and a mobile device, educators can integrate immersive content collections—such as virtual field trips to otherwise inaccessible locations—into their lesson plans at relatively low cost. Image source. Image source: iStock.^[51]

Subject Specialization

While some K-12-focused products offer a wide selection of content to cover a variety of subjects, others offer experiences for specific subjects or learning objectives.

BioDive by Killer Snails is a web-based VR experience built to teach middle school students about marine biodiversity.[52] Students explore an underwater ecosystem as marine biologists, and the app prompts them to make observations and develop hypotheses in an online journal. Teachers can view individual student progress and help guide their learning. Students can access both the immersive experience and the online journaling feature on any web-enabled device.

Figure 4: BioDive lets students experience a marine expedition from an immersive, first-person view. Image source: Killer Snails.^[53]

Movers and Shakers develops AR tools to integrate Black experiences in middle school history curricula.[54] Most recently, the organization launched Kinfolk, an app that lets students interact with AR models of Black leaders throughout history, such as Frederick Douglass, Harry Belafonte, and Shirley Chisholm.[55] Users can view each figure’s digital “monument” and access related content such as their biography, related historical artifacts, and even playlists.

Special Education

AR/VR’s ability to provide individualized learning solutions can benefit all students, including those with cognitive and learning disabilities. In addition, there are immersive programs available specifically for special education, particularly for students with ASD.

Project VOISS (Virtual Reality Opportunities to Implement Social Skills) is a Department of Education-funded program based out of the University of Kansas Center for Research on Learning and Department of Special Education.[56] The project uses VR experiences to help middle school-aged students with learning disabilities develop and practice social skills. The program provides students and teachers with a low-risk, controlled environment to practice many common scenarios with a headset or web-enabled device.[57]

Floreo offers VR-based lessons in social and life skills for young people with ASD.[58] Through story-based interactive scenarios, users can practice conversations and social cues in a gamified environment. Educators or other supervisory figures can view progress and guide the experience via an application on a tablet or mobile device. The experiences focus on building social connections, simulating real-life interactions, and practicing emotional-regulation techniques.[59]

Figure 5: With immersive simulations such as Floreo, students can practice interactions they might experience in their daily lives, such as conversations with peers, in a controlled, low-risk environment. Image source: Floreo.^[60]

Higher Education: Making the Theoretical Tangible and Equipping Students for Their Futures

Higher education solutions combine the learning advantages of immersive experiences with AR/VR’s capacity to reduce barriers found in physical space. They are often more decentralized than their K-12 counterparts, giving students more opportunities to learn and explore independently with guidance from instructors. STEM and health care education have long stood at the forefront of immersive learning, but colleges and universities in particular are increasingly turning to AR/VR solutions to enhance education in less-obvious fields, including humanities and art, and even professional fields such as law and business.

STEM Education

Immersive experiences can be particularly beneficial in STEM education because they offer hands-on experiences that would be either logistically difficult or physically impossible in the real world. A growing number of STEM faculty and educational technology experts are developing creative ways to teach complex and often abstract concepts using AR/VR tools.

Polar Explorer is a VR teaching tool developed by researchers at Arizona State University, Northern Arizona University, the University of Arizona, and the University of Colorado Boulder to teach undergraduate students about the impacts of climate change on polar environments.[61] The program takes students through interactive virtual field trips to the Arctic—an experience that few would have the financial resources or physical ability to have in real life.

Faculty at Universidad Católica San Antonio de Murcia in Spain used a VR environment built in the web-based Mozilla Hubs to develop hands-on lessons about the coronavirus.[62] Not only could students explore learning tools such as a larger-than-life model of the virus, they could do so in real time alongside their professor and peers in a virtual environment at a time when in-person collaboration was not possible due to COVID-19 safety measures.

At Purdue University, astronomy students can explore interactive, 3D models of astronomical objects in a virtual, collaborative environment.[63] Students and the professor can access the virtual space from anywhere using a headset or a computer, allowing the instructor to guide students through lessons that would otherwise rely on two-dimensional representations of these distant and complex phenomena.

Figure 6: Students in Professor Danny Milisavljevic's astronomy class investigate 3D models of astronomical objects alongside their peers in a virtual environment. Image source: Purdue University.^[64]

The Air Force Academy is integrating MR solutions into chemistry lessons through a new platform called HoloChem.[65] Developed by GIGXR (a company that produces AR, VR, and MR learning systems for STEM and medical education), the platform allows cadets to conduct advanced chemistry experiments that would be dangerous to execute in real-life labs, particularly by less-experienced learners.[66]

Medical Training

Medical education requires significant hands-on, in-person learning to prepare students for everything from interacting with patients to completing complex procedures. Medical and health care educators are increasingly turning to AR/VR solutions to provide low-cost, low-risk, and often more interactive alternatives to traditional approaches in this field.

HoloAnatomy is a medical education program developed at Case Western Reserve University that uses Microsoft HoloLens MR devices to enhance anatomy curricula.[67] Rather than a traditional cadaver-based approach, HoloAnatomy allows students to interact with 3D anatomical models and receive real-time feedback. The collaborative, MR-based approach also lends itself to remote learning, which proved critical for medical education during the COVID-19 pandemic.[68]

Figure 7: Using HoloAnatomy software and MR headsets, medical and life sciences students can view and manipulate anatomical models in real time. Image source: Interactive Commons at Case Western Reserve University.^[69]