Immersive technologies

Extended Reality (XR) is an umbrella term that covers immersive technologies ranging from virtual reality (VR) to mixed reality (MR) and augmented reality (AR). In VR, users are completely immersed in a simulated digital environment or a digital replica of reality. MR includes all variants where virtual and real environments are mixed. AR is one such variant where digital information is overlaid on images of reality viewed through a device. The level of augmentation can vary from a simple information display to the addition of virtual objects and even complete augmentation of the real world. MR can also include variants where real objects are included in the virtual world.

XR could be the next paradigm shift after the smartphone. Jessica Östergaard, Head of Architecture & Technology, Ericsson, explains why this transformative shift is urgent.

5G coverage enables wide-area and mobility-dependent XR applications such as AR gaming. At the same time, 5G has the capacity to handle multiple users in one place—such as a classroom or manufacturing site—running applications with high-bandwidth demands simultaneously.

To evolve XR devices from bulky head-mounted displays (HMDs) to lightweight, fashionable glasses, computationally heavy functions need to be offloaded to edge computing infrastructure or cloud servers. Running heavy compute functions in the cloud reduces HMD complexity and enables more immersive experiences with higher resolution, quality, and frame rates, supporting multi-user experiences in dynamic environments. To achieve this, both 5G networks and cloud servers need to deliver a high quality of experience.

For simple AR applications, such as digital overlays that help with street directions, current networks are sufficient. However, as XR applications become more advanced, connectivity requirements will become more stringent. Communications service providers (CSPs) need enhanced network capabilities to deliver low latency, high reliability, and high data rates essential for sustaining user quality of experience (QoE) in XR applications, while simultaneously offloading computation from the device to an edge or cloud server.

• Low latency and high reliability: XR applications require low latency and high reliability to ensure a seamless user experience. Network capabilities must support stringent latency requirements, including both radio access network (RAN) and core latency, to enable real-time interactions and rendering, especially for dynamic environments and interactions.
• High data rates: XR applications generate a significant amount of additional traffic, especially when remote rendering and offloading spatial computation are involved. Remote rendering requires high downlink data rates, while spatial compute requires high uplink data rates. Networks must have the capacity to handle the increased data rates to maintain user QoE.

Many smartphone users have already experienced basic forms of AR by using the camera filters in apps like Snapchat and playing games like Pokémon Go. AR technology becomes much more powerful, however, when used with specialized devices such as AR glasses. These glasses free up our hands and allow us to see digital information right before our eyes, layered over the real world.

In workplaces, AR glasses are already being used for remote assistance, workflow instructions, or training purposes, dramatically increasing worker efficiency. In education, VR transports students to immersive environments that make learning more engaging, helping them understand and remember better. AR is transforming spectator experiences at live events by enabling interactive engagement with the venue and other attendees, as well as delivering personalized, real-time data overlays.