Use cases

The XR-SENSE technological framework will be validated across three high-impact, demanding pilot domains: Connected and Autonomous Vehicles, Remote Collaborative Surgery, and Bidirectional XR Broadcasting. These pilots serve as real-world testbeds to demonstrate how the project’s unified visuo-haptic medium, real-time edge processing, and human-centric AI streaming handle extreme network latencies, complex data coregistration, and critical safety requirements. By deploying these diverse use cases, the project aims to transition XR from traditional, passive audio-visual experiences into deeply immersive, socially inclusive, and highly interactive bi-directional ecosystems.

This pilot focuses on enhancing vehicular safety and remote social telepresence in complex transit environments by integrating real-time infrastructure data directly into the driver’s field of view. It utilizes low-latency edge computing and wearable haptic feedback to lower cognitive load and prevent spatial disconnect.

Occlusion-Aware Overlays: Processes real-time point clouds and radiance fields from vehicle sensors to generate “see-through” safety displays that reveal hidden road hazards.
Remote XR Co-Pilots: Enables a distant user to enter the vehicle’s spatial environment as a high-fidelity avatar for real-time collaborative navigation.
Tactile Situational Awareness: Deploys haptic steering wheel vibrations and skin-stretch cues to deliver intuitive safety alerts without visually distracting the driver.