XR4Human
XR4Human Experience Library
At XR4HUMAN, we have created a curated library that hosts eXtended Reality (XR) experiences. The goal of this library is to empower the community to highlight their commitment to best practices by sharing their own XR experiences (which may include applications, games, tools and assets) that community members can use, enjoy, adapt and integrate into their own work. As a Horizon-funded platform, we strongly encourage EU-funded XR projects to showcase their outputs through this library. Each submission is tagged, making it effortless to search and sort by key criteria such as technology type, required hardware, domain focus, and user experience level. We invite members of the wider community to join us in contributing their own XR experiences, fostering a collaborative environment dedicated to pushing the boundaries of immersive technologies.
Ernst Grube – the legacy
Name: Philipp Grieß/ Frank Govaere / Oliver Schreer
Role: Director / Producer / Volumetric Video Production
Institution/company: UFA GmbH / UFA GmbH / Fraunhofer Heinrich-Hertz-Institut
About
The last survivors who experienced the atrocities of National Socialism first hand are already old. The joint virtual reality project by UFA and Fraunhofer Heinrich-Hertz-Institute (HHI) is committed to preserving these voices. With the technology of the volumetric video, whose basic technology “3D Human Body Reconstruction” was developed by researchers at Fraunhofer HHI, the memories of the Holocaust survivors are recorded for future generations. In the volumetric studio of Volucap GmbH, the Jewish eyewitness Ernst Grube reports on the experiences in National Socialist Germany and the persecution. Ernst Grube was captured in the volumetric studio with the help of 32 cameras. A lifelike three-dimensional image of Ernst Grube is then calculated from the video information using computer vision methods and can be directly integrated into a virtual world. This “walk-in film” illustrates a contemporary document in an unprecedented way. The aim is to convey the topic as a virtual reality (VR) experience, especially to younger generations, to whom the events of National Socialism seem far away. The “Contemporary Witnesses” project sets a new milestone in the documentation of a central chapter of German history and thus makes a valuable contribution to the German and European culture of remembrance. The full VR Experience was completed in March 2022 by the VR production company INVR-SPACE GmbH. It comprises five episodes: 1) The apartment of the Grube family in Munich, 2) The Jewish children’s home Antonienheim in Munich, 3) In the Munich Jewish ghetto – the Milbertshofen camp, 4) The fear of deportation, 5) The Theresienstadt concentration camp. Each of the episodes has a duration of 8-10 minutes and the user can decide, which episode would like to be experienced with the eyewitness. Overall, the VR Experience has a total duration of about 50 minutes. Hence, this project is to the best of our knowledge the longest VR production using volumetric video technology worldwide and for the first time. In the context of preserving contemporary evidence, this VR experience is also unique.
Technical Description
Technologies utilized in the experience: Volumetric Recording, VR (6DOF)
Hardware required to experience the project: PCVR Headset
Operating system: Windows
Language(s) used or supported in your experience: English, German
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 03/01/2022
Acceptable conditions: The VR production “Ernst Grube – the Legacy” is provided free of charge and for educational use only. Further distribution is not allowed. The user has to sign an agreement of use before receiving the download link.
Licence Model: CC BY
Application rating by impact area
Eva Umlauf – her testimony
Name: Anja Ballis / Oliver Schreer /Sönke Kirchof
Role: Director / Director / VR Production
Institution/company: Ludwig-Maximilians-Universität / Fraunhofer Heinrich-Hertz-Institut / INVR.Space GmbH
About
Learning about the Holocaust based on personal experiences is an increasingly difficult task. Most of the survivors have already passed away, which is why preserving the stories of those who are still alive has become an important mission. Thanks to the generous funding provided by the EVZ Foundation, Fraunhofer Heinrich-Hertz-Institute (HHI) and Ludwig-Maximilians-University Munich have collaborated to develop a VR experience centred around the story of Dr. Eva Umlauf, which is considered as one of the youngest survivors of the Auschwitz-Birkenau concentration camp. With the technology of the volumetric video, whose basic technology “3D Human Body Reconstruction” was developed by researchers at Fraunhofer HHI, the memories of the Holocaust survivor Eva Umlauf were recorded for future generations. Eva Umlauf was captured in the volumetric studio with the help of 32 cameras. A lifelike three-dimensional image of Eva Umlauf is then calculated from the video information using computer vision methods and can be directly integrated into a virtual world. This “walk-in film” illustrates a contemporary document in an unprecedented way. The aim is to convey the topic as a virtual reality (VR) experience, especially to younger generations, to whom the events of National Socialism seem far away. The “Contemporary Witnesses” project sets a new milestone in the documentation of a central chapter of German history and thus makes a valuable contribution to the German and European culture of remembrance. The full VR Experience was completed in May 2023 by the VR production company INVR-SPACE GmbH. It comprises three episodes: 1) Eva’s apartment in Munich – Life and survival, 2) Arrival and liberation at Auschwitz-Birkenau – Remembering torture, 3) Eva’s memorial speech at the Auschwitz-Birkenau memorial site in 2011 – Her message. Each of the episodes has a duration of 8-10 minutes and the user can decide, which episode would like to be experienced with the eyewitness. This virtual reality experience uses for the first time the technology of the subsequent animation of the volumetrically represented person. This makes it possible for the witness Eva Umlauf to always look at the user in the experience and provide eye contact, as the head is turned towards the user in real time. In the context of preserving contemporary evidence, this VR experience is also unique.
Technical Description
Technologies utilized in the experience: Volumetric Recording, VR (6DOF)
Hardware required to experience the project: PCVR Headset
Operating system: Windows
Language(s) used or supported in your experience: English, German
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 12/05/2023
Acceptable conditions: The VR production ” Eva Umlauf – her testimony” is provided free of charge and for educational use only. Further distribution is not allowed. The user has to sign an agreement of use before receiving the download link.
Licence Model: CC BY-NC
Application rating by impact area
Nevrolens
Name: Ekaterina Prasolova-Førland
Role: Project leader
Institution/company: Norwegian University of Science and Technology
About
Remote collaboration tool for neuroscience students to examine a rat brain (extended to include multiple brain models, e.g. human brain).
Technical Description
Technologies utilized in the experience: AR
Hardware required to experience the project: Mobile device
Operating system: Android
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Multi-user, Single-user
Project Details
Creators of this project: University or Research Project, Consortium Project (i.e. EU-funded project)
Date of completion: 10/07/2022
Acceptable conditions: Be aware that the app requests access to the camera of the user’s device to enable the augmented reality experience. The app contains a feature to take an image and save it locally on the device the user is using. The images are not transmitted over the Internet to any cloud storage. The app requests access to the microphone of the user’s device only to use it for the voice chat feature, while using the app in the collaborative mode. The app does not record and does not store the voice recording. The app also requests access to the storage of the device only to save the images taken in the app and saving and loading the progress in the app. The app does not access any other files or data stored on the user’s device.
Licence Model: Google play and App store policies
Application rating by impact area
Job Interview VR
Name: Ekaterina Prasolova-Førland
Role: Project leader
Institution/company: Norwegian University of Science and Technology
About
The Job interview VR app provides an immersive experience of a job interview. The app can be used to train and prepare for a job interview. The simulation is based on a scenario that contains 12 main questions and 14 additional comments or questions that appear optionally depending on the answers to the main questions. In the interview scenario, the user takes the role of the job candidate and goes through a typical job interview. The interviewer appears in a typical office room, captured in a 360-video format from the point of view of the user.
Technical Description
Technologies utilized in the experience: VR (6DOF)
Hardware required to experience the project: Standalone VR Headset
Operating system: Android
Language(s) used or supported in your experience: Norwegian
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 10/01/2020
Acceptable conditions: Be aware that the app records all sound during the simulated job interview. The app requests access to the microphone of the user’s device only to record the voice of the user while the app is in use. The sound recording is stored locally on the device while the app is in use. The app does not store the recording after the app is closed. The app does not transmit the recordings over the Internet.
Licence Model: Meta polity and Google Play policy
Application rating by impact area
VR4VET Blue sector
Name: Ekaterina Prasolova-Førland
Role: Project coordinator
Institution/company: Norwegian University of Science and Technology>
About
The VR4VET Blue Sector app is being developed for career guidance and vocational training in the Blue Economy sector, with a focus on empowering young job seekers. The app simulates an area of a fjord with several fish cages, a fish feeding station, a fish health and welfare station, a fish processing facility, a fish laboratory, and a reception area. The users can experience situations representing typical workplaces in the aquaculture and fish processing industries, such as feeding fish, inspecting fish for injuries and diseases, sorting fish in a factory, and analyzing water samples in a fish laboratory.
Technical Description
Technologies utilized in the experience: VR (6DOF)
Hardware required to experience the project: Standalone VR Headset
Operating system: Android
Language(s) used or supported in your experience: English, Norwegian
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 31/12/2024
Acceptable conditions: The app does not collect or share any personal information. The app does not access the user’s personal data stored on the device. The app does not access the user’s location data. The app does not access the user’s IP address. The app does not collect data about the user’s device.
Licence Model: Meta terms
Application rating by impact area
DEVA – Dynamic Exposure Visualization App
Name: Oliver Schreer
Role: Project Manager
Institution/company: Fraunhofer Heinrich Hertz Institute
About
Domain or subject area: Environment/Social
This app offers a real-time visualization of air quality and traffic data based on publicly available environmental do-it-yourself (DIY) sensors with Augmented Reality. Environmental data from sensors are in your surrounding are visualized in overlay mode on the camera image of your mobile device such as smartphone or tablet. The app has the following features: 1. different visualization modes for optimized display of 3D sensor data in the augmented 3D space, 2. alert, if pollution thresholds are exceeded, 3. trip recording to record and save current GPS positions and monitor air quality along a recorded trip. The data serve as input for the Dynamic Exposure Visualization Dashboard (DEV-D) (https://monitoring.wecompair.eu/dashboards/dev-d), 4. detailed sensor information for a variety of pollutants such as CO2 (Carbon Dioxide), NO2 (Nitrogen Dioxide), BC (Black Carbon), PM1, PM2.5 and PM10 (Particulate Matter of size 1, 2.5 and 10 micrometres), humidity and temperature, 5. detailed traffic sensor information such as number of cars, trucks or bicycles for a given period. This app was developed in the Horizon Europe EU project Compair (No. 101036563) (see https://www.wecompair.eu/).
Technical Description
Technologies utilized in the experience: AR
Hardware required to experience the project: Mobile device
Operating system: Android, iOS
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: This app was developed in the Horizon Europe EU project Compair (No. 101036563)
Date of completion: 01/07/2024
Acceptable conditions: The app is currently publicly available on Google Play Store, an Apple iOS version will be coming soon.
Licence Model: CC BY-NC
Application rating by impact area
