XR4HUMAN
XR4HUMAN Experience Library
At XR4HUMAN, we have created a curated library that hosts eXtended Reality (XR) experiences. The goal of this library is to empower the community to highlight their commitment to best practices by sharing their own XR experiences (which may include applications, games, tools and assets) that community members can use, enjoy, adapt and integrate into their own work. As a Horizon-funded platform, we strongly encourage EU-funded XR projects to showcase their outputs through this library. Each submission is tagged, making it effortless to search and sort by key criteria such as technology type, required hardware, domain focus, and user experience level. We invite members of the wider community to join us in contributing their own XR experiences, fostering a collaborative environment dedicated to pushing the boundaries of immersive technologies.
Ernst Grube – the legacy
Name: Philipp Grieß/ Frank Govaere / Oliver Schreer
Role: Director / Producer / Volumetric Video Production
Institution/company: UFA GmbH / UFA GmbH / Fraunhofer Heinrich-Hertz-Institut
About
The last survivors who experienced the atrocities of National Socialism first hand are already old. The joint virtual reality project by UFA and Fraunhofer Heinrich-Hertz-Institute (HHI) is committed to preserving these voices. With the technology of the volumetric video, whose basic technology “3D Human Body Reconstruction” was developed by researchers at Fraunhofer HHI, the memories of the Holocaust survivors are recorded for future generations. In the volumetric studio of Volucap GmbH, the Jewish eyewitness Ernst Grube reports on the experiences in National Socialist Germany and the persecution. Ernst Grube was captured in the volumetric studio with the help of 32 cameras. A lifelike three-dimensional image of Ernst Grube is then calculated from the video information using computer vision methods and can be directly integrated into a virtual world. This “walk-in film” illustrates a contemporary document in an unprecedented way. The aim is to convey the topic as a virtual reality (VR) experience, especially to younger generations, to whom the events of National Socialism seem far away. The “Contemporary Witnesses” project sets a new milestone in the documentation of a central chapter of German history and thus makes a valuable contribution to the German and European culture of remembrance. The full VR Experience was completed in March 2022 by the VR production company INVR-SPACE GmbH. It comprises five episodes: 1) The apartment of the Grube family in Munich, 2) The Jewish children’s home Antonienheim in Munich, 3) In the Munich Jewish ghetto – the Milbertshofen camp, 4) The fear of deportation, 5) The Theresienstadt concentration camp. Each of the episodes has a duration of 8-10 minutes and the user can decide, which episode would like to be experienced with the eyewitness. Overall, the VR Experience has a total duration of about 50 minutes. Hence, this project is to the best of our knowledge the longest VR production using volumetric video technology worldwide and for the first time. In the context of preserving contemporary evidence, this VR experience is also unique.
Technical Description
Technologies utilized in the experience: Volumetric Recording, VR (6DOF)
Hardware required to experience the project: PCVR Headset
Operating system: Windows
Language(s) used or supported in your experience: English, German
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 03/01/2022
Acceptable conditions: The VR production “Ernst Grube – the Legacy” is provided free of charge and for educational use only. Further distribution is not allowed. The user has to sign an agreement of use before receiving the download link.
Licence Model: CC BY
Application rating by impact area
Eva Umlauf – her testimony
Name: Anja Ballis / Oliver Schreer /Sönke Kirchof
Role: Director / Director / VR Production
Institution/company: Ludwig-Maximilians-Universität / Fraunhofer Heinrich-Hertz-Institut / INVR.Space GmbH
About
Learning about the Holocaust based on personal experiences is an increasingly difficult task. Most of the survivors have already passed away, which is why preserving the stories of those who are still alive has become an important mission. Thanks to the generous funding provided by the EVZ Foundation, Fraunhofer Heinrich-Hertz-Institute (HHI) and Ludwig-Maximilians-University Munich have collaborated to develop a VR experience centred around the story of Dr. Eva Umlauf, which is considered as one of the youngest survivors of the Auschwitz-Birkenau concentration camp. With the technology of the volumetric video, whose basic technology “3D Human Body Reconstruction” was developed by researchers at Fraunhofer HHI, the memories of the Holocaust survivor Eva Umlauf were recorded for future generations. Eva Umlauf was captured in the volumetric studio with the help of 32 cameras. A lifelike three-dimensional image of Eva Umlauf is then calculated from the video information using computer vision methods and can be directly integrated into a virtual world. This “walk-in film” illustrates a contemporary document in an unprecedented way. The aim is to convey the topic as a virtual reality (VR) experience, especially to younger generations, to whom the events of National Socialism seem far away. The “Contemporary Witnesses” project sets a new milestone in the documentation of a central chapter of German history and thus makes a valuable contribution to the German and European culture of remembrance. The full VR Experience was completed in May 2023 by the VR production company INVR-SPACE GmbH. It comprises three episodes: 1) Eva’s apartment in Munich – Life and survival, 2) Arrival and liberation at Auschwitz-Birkenau – Remembering torture, 3) Eva’s memorial speech at the Auschwitz-Birkenau memorial site in 2011 – Her message. Each of the episodes has a duration of 8-10 minutes and the user can decide, which episode would like to be experienced with the eyewitness. This virtual reality experience uses for the first time the technology of the subsequent animation of the volumetrically represented person. This makes it possible for the witness Eva Umlauf to always look at the user in the experience and provide eye contact, as the head is turned towards the user in real time. In the context of preserving contemporary evidence, this VR experience is also unique.
Technical Description
Technologies utilized in the experience: Volumetric Recording, VR (6DOF)
Hardware required to experience the project: PCVR Headset
Operating system: Windows
Language(s) used or supported in your experience: English, German
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 12/05/2023
Acceptable conditions: The VR production ” Eva Umlauf – her testimony” is provided free of charge and for educational use only. Further distribution is not allowed. The user has to sign an agreement of use before receiving the download link.
Licence Model: CC BY-NC
Application rating by impact area
Gedrag: (G)een Probleem – Extended
Name: Leiden Learning and Innovation Centre
Role: Main developer
Institution/company: Leiden University
Contact details: hello at llinc.leidenuniv dot nl
About
Deze ervaring is ontworpen als een trainingsinstrument voor professionals in ouderenzorg om een dieper begrip te krijgen van gedragssymptomen bij patiënten met dementie. De ervaring ondersteunt bij de ontwikkeling van empathie en het verbeteren van communicatievaardigheden. Ontwikkeld door het voormalige Leiden University Centre for Innovation in samenwerking met opleidingsprogramma’s aan het Leids Universitair Medisch Centrum (LUMC), biedt de app “”Gedrag: (G)een Probleem”” een reis in de wereld van patiënten met dementie. De nieuwste versie van de app is verrijkt en uitgebreid door het Leiden Learning and Innovation Centre in samenwerking met Zorg4Effect dankzij de genereuze subsidie en (financiële) bijdragen van diverse organisaties en fondsen. Deze ontwikkeling werd mogelijk gemaakt door: * Gemeente Leiden * Jo Visser fonds * Pleindoneren Stichting Else * Project SIVIL ZonMW * Transitiegelden van zorgkantoor Zorg en Zekerheid en Zorg4Effect”
Technical Description
Technologies utilized in the experience: 360 VR (3DOF), VR (6DOF)
Hardware required to experience the project: Standalone VR Headset
Operating system: Android
Language(s) used or supported in your experience: Dutch
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: Leiden Learning and Innovation Centre (Leiden University), Leiden University Medical Center and Zorg4Effect with funding by Gemeente Leiden, Jo Visser fonds, Pleindoneren Stichting Else, Project SIVIL ZonMW, Zorg en Zekerheid.
Date of completion: 02/01/2024
Acceptable conditions: For use educational settings. Please always consider appropriate embedding in the intended learning experience when exposing learners to the application.
Nevrolens
Name: Ekaterina Prasolova-Førland
Role: Project leader
Institution/company: Norwegian University of Science and Technology
About
Remote collaboration tool for neuroscience students to examine a rat brain (extended to include multiple brain models, e.g. human brain).
Technical Description
Technologies utilized in the experience: AR
Hardware required to experience the project: Mobile device
Operating system: Android
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Multi-user, Single-user
Project Details
Creators of this project: University or Research Project, Consortium Project (i.e. EU-funded project)
Date of completion: 10/07/2022
Acceptable conditions: Be aware that the app requests access to the camera of the user’s device to enable the augmented reality experience. The app contains a feature to take an image and save it locally on the device the user is using. The images are not transmitted over the Internet to any cloud storage. The app requests access to the microphone of the user’s device only to use it for the voice chat feature, while using the app in the collaborative mode. The app does not record and does not store the voice recording. The app also requests access to the storage of the device only to save the images taken in the app and saving and loading the progress in the app. The app does not access any other files or data stored on the user’s device.
Licence Model: Google play and App store policies
Application rating by impact area
Job Interview VR
Name: Ekaterina Prasolova-Førland
Role: Project leader
Institution/company: Norwegian University of Science and Technology
About
The Job interview VR app provides an immersive experience of a job interview. The app can be used to train and prepare for a job interview. The simulation is based on a scenario that contains 12 main questions and 14 additional comments or questions that appear optionally depending on the answers to the main questions. In the interview scenario, the user takes the role of the job candidate and goes through a typical job interview. The interviewer appears in a typical office room, captured in a 360-video format from the point of view of the user.
Technical Description
Technologies utilized in the experience: VR (6DOF)
Hardware required to experience the project: Standalone VR Headset
Operating system: Android
Language(s) used or supported in your experience: Norwegian
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 10/01/2020
Acceptable conditions: Be aware that the app records all sound during the simulated job interview. The app requests access to the microphone of the user’s device only to record the voice of the user while the app is in use. The sound recording is stored locally on the device while the app is in use. The app does not store the recording after the app is closed. The app does not transmit the recordings over the Internet.
Licence Model: Meta polity and Google Play policy
Application rating by impact area
VR4VET Blue sector
Name: Ekaterina Prasolova-Førland
Role: Project coordinator
Institution/company: Norwegian University of Science and Technology>
About
The VR4VET Blue Sector app is being developed for career guidance and vocational training in the Blue Economy sector, with a focus on empowering young job seekers. The app simulates an area of a fjord with several fish cages, a fish feeding station, a fish health and welfare station, a fish processing facility, a fish laboratory, and a reception area. The users can experience situations representing typical workplaces in the aquaculture and fish processing industries, such as feeding fish, inspecting fish for injuries and diseases, sorting fish in a factory, and analyzing water samples in a fish laboratory.
Technical Description
Technologies utilized in the experience: VR (6DOF)
Hardware required to experience the project: Standalone VR Headset
Operating system: Android
Language(s) used or supported in your experience: English, Norwegian
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: University or Research Project
Date of completion: 31/12/2024
Acceptable conditions: The app does not collect or share any personal information. The app does not access the user’s personal data stored on the device. The app does not access the user’s location data. The app does not access the user’s IP address. The app does not collect data about the user’s device.
Licence Model: Meta terms
Application rating by impact area
End-to-end open-source location-based augmented reality in 5G
Domain or subject area: Cinema/Cultural heritage/Documentary/Education/Gaming/Healthcare/Industry/Medical/Social/Social impact
Name: Open AR Cloud Europe gUG
Role: Project Coordinator, Researcher
Institution/company: Open AR Cloud Europe gUG
About
Domain or subject area: Cinema/Cultural heritage/Documentary/Education/Gaming/Healthcare/Industry/Medical/Social/Social impact
The vision of an augmented reality (AR) cloud is about an enhanced version of the real world extended by persistent, location-anchored digital objects. We present a fully open source, end-to-end solution for placing, storing, and re-discovering geo-anchored AR contents in the real world. We advanced various components of the Open Spatial Computing Platform (OSCP) and deployed it in a 5G testbed. We created a new OSCP reference client in Unity and built representative demo applications that allow virtual objects to persist throughout space and time. We created a data collector application for spatial mapping, and we connected the OSCP with an open-source visual positioning system. Furthermore, we created tutorials on the setup to foster its adoption in the scientific community as a platform for location-based AR experiments.
Technical Description
Technologies utilized in the experience: AR, Open Source XR Spatial Computing Web and Unity Client
Hardware required to experience the project: Mobile device
Operating system: Android, iOS
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Multi-user, Single-user
Project Details
Creators of this project: Consortium Project (i.e. EU-funded project)
Date of completion: 20/10/2022
Acceptable conditions: We produced and open source solution that was demoed at IEEE ISMAR 2022
Wisor: Open-Source Wireless XR Headset
Domain or subject area: Cultural heritage/Education/Gaming/Healthcare/Medical/Social/Social impact
Name: Egemen Ertuğrul
Role: Developer and Designer
Institution/company: Student project
About
Wisor is an open-source XR headset project that aims to offer an affordable, end-to-end, and versatile alternative for general-purpose use. The mission is to foster accessibility and affordability in XR technology by eliminating the need for expensive hardware and ensuring a seamless, cost-effective, and interoperable experience. No sign-ups, no vendor lock-ins. Complete freedom and accessibility for all. For supplementary material, click here:https://wisorxr.com/docs/
Technical Description
Technologies utilized in the experience: AR, MR, VR (6DOF)
Hardware required to experience the project: Custom-built hardware
Operating system: Raspberry Pi / Linux
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: Student Project
Date of completion: 02/10/2023
Acceptable conditions: Wisor XR headset can be used or exhibited in any setting that aligns with our mission of fostering accessibility and affordability in XR technology. This includes educational, non-commercial, and open-source environments. No proprietary or commercial constraints should be applied to its use, ensuring freedom and accessibility for all.
Licence Model: GNU Affero General Public License
Leonardo da Vinci VR
Name: Elena Blanes
Role: Producer & Designer
Institution/company: Private Company
About
Domain or subject area: Cultural heritage/Education
Benvenuti! Dive into this educational VR experience in which you embody a newly arrived apprentice to Leonardo da Vinci’s workshop in the Sforza Castle in Milan, and experience how a Renaissance workshop worked through different mini-games as well as visit a gallery with his worldwide known paintings and reproductions of some of his inventions. Embody a young pupil under his mentorship and learn about Leonardo’s ideas on art and science as well as discover more about the real person behind the veil of his myth. Learn through interaction, explore the different objects and work areas, and listen directly to the master.
Technical Description
Technologies utilized in the experience: VR (6DOF)
Hardware required to experience the project: Standalone VR Headset
Operating system: Android, Windows
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: Stega, an independent group of developers and artists from Málaga in Spain.
Date of completion: 01/03/2023
Acceptable conditions: Full permission to display or use the experience as long as the developer company is referenced.
Licence Model: CC BY-NC
DEVA – Dynamic Exposure Visualization App
Name: Oliver Schreer
Role: Project Manager
Institution/company: Fraunhofer Heinrich Hertz Institute
About
Domain or subject area: Environment/Social
This app offers a real-time visualization of air quality and traffic data based on publicly available environmental do-it-yourself (DIY) sensors with Augmented Reality. Environmental data from sensors are in your surrounding are visualized in overlay mode on the camera image of your mobile device such as smartphone or tablet. The app has the following features: 1. different visualization modes for optimized display of 3D sensor data in the augmented 3D space, 2. alert, if pollution thresholds are exceeded, 3. trip recording to record and save current GPS positions and monitor air quality along a recorded trip. The data serve as input for the Dynamic Exposure Visualization Dashboard (DEV-D) (https://monitoring.wecompair.eu/dashboards/dev-d), 4. detailed sensor information for a variety of pollutants such as CO2 (Carbon Dioxide), NO2 (Nitrogen Dioxide), BC (Black Carbon), PM1, PM2.5 and PM10 (Particulate Matter of size 1, 2.5 and 10 micrometres), humidity and temperature, 5. detailed traffic sensor information such as number of cars, trucks or bicycles for a given period. This app was developed in the Horizon Europe EU project Compair (No. 101036563) (see https://www.wecompair.eu/).
Technical Description
Technologies utilized in the experience: AR
Hardware required to experience the project: Mobile device
Operating system: Android, iOS
Language(s) used or supported in your experience: English
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: This app was developed in the Horizon Europe EU project Compair (No. 101036563)
Date of completion: 01/07/2024
Acceptable conditions: The app is currently publicly available on Google Play Store, an Apple iOS version will be coming soon.
Licence Model: CC BY-NC
Application rating by impact area
VR-ACE: Ace the job interview
Name: Erik Sikström
Role: Technical partner
Institution/company: Consortium Project (i.e. EU-funded project)
About
Enhancing Youth Employment with Virtual Reality Job Interview training Practice your job interview skills in VR and receive feedback from the app on your performance, and rate your own answers to the interview questions. You can also record your practice interviews using the built-in video recording feature of your Quest headset to further evaluate how well you performed. The VR-ACE project seeks to address the issues young people face in entering the labour market, particularly their lack of success in interviews. VR-ACE offers educational tools in the form of a Virtual Reality (VR) job interview experience and a digital guidebook and to strengthen young job seekers’ skills in applying for jobs and succeeding in interviews and improve their transversal skills, thus increasing their chances of employment. Supported languages: English, Danish, Finnish, French, Greek, Italian, Lithuanian Read more about the project at: https://vr-aceproject.eu/ Project Code: 2023-1-LT02-KA220-YOU-000152550 The project partners are either specalized in youth work, or software development.
Technical Description
Technologies utilized in the experience: VR (6DOF)
Hardware required to experience the project: Quest 3S, Standalone VR Headset
Operating system: Android
Language(s) used or supported in your experience: Danish, English, Finnish, French, Greek, Lithuanian
Is your experience a single-user or multi-user: Single-user
Project Details
Creators of this project: Consortium Project (i.e. EU-funded project)
Date of completion: 12/02/2025
Acceptable conditions: The compiled version of this software, as well as the other output from the VR-ACE project (reports, guidebooks, e-learning materials), may be used for free.