VIRTUALTIMES
Overview
Exploring and Modifying the Sense of Time in Virtual Environments.
Project Website
Project Vision
-
This project aims to explore and modify the sense of time in virtual environments to change our understanding of time experience and its relevance for the therapy of psychopathological conditions (e.g. Depression, Schizophrenia, Autism) and human well-being in general.
-
At the project’s core is the development and evaluation of a novel type of experimental AI-enhanced VR platform called MetaChron to study, measure and modify time perceptions.
-
MetaChron represents a first step towards a system that not only will be able to detect (“diagnose”) but also allow to modify (“treat”) variations or distortions of the sense of time in an individualized, neuroadaptive, hence “intelligent” way;
Our Role (HCI Group - UNI UW) - MetaChron Development
Development of an experimental VR platform (Metachron) that allows performing experiments of time experience and time manipulation studies requiring:
- (1) Provision of robust and user-friendly VR research scenarios
- (2) Integration of a novel AI-driven time controller modifying the dynamics of the VR setup
- (3) Development and integration the relevant technology and methodology components including VR environments
- (4) Preparation of automatic scenario adaptation.
Virtual Zeitgebers
-
Metachron is providing new experimental VR environments for exploring the influence of different types of virtual zeitgebers and their velocity, density, and synchronicity on time perception in collaboration with the project partners.
-
Virtual zeitgebers represent any virtual object influencing time perception, such as a virtual clock or pen,dulum , or even a virtual sun.
Metachron is mainly investigating five types of virtual zeitgebers:
- Object-based virtual zeitgebers: study the influence of virtual objects like virtual clocks, pendulums, and even fire on time perception
- Travel-based virtual zeitgebers: study the influence of virtual travel like starfield or tunnel simulation on time perception
- Body-based virtual zeitgebers: study the influence of the virtual body embodiment and disembodiment on time perceptions
- Social-based virtual zeitgebers: study the influence of virtual agents like virtual human groups or audiences on time perception
- Activity-based virtual zeitgebers: study the influence of certain activities like waiting, playing or, working on time perception
Metachron Architecture and Features
- MetaChron is a comprehensive system for researching time perception within Unreal Engine 4.x and includes a large variety of manipulable virtual elements and detailed interaction libraries
- See a Description of the platform architecture and features here:
- Main Components:
- 18 virtual zeitgebers (which can be manipulated in terms of velocity, density and synchronicity via 3D/2D UI, Code or Webt REST API)
- 12 Environments
- 12 Virtual humans
- 6 Avatar Types
- 7 Questionnaires in VR and desktop versions (Time, Presence, Embodiment,…)
- 3D Interactions (Grasping, Teleporting, …)
- Eye Tracking
- Over 15 interactive demos and 50 videos demonstrate the system’s capabilities, and all resources are freely available online (see below).
Metachron Licence and EULA
-
The Metachron platform and interactive demos are now open-source under the BSD 3-Clause License. Software terms, end-user agreements, and disclaimers can be found here in the repositories.
-
The repositories and demos are listed below and are updated continuously. Currently available are 15 interactive demos and four versions of the Metachron Platform (v1.0, v2.0, v3.0, and v3.x for ongoing development).
-
We aim to promote future collaboration, innovation, research and commercialization by opening the source code and applications developed.
-
While executable versions of the demos are fully public, accessing the source code requires sending an email request, as detailed on our website. This simple step allows us to track usage for research purposes while still providing open access.
Metachron Videos
Metachron Platform and Demos
| MetaChron Systems | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Version | Overview | Repository (Source/Private) | Private Repository Access Request Only for Non-commercial Projects, or Project Reviewers and Partners |
Description | Videos | Instructions | End User Agreement & Licence | |||
| v1.0 | MetaChron v1.0 Core Design (architecture and manual time manipulation) - M2.1 (M12) | Repository | Send Email | All resources associated to this Milestone (Source Code, Environments, Examples and Documentation) - Info on public repository |
Overview, Environments showcase , Zeitgebers Velocity Modifications in VR,Zeitgeber Integration in Unreal Scene Demo ,First waiting room prototype with Embodiment , Waiting Room replica experiment ,Eye Tracking Integration ,Eyer Tracking Accuracy Test, Avatar Partial Embodiment - Virtual Hand Representations Avatar Embodiment- Full Body Tracking,Eyetracking heatmap, Realistic Waiting Room and different user representations , Questionnaires in VR , Synchronicity manipulation, Time-Event physics manipulation, Event Synchronisation, Environmental Density Demo, Social Atmospheres, Experimentatl Feature: Gravity Manipulation + Rewind Time Feature, Environmental effects, |
See README.md in Repository | See README.md in Repository | |||
| v2.0 | MetaChron v2.0 AI-driven Time - M2.2 (M30) | Repository | Send Email | All resources associated to this Milestone (Source Code, Environments, Examples and Documentation) - see Info on public repository |
See README.md in Repository | See README.md in Repository | ||||
| v.3.0 | MetaChron v3.0 Final Version - D2.1 (M42) | Repository | Send Email | All resources associated to this deliverable (Source Code, Environments, Examples and Documentation) - see Info on public repository |
See README.md in Repository | See README.md in Repository | ||||
| v.3x | MetaCron v3.x (Current Development) | Repository | Send Email | Repository for MetaChron Core Current Development (including new experiments, demos and experimental features in preparation) |
See README.md in Repository | See README.md in Repository | ||||
| MetaChron Demos | ||||||||||
| Demo Set ID | Virtual Zeitgeber Type | Demo Set Overview | Repository (Exec/Public) | Repository (Source/Private) | Private Repository Access Request Only for Non-commercial Projects, or Project Reviewers and Partners |
Description | Demos | Videos | Instructions | End User Agreement & Licence |
| 1 | Object-based Virtual Zeitgebers | Zeitgebers Manipulation Example | Repository | Repository | Send Email | Showcasing the interactive manipulation of different Zeitgebers (e.g. clock, pendulum, sun) in VR and Desktop |
See README.md in Repository | See README.md in Repository | ||
| 2 | Object-based Virtual Zeitgebers | Doctor’s Waiting Room with faster/slower Clock | Repository | Repository | Send Email | Showcasing four versions of a doctor’s waiting room in VR. The scenario include typical ambient noises and a faster/slower running clock as a Zeitgeber |
Clock-velocity-decreased Clock-velocity-increased Clock-velocity-normal Clock-velocity-testing |
See README.md in Repository | See README.md in Repository | |
| 3 | Object-based Virtual Zeitgebers | Doctor’s waiting room with synchronized or desynchronized clock | Repository | Repository | Send Email | Showcasing two versions of a doctor’s waiting room in VR. The scenario includes typical ambient noises and a synchronized or desynchronized visual-audio clock as a Zeitgeber |
Clock-asynchronicity Clock-synchronicity |
See README.md in Repository | See README.md in Repository | |
| 4 | Social-based Virtual Zeitgebers | Doctor’s waiting room with Agents | Repository | Repository | Send Email | Showcasing four versions of a doctor’s waiting room in VR. with multiple virtual huam (agents). The scenario includes a varying number of agents sitting next to you. Depending on the selected scenario, the social atmosphere created by the agents’ behavior also changes (e.g. positive, negative, neutral atmosphere) |
Big-Agressive-WaitingRoom Big-Neutral-WaitingRoom Big-Positive-WaitingRoom Empty-WaintingRoom Small-Agressive Small-Neutral Small-Positive |
See README.md in Repository | See README.md in Repository | |
| 5 | Activity-based Virtual Zeitgebers | Generic Office Waiting Room | Repository | Repository | Send Email | “Showcasing versions of a digital twin of a waiting room (replica of areal waiting room) for a comparison between a Virtual and a real waiting situation concerning boredom, self-regulation, and the experience of time - paper Collaboration with Freiburg group (IGPP). Contact person from Freiburg: Dr. Marc Wittmann wittmann@igpp.de and Federico Alvarez alvarez@igpp.de |
See README.md in Repository | See README.md in Repository | ||
| 6 | Travel-based Virtual Zeitgebers | VR Tunnel (v1.1) - Virtual Tunnel Simulation | Repository | Repository | Send Email | “Showcasing versions of a tunnel-traveling simulation for Desktop and VR setting. In addition to the actual tunnel, this scenario contains a distinctive UI that presents the wide range of setting options. After selecting the parameters, you move through a tunnel in VR or on the screen - Collaboration with Freiburg group (IGPP). Contact person from Freiburg: Dr. Marc Wittmann wittmann@igpp.de and Federico Alvarez alvarez@igpp.de |
See README.md in Repository | See README.md in Repository | ||
| 7 | Travel-based Virtual Zeitgebers | Starfield and Starship v1 - Velocity and Density Experiment - | Repository | Repository | Send Email | Showcasing versions of a starfield and starship in VR.In this scenario, you are on a starship and flying through space. You can see a multitude of configurable stars through the front window - Collaboration with JÜLICH group (JÜLICH). Contact person from JÜLICH: mathis Jording m.jording@fz-juelich.de |
See README.md in Repository | See README.md in Repository | ||
| 8 | Body-based Virtual Zeitgebers | Embodiment and Waiting Time Perception (Baseline Experiment) | Repository | Repository | Send Email | In this scenario, you are sitting on a chair in a nearly empty room and your task is to wait there. You either receive an avatar or no virtual body at all. |
See README.md in Repository | See README.md in Repository | ||
| 9 | Object-based Virtual Zeitgebers | Zeitegeber Type Experiment | Repository | Repository | Send Email | See README.md in Repository | See README.md in Repository | |||
| 10 | Object-based Virtual Zeitgebers | Zeitegeber Velocity Experiment | Repository | Repository | Send Email | See README.md in Repository | See README.md in Repository | |||
| 11 | Body-based Virtual Zeitgebers | Embodiment and Task Time Perception | Repository | Repository | Send Email | “ In this scenario, your task is to activate a virtual lamp by pressing a button and estimate the delay between pressing the button and the light turning on. You experience different degrees of embodiment: i) without an avatar (low), ii) with hands (medium), and iii) with a high-quality avatar (high) - Collaboration with JÜLICH group. Contact person from JÜLICH: David Vogel david.vogel@uk-koeln.de |
See README.md in Repository | See README.md in Repository | ||
| 12 | Body-based Virtual Zeitgebers | Disembodiment and Task Time Perception | Repository | Repository | Send Email | In this scenario, you are initially embodied in a virtual avatar from the eye-view. After a certain time, you are actively disembodied by performing a linear transition to the behind-view or facing-view, whereby you can continue to control the virtual avatar. |
See README.md in Repository | See README.md in Repository | ||
| 13 | Travel-based Virtual Zeitgebers | VR Tunnel v2.0 - Virtual Tunnel Simulation | Repository | Repository | Send Email | “Showcasing versions of a tunnel-traveling simulation for Desktop and VR setting. In addition to the actual tunnel, this scenario contains a distinctive UI that presents the wide range of setting options. After selecting the parameters, you move through a tunnel in VR or on the screen - Collaboration with Freiburg group (IGPP). Contact person from Freiburg: Federico Alvarez alvarez@igpp.de |
See README.md in Repository | See README.md in Repository | ||
| 14 | Travel-based Virtual Zeitgebers | Starfield and Starship v2.0 - Variable Foreperiod Task and Asynchronies | Repository | Repository | Send Email | “Showcasing versions of a starfield and starship in VR.In this scenario, you are on a starship and flying through space. You can see a multitude of configurable stars through the front window. - Collaboration with INSERM group . Contact person from INSERM: GIERSCH Anne giersch@unistra.fr, ellen Joos ellen.joos2014@gmail.com |
See README.md in Repository | See README.md in Repository | ||
| 15 | Travel-based Virtual Zeitgebers | AI-Driven Prototype Showcase: NeuroAdaptive Startfield - v1 | Repository | Repository | Send Email | “Demonstration of an AI driven VR scenario with MetaChron - MetaChron enables the detection of a person’s physiological states (EEG) and makes automatic adjustments to a starfield displayed in a VR environment” - Collaboration with University of Helsinki (UH) group - Contact person from University of Helsinki (UH) - Giulio Jacucci giulio.jacucci@helsinki.fi, Imtiaj Ahmed imtiaj.ahmed@helsinki.fi |
See README.md in Repository | See README.md in Repository | ||
| 16 | Travel-based Virtual Zeitgebers | Therapist UI Prototype - Demonstration for the AI-Driven Prototype Showcase “NeuroAdaptive Startfield - v1 | Repository | Repository | Send Email | “Showcasing the Therapist UI with an AI driven VR scenario with MetaChron - MetaChron enables the detection of a person’s physiological states (EEG) and makes automatic adjustments to a starfield displayed in a VR environmen - Collaboration with Psious Smart Apps, S.L. (PSICO) group . Contact person from PSICO: Xavier Palomer xavier@psious.com |
See README.md in Repository | See README.md in Repository | ||
| 17 | Body-based Virtual Zeitgebers | Embodiment and Task Time Perception v2 | Repository | Repository | Send Email | “ In this version , your task is to activate a virtual lamp by pressing a button and estimate the delay between pressing the button and the light turning on. You experience different degrees of embodiment: i) without an avatar (low), ii) with hands (medium), and iii) with a high-quality avatar (high)- You will also experience one condition (called Observer) where the switch is automatically pressed - Collaboration with JÜLICH group. Contact person from JÜLICH: David Vogel david.vogel@uk-koeln.de |
See README.md in Repository | See README.md in Repository | ||
| 18 | Travel-based Virtual Zeitgebers | AI-Driven Prototype Showcase: NeuroAdaptive Startfield - v2 - with Multimodal Physiological Signals | Repository | Repository | Send Email | “Demonstration of an AI driven VR scenario Physiological activity used to classify users imagery movement and the velocity of the starfield updated respectively, imagery running increases the startfield velocity and standing still decreases. Multimodal physiological signals in use (EEG for classifying imagery movement states,fEMG, ECG, and accelerometer for maintaining quality of the data).” - Collaboration with University of Helsinki (UH) group - and Collaboration with JÜLICH group (JÜLICH). Contact person from JÜLICH: mathis Jording m.jording@fz-juelich.de - Contact person from University of Helsinki (UH) - Giulio Jacucci giulio.jacucci@helsinki.fi, Imtiaj Ahmed imtiaj.ahmed@helsinki.fi |
See README.md in Repository | See README.md in Repository |
News
The sense of presence that virtual reality can trigger in us - Prof. Dr. Marc Erich Latoschik (HCI) talks about this in the program Xenius: Urlaub trotz Corona: Neue Chancen entdecken. The focus is on the projects Virtual Times and Interactive Opera.
Prof. Dr. Marc Erich Latoschik (HCI) speaks in the program alles wissen about the feeling of presence that virtual reality can trigger in us. The focus is on the projects Virtual Times and Interactive Opera.
Daniel Roth and Maximilian Landeck presented their work at the VRST 2019 in Sydney.
The HCI chair will start to work at a new party promoted research project called "VIRTUALTIMES -Exploring and Modifying the Sense of Time in Virtual Environments."
Funding and Collaboration
JÜLICH will lead the consortium of VIRTUALTIMES and will play a leading role in the neuroscientific validation of time experience in the different populations of persons being studied including their variations due to the different psychopathological conditions.
IGPP will play a strategic role in the project as it brings in the expertise in all psychological aspects of human subjective time.
Universität Würzburg will be responsible for the provision of the base technological platform for the various prototypes as well as of the integration of the modules into the prototypes. It will lead the development of the timeliness protocols and interfaces and will provide key functionality of the avatar technologies. It will support the development of the sync-engine, especially with respect to the timeliness protocols.
The INSERM U1114 laboratory will provide its expertise on timing disorders in schizophrenia, its innovative methods of behavioral exploration and access to patients for both experimental, EEG and fMRI studies.
The University of Helsinki (UH) is one of the best multidisciplinary research universities in Europe. The high-quality research carried out by the university creates new knowledge for educating diverse specialists in various fields and for utilization in social decision making and the business sector. From the UH, two departments are participating in EMPATEC: the Department of Social Research and the Department of Computer Science.
PSICO will be the lead partner in developing the VR environments with hyper-realistic format and human-like avatars and integrating them with the time scaling techniques. PSICO is an expert bringing medical and therapeutic meaning into the VR technology, crucial for the project.
