Department of Computer Science

MARVEL

Mixed & Augmented Reality & Virtual Environments Lab

We are an interdisciplinary group of researchers from Computer Science, Psychology and Health, investigating mixed, augmented and virtual reality and its applications.

We look at how virtual content can be created, how its design affects its users and how it can be used to address challenges and create innovative and engaging experiences in areas including physical and mental health, art, entertainment and sport.

Projects

Interactive Narrative at Dyrham Park

dyrham-parkMARVEL is working with the National Trust on an interactive exhibit at their Dyrham Park property. The exhibit aims at bringing the rich history of this 17th century mansion to life by immersing visitors into a narrative. We are combining different modalities to augment this historic setting and engage visitors with its stories.

Live User-Guided Intrinsic Video For Static Scenes

interactiveintrinsicarWe present a novel real-time approach for user-guided intrinsic decomposition of static scenes captured by an RGB-D sensor. In the first step, we acquire a three-dimensional representation of the scene using a dense volumetric reconstruction framework. The obtained reconstruction serves as a proxy to densely fuse reflectance estimates and to store user-provided constraints in three-dimensional space. User constraints, in the form of constant shading and reflectance strokes, can be placed directly on the real-world geometry using an intuitive touch-based interaction metaphor, or using interactive mouse strokes. Fusing the decomposition results and constraints in three-dimensional space allows for robust propagation of this information to novel views by re-projection. We leverage this information to improve on the decomposition quality of existing intrinsic video decomposition techniques by further constraining the ill-posed decomposition problem. In addition to improved decomposition quality, we show a variety of live augmented reality applications such as recoloring of objects, relighting of scenes and editing of material appearance.

For more information, please see the project website.