Yin Zhang
M.Sc. Candidate
Supervisor: Dr. Oscar Meruvia-Pastor

Exploring Gesture Control with Depth Sensing Camera in Virtual Reality

Department of Computer Science
Thursday, April 14, 2016, 11:00 a.m., Room EN 2022

---

Abstract

Immersive Virtual Reality (VR) has become more affordable with the appearance of VR headsets such as the Oculus Rift, Google Cardboard or the Samsung Gear. In addition, portable depth-sensing cameras allow users to control interfaces using hand gestures at a short range from the camera. Both technologies are being put together to create immersive VR experiences that respond to hand gestures. The goal of this project is to explore gesture-based interaction in immersive VR environments using Unity, Leap Motion, a Smartphone and the FreeFly VR headset. We implemented a system that allows users to play a game in a virtual world with the ultimate objective to explore improvements to this type of system. In this presentation, we will describe this project in more detail and present our findings.