Date of Award

4-2016

Degree Type

Thesis

Degree Name

Master of Science (MS)

Department

Computer Science

First Advisor

Yingjie Victor Chen

Committee Chair

Yingjie Victor Chen

Committee Member 1

Raymond Hassan

Committee Member 2

Tim McGraw

Abstract

The dominant way of interacting with tablets, smartphones, or wearable devices are through touchscreen or touchpad, which requires the user to physically touch the device’s screen. However, in certain situation, for example, a dirty working environment, touching is not ideal or feasible. This study examined a new method that allows for a non-touch interaction by using the devices’ back camera along with simple gesture to simulate mouse clicking. Cameras are used to capture motion-based gestures coupled with object detection, achieving a non-touch interaction. With human subject evaluation, the researcher found that using the back camera on mobile devices for gesture based controls is not as efficient as touch. Efficiency was measured in speed and accuracy, speed was about three times slower than current touch method, accuracy varied depending on smoothness of a task but was about two times less accurate. However, in a dirty working environment, this method is still effective and intuitive to use.

Download

Share

COinS