Gesture based non-obstacle interaction on mobile computing devices for dirty working environment

William B Huynh, Purdue University

Abstract

The dominant way of interacting with tablets, smartphones, or wearable devices are through touchscreen or touchpad, which requires the user to physically touch the device’s screen. However, in certain situation, for example, a dirty working environment, touching is not ideal or feasible. This study examined a new method that allows for a non-touch interaction by using the devices’ back camera along with simple gesture to simulate mouse clicking. Cameras are used to capture motion-based gestures coupled with object detection, achieving a non-touch interaction. With human subject evaluation, the researcher found that using the back camera on mobile devices for gesture based controls is not as efficient as touch. Efficiency was measured in speed and accuracy, speed was about three times slower than current touch method, accuracy varied depending on smoothness of a task but was about two times less accurate. However, in a dirty working environment, this method is still effective and intuitive to use.

Degree

M.S.

Advisors

Chen, Purdue University.

Subject Area

Computer science

Off-Campus Purdue Users:
To access this dissertation, please log in to our
proxy server
.

Share

COinS