Journal of Software:2018.29(S2):75-85

(浙江工业大学 计算机科学与技术学院, 浙江 杭州 310023)
Eye Tracking and Gesture Based Interaction for Target Selection on Large Display
CHENG Shi-Wei,ZHU An-Jie,FAN Jing
(School of Computer Science & Technology, Zhejiang University of Technology, Hangzhou 310023, China)
Chart / table
Similar Articles
Article :Browse 500   Download 382
Received:June 15, 2018    
> 中文摘要: 眼动跟踪方法具有很强的视觉指向性,可以将其应用于面向大屏幕的目标选择,进而避免鼠标操作方式在空间上的远距离移动.然而,仅仅利用眼动跟踪进行选择操作,也会产生选择精度降低、容易产生误操作等问题.因此,为了实现大屏幕上快速、准确的目标选择,提出一种融合眼动跟踪与手势的多通道交互方法,即通过眼动跟踪选择目标,利用手势进行选择确认.在目标尺寸小、目标间距较小时,通过光标稳定和二次选择机制进一步对交互过程进行优化.用户测试结果表明,该方法可以在大屏幕上针对不同尺寸和间距的目标完成有效的选择操作,与仅使用眼动跟踪的目标选择方法相比,任务完成速度提升了16%,任务完成正确率提升了82.6%.此外,针对层级菜单的具体选择任务,该方法与仅使用眼动跟踪的方法相比,任务完成速度提升了13.6%,任务完成正确率提升了55.7%.此外,该方法总体性能接近传统的鼠标操作方式,进一步验证了该方法在实际应用中的有效性.
Abstract:Mouse based target selection will require much movement when locating target across long distance on large display. On the other hand, eye tracking technique can locate target more easily and quickly across long distance. Hence, eye tracking has a high potential for fast targets selection on large displays. However, eye tracking still faces the challenges, such as low accuracy, and high error rate of selection operation, especially for gaze-only interaction. This study proposed a multimodal interaction method that combined gaze with gestures. This method utilized gaze for rough selection first, and then utilized hand gesture to confirm accurate selection. Furthermore, in order to keep the selection accuracy when targets are small and crowded, authors used semi-fixed gaze cursor and secondary selection mechanism to optimize the selection process. Finally, the method conducted a user study in different levels of target sizes and distance among targets. The results show that the selection speed and accuracy rate of proposed method are higher than those of the method only using gaze with 16% and 82.6% respectively. In addition, for the selection of the hierarchical menu items, the selection speed and accuracy rate of proposed method are higher than the those of method only using gaze with 13.6% and 55.7% respectively. In addition, the overall performance of proposed method is similar to the mouse based selection method, and it also validates the effectiveness of the proposed method.
文章编号:     中图分类号:    文献标志码:
基金项目:国家重点研发计划(2016YFB1001403);国家自然科学基金(61772468) 国家重点研发计划(2016YFB1001403);国家自然科学基金(61772468)
Foundation items:National Key Research and Development Plan (2016YFB1001403); National Natural Science Foundation of China (61772468)
Reference text:


CHENG Shi-Wei,ZHU An-Jie,FAN Jing.Eye Tracking and Gesture Based Interaction for Target Selection on Large Display.Journal of Software,2018,29(S2):75-85