Multimodal Human-Computer Interaction Model for Nerve Function Assessment in Mobile Environment
DOI:
Author:
Affiliation:

Clc Number:

Fund Project:

National Natural Science Foundation of China (61232013,61422212)

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    With the growing popularity of smart mobile devices such as tablet PCs, smart phones and smart watches, the use of portable smart mobile devices in health evaluation has received extensive attention of scholars at home and abroad. The characteristics of multimodal, interactive and collaborative computing in human-computer interaction (HCI) can effectively improve the accuracy of nerve function assessment. However, little research has been done on the important role of human computer interaction in medical assessment, and no model of nerve function assessment in mobile environment has been established. Therefore, this paper firstly analyzes the mainstream method of nerve function assessment in mobile environment, and summarizes a set of interaction primitives and interaction tasks for the application on this scenario. Then it proposes a multimodal human-computer interaction model for nerve function assessment in mobile environment:MINA, and analyzes the characteristics of mobile health assessment and multimodal fusion in MINA. Finally, one application that builds on MINA has been demonstrated. The practice shows that MINA can better guide the development of interactive nerve assessment applications, and the multimodal fusion can effectively improve the accuracy of medical assessment.

    Reference
    Related
    Cited by
Get Citation

黄进,陈毅能,刘杰,田丰,戴国忠,王宏安.移动环境下神经功能评价多通道交互模型.软件学报,2016,27(S2):156-171

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:November 29,2016
  • Revised:December 05,2016
  • Adopted:
  • Online: January 10,2017
  • Published:
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063