| 本文已被：浏览 2663次 下载 4640次 |
码上扫一扫！ |
|
|
| 移动环境下神经功能评价多通道交互模型 |
|
黄进1,2, 陈毅能1,2, 刘杰1,2, 田丰1, 戴国忠1, 王宏安1
|
|
1.人机交互北京市重点实验室(中国科学院 软件研究所), 北京 100190;2.中国科学院大学 计算机与控制学院, 北京 100049
|
|
| 摘要: |
| 随着平板电脑、智能手机、智能手表等智能移动设备的普及，利用便携的智能移动设备随时随地进行健康评价受到了国内外学者的广泛关注.人机交互特有的多通道、交互式、人机协同的计算能够有效地提高移动环境下神经功能评价的准确度.然而，目前很少有研究对人机交互在这一应用场景上发挥的作用进行过充分讨论，更没有形成统一的多通道交互模型.为此，首先分析了目前移动设备上主流的神经功能评价方法，归纳总结出了一套适用该应用场景的交互原语和交互任务.然后，在此基础上提出了移动环境下神经功能评价多通道人机交互模型——MINA（multimodal human-computer interaction model for nerve function assessment in mobile environment)，并对该模型的移动医学评价和多通道融合特点进行了分析.最后，依据此模型给出神经系统疾病检测的应用实例.实践证明，MINA能够较好地指导交互式神经功能评价应用的设计和开发，多通道融合的方式能够有效地提高医学评价的准确度. |
| 关键词: 移动环境 神经功能评价 人机交互 多通道交互 交互模型 |
| DOI： |
| 分类号: |
| 基金项目:国家自然科学基金（61232013，61422212) |
|
| Multimodal Human-Computer Interaction Model for Nerve Function Assessment in Mobile Environment |
|
HUANG Jin1,2, CHEN Yi-Neng1,2, LIU Jie1,2, TIAN Feng1, DAI Guo-Zhong1, WANG Hong-An1
|
|
1.Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, the Chinese Academy of Sciences), Beijing 100190, China;2.School of Computer and Control Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
|
| Abstract: |
| With the growing popularity of smart mobile devices such as tablet PCs, smart phones and smart watches, the use of portable smart mobile devices in health evaluation has received extensive attention of scholars at home and abroad. The characteristics of multimodal, interactive and collaborative computing in human-computer interaction (HCI) can effectively improve the accuracy of nerve function assessment. However, little research has been done on the important role of human computer interaction in medical assessment, and no model of nerve function assessment in mobile environment has been established. Therefore, this paper firstly analyzes the mainstream method of nerve function assessment in mobile environment, and summarizes a set of interaction primitives and interaction tasks for the application on this scenario. Then it proposes a multimodal human-computer interaction model for nerve function assessment in mobile environment:MINA, and analyzes the characteristics of mobile health assessment and multimodal fusion in MINA. Finally, one application that builds on MINA has been demonstrated. The practice shows that MINA can better guide the development of interactive nerve assessment applications, and the multimodal fusion can effectively improve the accuracy of medical assessment. |
| Key words: mobile environment nerve function assessment human-computer interaction multimodal interaction interaction model |
