| 摘要: |
| 手持移动计算已逐渐成为当今主流的计算模式之一,人机交互是其中的关键问题.多通道用户界面和多通道交互方式能够有效地提高移动环境中人机交互的效率.讨论了移动环境中的多通道交互模型,并结合设计开发的移动导游系统TGH(tour guide on hand),分析了多通道交互在手持移动计算中的应用.性能测试表明,笔和语音结合的多通道交互方式在移动环境中能够较好地提高人机交互效率. |
| 关键词: 手持移动计算 多通道用户界面 多通道交互 语音 导游系统 |
| DOI: |
| 分类号: |
| 基金项目:Supported by the National Natural Science Foundation of China under Grant No.60033020 (国家自然科学基金); the National High-Tech Research and Development Plan of China under Grant No.2001AA114170 (国家高技术研究发展计划(863) |
|
| Multi-Modal Interaction in Handheld Mobile Computing |
|
WANG Yue,YUE Wei-Ning,WANG Heng,DONG Shi-Hai
|
| Abstract: |
| Handheld mobile computing has increasingly become a mainstream computing paradigm, in which human-computer interaction is an essential issue. Multi-Modal user interface and multi-modal interaction can effectively improve the interaction efficiency in mobile computing. This paper presents a multi-modal interaction model and discusses the application of multi-modal interaction in handheld devices. Then the tour guide system is described. An experimental evaluation shows that the multi-modal interaction, based on pen and speech, can greatly improve its interaction. |
| Key words: mobile computing multi-modal user interface multi-modal interaction speech tour guide |