###
Journal of Software:2013.24(6):1403-1417

面向云端Key/Value存储系统的开销敏感的数据迁移方法
秦秀磊,张文博,王伟,魏峻,赵鑫,钟华,黄涛
(中国科学院 软件研究所 软件工程技术中心, 北京 100190;计算机科学国家重点实验室(中国科学院 软件研究所), 北京 100190;中国科学院大学, 北京 100049)
Enabling Elasticity of Key-Value Stores in the Cloud Using Cost-Aware Live Data Migration
QIN Xiu-Lei,ZHANG Wen-Bo,WANG Wei,WEI Jun,ZHAO Xin,ZHONG Hua,HUANG Tao
(Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China;State Key Laboratory of Computer Science (Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China;University of the Chinese Academy of Sciences, Beijing 100049, China)
Abstract
Chart / table
Reference
Similar Articles
Article :Browse 2368   Download 2974
Received:July 10, 2012    Revised:October 19, 2012
> 中文摘要: Key/Value存储系统在大规模、高性能云应用支撑方面扮演了重要的角色,对云端Key/Value存储系统而言,数据迁移是实现节点动态扩展与弹性负载均衡的关键技术.如何降低迁移开销,是云服务提供商需着力解决的问题.已有研究工作大多针对非虚拟化环境下的数据迁移问题,这些方法对于云端Key/Value存储系统而言往往并不适用.为应对上述挑战,将数据迁移问题纳入负载均衡场景解决.提出一种基于面积的迁移开销模型,该模型可以有效感知底层VM性能干扰状况,权衡迁移时间与性能衰减值.进一步提出一种开销敏感的数据迁移算法,该算法基于开销模型与均衡度制订数据迁移计划,选取最优的迁移操作.基于雅虎的云服务基准测试工具YCSB验证了该方法的有效性.
Abstract:Key-Value stores play an important role in today’s large-scale, high-performance cloud applications. Elastic scaling and load rebalancing with low cost live data migration are critical to enabling the elasticity of Key/Value stores in the cloud. Learning how to reduce the migration cost is one difficult problem that cloud providers are trying to solve. Many existing works try to address this issue in non-virtual environments. These approaches, however, may not be well suited for cloud-based Key/Value stores. To address this challenge, the study tackles the data migration problem under a load rebalancing scenario. The paper builds a one cost model that could be aware of the underlying VM interference and trade-off between migration time and performance impact. A cost-aware migration algorithm is designed to utilize the cost model and balance rate to guide the choice of possible migration actions. Our evaluation using Yahoo! Cloud Serving Benchmark shows the effectiveness of the approach.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(61173003, 61100068); 国家重点基础研究发展计划(973)(2009CB320704); 国家高技术研究发展计划(863)(2012AA011204); 国家科技支撑计划(2012BAH05F02) 国家自然科学基金(61173003, 61100068); 国家重点基础研究发展计划(973)(2009CB320704); 国家高技术研究发展计划(863)(2012AA011204); 国家科技支撑计划(2012BAH05F02)
Foundation items:
Author NameAffiliationE-mail
QIN Xiu-Lei Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China
State Key Laboratory of Computer Science (Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China
University of the Chinese Academy of Sciences, Beijing 100049, China 
qinxiulei08@otcaix.iscas.ac.cn 
ZHANG Wen-Bo Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China  
WANG Wei Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China  
WEI Jun Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China
State Key Laboratory of Computer Science (Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China 
 
ZHAO Xin Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China
State Key Laboratory of Computer Science (Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China
University of the Chinese Academy of Sciences, Beijing 100049, China 
 
ZHONG Hua Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China  
HUANG Tao Technology Center of Software Engineering, Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China
State Key Laboratory of Computer Science (Institute of Software, The Chinese Academy of Sciences, Beijing 100190, China 
 
Reference text:

秦秀磊,张文博,王伟,魏峻,赵鑫,钟华,黄涛.面向云端Key/Value存储系统的开销敏感的数据迁移方法.软件学报,2013,24(6):1403-1417

QIN Xiu-Lei,ZHANG Wen-Bo,WANG Wei,WEI Jun,ZHAO Xin,ZHONG Hua,HUANG Tao.Enabling Elasticity of Key-Value Stores in the Cloud Using Cost-Aware Live Data Migration.Journal of Software,2013,24(6):1403-1417