###
DOI:
Journal of Software:2010.21(12):3175-3185

基于聚类和一致Hash的数据布局算法
陈涛,肖侬,刘芳,付长胜
()
Clustering-Based and Consistent Hashing-Aware Data Placement Algorithm
CHEN Tao,XIAO Nong,LIU Fang,FU Chang-Sheng
()
Abstract
Chart / table
Reference
Similar Articles
Article :Browse 4595   Download 5153
Received:November 06, 2008    Revised:April 12, 2010
> 中文摘要: 如何有效地对数据进行布局是大规模网络存储系统面临的重大挑战,需要一种能够自适应存储规模变化、公平有效的数据布局算法.提出的CCHDP(clustering-based and consistent hashing-aware data placement)算法将聚类算法与一致hash方法相结合,引入少量的虚拟设备,极大地减少了存储空间.理论和实验证明,CCHDP算法可以按照设备的权重公平地分布数据,自适应存储设备的增加和删除,在存储规模发生变化时迁移最少的数据量,并且可以快速地定位数据,对存储空间的消耗较少.
中文关键词: 数据布局  聚类算法  一致hash  公平  自适应
Abstract:Large-Scale network storage systems are confronted with the big challenge of efficiently distributing data among storage devices. It’s necessary to design an efficient, fair and adaptive data placement algorithm. This paper has developed an algorithm CCHDP (clustering-based and consistent hashing-aware data placement) to distribute data over heterogeneous devices in the systems. It combines clustering algorithm and consistent hashing, saving much memory space by avoiding extra virtual devices. The analysis and experiments show that CCHDP can notonly assign data evenly among devices and adapt well with the additions or departures of devices for the number of data moved is nearly equal to the optimal amount in the events of devices changes. Moreover, CCHDP is time efficient with little memory overhead.
文章编号:     中图分类号:    文献标志码:
基金项目:Supported by the National Natural Science Foundation of China under Grant Nos.60736013, 60903040 (国家自然科学基金); the National High-Tech Research and Development Plan of China under Grant Nos.2006AA01A106, 2006AA01A118 (国家高技术研究发展计划(863)); the Program for New Century Excellent Talents in University of China under Grant No.NCET-08-0145 (新世纪优秀人才支持计划) Supported by the National Natural Science Foundation of China under Grant Nos.60736013, 60903040 (国家自然科学基金); the National High-Tech Research and Development Plan of China under Grant Nos.2006AA01A106, 2006AA01A118 (国家高技术研究发展计划(863)); the Program for New Century Excellent Talents in University of China under Grant No.NCET-08-0145 (新世纪优秀人才支持计划)
Foundation items:
Author NameAffiliation
CHEN Tao  
XIAO Nong  
LIU Fang  
FU Chang-Sheng  
Reference text:

陈涛,肖侬,刘芳,付长胜.基于聚类和一致Hash的数据布局算法.软件学报,2010,21(12):3175-3185

CHEN Tao,XIAO Nong,LIU Fang,FU Chang-Sheng.Clustering-Based and Consistent Hashing-Aware Data Placement Algorithm.Journal of Software,2010,21(12):3175-3185