| 本文已被：浏览 5094次 下载 7834次 |
码上扫一扫！ |
|
|
| 一种自适应文件系统元数据服务负载均衡策略 |
|
佘楚玉1,2,3, 温武少1,2, 肖扬1, 刘育擘1, 贾殷1
|
|
1.中山大学 数据科学与计算机学院, 广东 广州 510006;2.中山大学-卡内基梅隆大学国际联合研究院, 广东 顺德 528300;3.广东财经大学 数学与统计学院, 广东 广州 510320
|
|
| 摘要: |
| 随着大数据时代的到来，全球信息存储量呈现爆发式的增长，传统的存储系统在存储性能、存储容量、数据可靠性和成本等方面存在诸多不足.近年来，以云计算平台为依托的存储技术得到了飞速发展，成为处理海量数据的重要工具.针对分布式文件系统元数据管理的问题，提出了一种自适应元数据服务负载均衡策略.该策略主要包括以下3点内容：介绍了一种实时的元数据服务器的性能评价模型；提出了一种基于服务器负载变化的检测周期自适应调整机制；提出了一种基于元数据服务器性能指标的自适应负载均衡算法.实验结果证明了该方法的可行性、有效性和稳定性. |
| 关键词: 分布式文件系统 元数据管理 自适应 负载均衡 性能评价模型 |
| DOI：10.13328/j.cnki.jos.005199 |
| 分类号: |
| 基金项目:广东省科技计划（2014B010114002，2015B010108004） |
|
| Adaptive Load Balancing Strategy for File-System Metadata Service |
|
SHE Chu-Yu1,2,3, WEN Wu-Shao1,2, XIAO Yang1, LIU Yu-Bo1, JIA Yin1
|
|
1.School of Data and Computer Science, Sun Yat-Sen University, Guangzhou 510006, China;2.SYSU-CMU Shunde International Joint Research Institute, Shunde 528300, China;3.School of Mathematics and Statistics, Guangdong University of Finance and Economics, Guangzhou 510320, China
|
| Abstract: |
| With the advent of big data era, global storage is experiencing an explosive growth. Traditional storage systems have several drawbacks in storage performance, storage capacity, data security and device cost. In order to handle large amount of data, the storage technology for cloud computing platform has undergone rapid development in the recent years, and become an important tool to deal with big data. This paper analyzes the shortcomings of metadata management of certain distributed file system and proposes an adaptive metadata load balancing mechanism. First, a real-time server performance evaluation model is introduced. Next, a period adaptive mechanism based on change of server load is built. Finally, an adaptive load balancing algorithm based on server performance is proposed. Experimental results demonstrate the practicability, availability and stability of the new mechanism. |
| Key words: distributed file system metadata management adaptive load balancing performance evaluation model |
