| 本文已被：浏览 4577次 下载 6216次 |
码上扫一扫！ |
|
|
| 数据流历史数据的存储与聚集查询处理算法 |
|
张冬冬1, 李建中1,2, 王伟平1, 郭龙江1,2
|
|
1.哈尔滨工业大学,计算机科学与技术学院,黑龙江,哈尔滨,150001;2.黑龙江大学,计算机科学与技术学院,黑龙江,哈尔滨,150080
|
|
| 摘要: |
| 目前数据流的研究成果主要集中在分析处理存储于内存中的最近一段时间内的数据流数据,忽略了对数据流历史数据的分析处理与存储管理.提出了一种数据流历史数据的存储管理及聚集查询处理方法,通过对历史数据实施多层递阶抽样存储,并在内存中建立存储数据流历史数据聚集值的HDS-Tree索引,实现对无限数据流历史数据的存储管理,有效地支持各种聚集查询同时,还给出了基于HDS-Tree的聚集查询算法的时间复杂性分析和查询误差分析.理论分析与实验结果表明,该方法可以有效地用于数据流历史数据的存储与分析. |
| 关键词: 数据流 历史数据 聚集算法 HDS-Tree |
| DOI： |
| 分类号: |
| 基金项目:Supported bv the National Natural Science Foundation of China under Grant No.60273082(国家自然科学基金);the National High-Tech Research and Development Plan of China under Grant No.2002AA444110(国家高技术研究发展计划(863));the National Grand Fundamental Research 973 Program of China under Grant No.G1999032704(国家重点基础研究发展规划(973));the Natural Science Foundation of Heilongjiang Province of China under Grant No.zjg03-05(黑龙江省自然科学基金) |
|
| Algorithms for Storing and Aggregating Historical Streaming Data |
|
ZHANG Dong-Dong,LI Jian-Zhong,WANG Wei-Ping,GUO Long-Jiang
|
| Abstract: |
| The current research work over data streams is mainly focused on dealing with the arrival of recent data in memory, neglecting the analysis and management of historical streaming data. An approach is proposed to store and query historical streaming data by using multi-layer recursive sampling method and HDS-Tree structure, which indexes the aggregation of historical streaming data and supports all kinds of aggregation queries over historical streaming data. The time-complexity and the error of aggregation algorithms are also analyzed based on HDS-Tree. The analytical and experimental results show that the approach can be effectively used to store and analyze the historical streaming data. |
| Key words: data streams historical data aggregation algorithm HDS-Tree |
