Research on Database Stability Optimization Under Large-capacity and High-concurrency Load
Author:
Affiliation:

Clc Number:

TP311

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Database systems serve as critical infrastructure for big data, with their performance directly affecting the quality of service (QoS) for upper-layer applications. With the rapid advancement of storage hardware technologies, traditional database systems increasingly exhibit stability challenges under large-scale and high-concurrency workloads. Baseline evaluations reveal severe performance degradation under intensive workloads, characterized by sharp throughput decline and noticeable jitter. Analysis of key operational metrics identifies the root cause of instability in the database I/O read-write model, where delayed dirty page flushing and insufficient candidate pages for backend threads reduce overall system stability. To address these issues, this study abstracts the database I/O mechanism into a producer-consumer model centered on buffer management and identifies inherent functional coupling problems. A novel functionally decoupled I/O model is proposed, featuring optimizations to the dirty page flushing mechanism and candidate page allocation strategy, thereby enhancing the supply of clean pages. Furthermore, the improved NSGA-II algorithm is integrated into the flushing framework for multi-objective white-box parameter tuning. Comprehensive evaluations are conducted using TPC-C and sysbench benchmarks across multiple dimensions, including data scale, testing duration, concurrency levels, and read-write patterns, supplemented by ablation studies. Experimental results demonstrate that the proposed framework achieves significant improvements over baseline approaches and existing optimization approaches in throughput, stability, and latency under high-pressure scenarios.

    Reference
    Related
    Cited by
Get Citation

胡谱赟,潘巍,马泽琪,韩宇翊,沈阳,李战怀.大容量高并发下数据库稳定性优化研究.软件学报,,():1-24

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:August 01,2025
  • Revised:October 27,2025
  • Adopted:
  • Online: April 29,2026
  • Published:
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063