NUMA架构下数据热度的内存数据库日志恢复技术

doi:10.3778/j.issn.1673-9418.1807054

计算机科学与探索 ›› 2019, Vol. 13 ›› Issue (6): 941-949.DOI: 10.3778/j.issn.1673-9418.1807054

NUMA架构下数据热度的内存数据库日志恢复技术

吴刚1,2，阿卜杜热西提·热合曼1+，李梁1，乔百友1，韩东红1

1.东北大学计算机科学与工程学院，沈阳 110819

2.南京大学计算机软件新技术国家重点实验室，南京 210093

出版日期:2019-06-01 发布日期:2019-06-14

Main-Memory Database Log Recovery Techniques with Data Popularity in NUMA Architecture

WU Gang1,2, Abudurexiti REHEMAN1+, LI Liang1, QIAO Baiyou1, HAN Donghong1

1. School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
2. State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210093, China

Online:2019-06-01 Published:2019-06-14

摘要/Abstract

摘要： 在内存数据库故障恢复技术中，命令日志是针对内存数据库设计的粗粒度的、轻量级的日志记录方式。但在非统一内存访问（non-uniform memory access，NUMA）体系架构下面向数据的数据库设计中利用命令日志进行故障恢复时，由于数据访问频率不均衡，导致负责高频数据恢复的CPU线程负载加重，而其他CPU相对空闲。针对这种工作负载不均衡所导致的恢复时间开销增大的情况，提出了NUMA体系架构下基于热度记录的内存数据库日志恢复算法。该算法中，每一条数据的访问次数作为该数据的热度记录下来。在并行恢复时，根据数据热度，将数据比较均衡地划分到各个节点的CPU线程执行恢复操作，以此来提高数据库的恢复速度。实验结果表明，该方案比NUMA架构下的常规恢复方案快，而且数据的热度越高，恢复速度的提升越明显，最高提升了19%。

关键词: 内存数据库, 日志, 检查点, 故障恢复, 非统一内存访问（NUMA）架构

Abstract: In the main-memory database failure recovery technology, the command logging is a coarse-grained, lightweight logging method designed for main-memory databases. However, when it is used for failure recovery in data-oriented database design under the non-uniform memory access (NUMA) architecture, the CPU thread load responsible for high-frequency data recovery is increased and the other CPUs are relatively idle due to uneven data access frequency. In view of the increasing recovery time overhead caused by this unbalanced workload, this paper proposes a main-memory database log recovery algorithm based on the data popularity in NUMA architecture. In this algorithm, the number of accesses to each data is recorded as the popularity of the data. In parallel recovery, according to the data popularity, the data are more evenly distributed to the CPU thread on each node to perform the recovery operation, so as to improve the database recovery speed. The experimental results show that this solution is faster than the conventional recovery scheme of NUMA architecture. Moreover, the higher the data popularity, the more obvious the improvement in recovery speed, and the highest increase is 19%.

Key words: main-memory database, logging, checkpoint, failure recovery, non-uniform memory access (NUMA) architecture

吴刚，阿卜杜热西提·热合曼，李梁，乔百友，韩东红. NUMA架构下数据热度的内存数据库日志恢复技术[J]. 计算机科学与探索, 2019, 13(6): 941-949.

WU Gang, Abudurexiti REHEMAN, LI Liang, QIAO Baiyou, HAN Donghong. Main-Memory Database Log Recovery Techniques with Data Popularity in NUMA Architecture[J]. Journal of Frontiers of Computer Science and Technology, 2019, 13(6): 941-949.

[1]	黄慧，李海林. 带有可信度标记的增量式数据修复方法研究[J]. 计算机科学与探索, 2021, 15(10): 1900-1911.
[2]	王晓东，赵一宁，肖海力，王小宁，迟学斌. 线上多节点日志流量异常检测系统的研究[J]. 计算机科学与探索, 2020, 14(11): 1828-1837.
[3]	赵一宁，肖海力. 国家高性能计算环境事件流系统的设计[J]. 计算机科学与探索, 2019, 13(3): 374-382.
[4]	张胜，赵珏，陈荣元. 网络安全日志可视化分析研究进展[J]. 计算机科学与探索, 2018, 12(5): 681-696.
[5]	刘勇，谢胜男，张巍，朱敬华，王楠. 社会网中时间最优的利润最大化算法研究[J]. 计算机科学与探索, 2017, 11(11): 1723-1732.
[6]	孙国瑞，华锦芝，刘思帆，杨阳，钟亦平，张凌毅. 实时风险评估模型的研究与实现[J]. 计算机科学与探索, 2015, 9(4): 462-474.
[7]	杨鑫晟，李弘，王伟，黄翔，魏峻. 在线服务系统自动化故障诊断与错误管理方法[J]. 计算机科学与探索, 2014, 8(8): 945-955.
[8]	杨艳，邱艳丽. 新的基于日志分析的用户个性化模型[J]. 计算机科学与探索, 2012, 6(4): 333-342.
[9]	宋玲1+ , 杨雪君2 , 马兰1 . 嵌入式内存数据库的存储和索引算法研究*[J]. 计算机科学与探索, 2010, 4(8): 742-748.
[10]	黄春+,刘勇鹏,杨学军. 面向OpenMP的混合检查点机制[J]. 计算机科学与探索, 2007, 1(2): 191-199.

NUMA架构下数据热度的内存数据库日志恢复技术

Main-Memory Database Log Recovery Techniques with Data Popularity in NUMA Architecture

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 10

编辑推荐

Metrics