关键词: 混合架构, 查询优化, 划分建议器

Abstract: Data partition is the important factor with influencing query performance in hybrid architecture of integrating MapReduce and database. For Join and Group operations with larger query cost, they are implemented in need of expensive cost of network transmission and I/O in hybrid MapReduce system because of large-scale data transmission across the nodes. In order to reduce data transmission and improve operation efficiency of Join query, this paper puts forward partition recommender. Firstly, it proposes and realizes the partition recommender for hybrid architecture, which calculates the query cost to generate the optimal partition solution and improve the efficiency of the system. Secondly, it proposes a priority-based generation strategy and a space-pruning search algorithm to decrease calculating time of the optimal partition solution. Finally, the experiments verify effectively the partition recommender, which makes query cost minimum and improves query performance of hybrid MapReduce architecture.

Key words: hybrid architecture, query optimization, partition recommender