关键词: 数字图书馆, 对象存储, 数据管理架构, 大数据

Abstract: This paper studies the problem of efficient object store and index in digital library and proposes a data repository system called PuntTable. PuntTable uses a schema-free way to store and get the objects and builds indices to support querying the fields inside the objects. In order to achieve a high throughput and low latency, PuntTable is designed by using multiple content storage engine and index storage engine through two interfaces, PuntStore and PuntIndex. PuntStore and PuntIndex are designed as the storage layer of PuntTable. Both the objects content and their indices can choose the most suitable storage layer for a specific data set. PuntTable is tested and evaluated for the performance of processing object data and index store combination by using varies of data sets with different single record sizes. These data sets are picked from digital library to simulate the real application scenarios. The result reveals that the proper configuration of storage layer for a particular data set can significantly improve the throughput and drop the latency.

Key words: digital library, object store, digital infrastructure, big data