关键词: 云计算, MapReduce, 字符串波形, 实体识别

Abstract: Large quantities of records need to be read and analyzed in cloud computing, many records referring to the same entity bring challenges for data processing and analysis. Clustering based on records similarity is one of the most commonly used methods in entity resolution. But existing methods of computing records similarity often cost much time and are not suitable for cloud computing. This paper discusses that it’s necessary to use wave of strings, which can achieve a high performance by using features of cloud computing, to compute records similarity, and provides a method based on wave of strings of entity resolution. The method calculates frequencies of characters, generates waves based on frequencies of characters, and computes records similarity quickly by filtering method based on waves to get clusters based on records similarity. Theoretical analysis and experimental results from real data show that the method is correct and effective.

Key words: cloud computing, MapReduce, wave of strings, entity resolution