Journal of Frontiers of Computer Science and Technology ›› 2018, Vol. 12 ›› Issue (3): 380-392.DOI: 10.3778/j.issn.1673-9418.1702024

Previous Articles     Next Articles

Evaluation Strategy of Efficiency in Design Pattern Detection Tools

XIAO Zhuoyu1, HUANG Hai2+, HE Pei3,4, LI Gang1, YANG Daowu1, PENG Yifan1, DONG Zemin1   

  1. 1. Swan College of Central South University of Forestry and Technology, Changsha 410200, China
    2. Department of Computer Science, Guangdong University of Education, Guangzhou 510303, China
    3. Key Laboratory of High Confidence Software Technologies of Ministry of Education, Peking University, Beijing 100871, China
    4. School of Computer Science & Education Software, Guangzhou University, Guangzhou 510006, China
  • Online:2018-03-01 Published:2018-03-08

设计模式检测工具有效性评估策略

肖卓宇1,黄  海2+,何  锫3,4,李  港1,杨道武1,彭逸凡1,董泽民1   

  1. 1. 中南林业科技大学 涉外学院,长沙 410200
    2. 广东第二师范学院 计算机科学系,广州 510303
    3. 北京大学 高可信软件技术教育部重点实验室,北京 100871
    4. 广州大学 计算机科学与教育软件学院,广州 510006

Abstract: To solve the unavailability of standard benchmarks and repeated development problem in design pattern detection tools, this paper discusses the limitations of various tools based on the analysis of existing design pattern tools, classifies the identification method, establishes the filtering rules, and proposes a method for effectiveness evaluation of design pattern detection tools. Focusing on standard benchmark, variant and instance sharing evaluation?index, the experiment results show the effectiveness of the proposed method, which is compared to nine well-known tools of design pattern detection and eight open source systems by indexes. Finally, this paper summarizes the effectiveness threat of the evaluation?work, gives the reasonable suggestions, and provides the perspective of evaluation of design pattern detection tools.

Key words: design pattern detection, evaluation index, benchmark, variants of design pattern, instance sharing

摘要: 为解决传统设计模式检测工具比较基准缺乏及相似工具重复开发的问题,在分析现有设计模式工具检测结果基础上,按识别方法进行了分类,制订了参与检测工具的筛选规则,探讨了各种工具的局限性,提出了一种设计模式检测工具有效性评估方法。以设计模式实例基准、变体、参与者角色实例共享为主要评估指标,通过对8种检测工具及9种开源系统指标的交叉比较,验证了所提方法的有效性,总结了评估工作的有效性威胁,给出了合理性建议,为设计模式检测工具评估提供了一种新思路。

关键词: 设计模式检测, 评估指标, 基准, 设计模式变体, 实例共享