Context: Tertiary studies in software engineering (TS@SE) are widely used to synthesise evidence on a research topic systematically. As part of their protocol, TS@SE define inclusion and exclusion criteria (IC/EC) aimed at selecting those secondary studies (SS) to be included in the analysis. Aims: To provide a state of the art on the definition and application of IC/EC in TS@SE, and from the results of this analysis, we outline an emerging framework, TSICEC, to be used by SE researchers. Method: To provide the state of the art, we conducted a systematic mapping (SM) combining automatic search and snowballing over the body of SE scientific literature, which led to 50 papers after application of our own IC/EC. The extracted data was synthesised using content analysis. The results were used to define a first version of TSICEC. Results: The SM resulted in a coding schema, and a thorough analysis of the selected papers on the basis of this coding. Our TSICEC framework includes guidelines for the definition of IC/EC in TS@SE. Conclusion: This paper is a step forward establishing a foundation for researchers in two ways. As authors, understanding the different possibilities to define IC/EC and apply them to select SS. As readers, having an instrument to understand the methodological rigor upon which TS@SE may claim their findings.
翻译:背景:软件工程方面的高等教育(TS@SE)被广泛用于系统地综合研究题目的证据。作为其议定书的一部分,TS@SE界定了包容和排斥标准(IC/EC),目的是选择将纳入分析的次级研究(SS)。目的:为了提供在TS@SE中定义和应用IC/EC的最新数据,并根据这一分析的结果,我们概述了一个新兴框架(TSICEC),供SE研究人员使用。方法:为了提供最新数据,我们开展了一个系统绘图(SM),将SE科学文献的自动搜索和雪球结合在一起,从而在应用了我们自己的IC/EC之后,得出了50份文件。所提取的数据是利用内容分析综合的。结果被用来界定TSICEC的第一个版本。结果:SISC产生了一个共同的系统,并根据这一编码对选定的文件进行了透彻的分析。我们的TSICEC框架包括了在TSE@SE中定义IC/EC的指南。结论:这份文件是将SE研究者们的两种可能的方式理解为SEE 一种方法。