Towards a framework to support large scale sampling in software engineering surveys
作者： Rafael Maiani de Mello , Pedro Correa da Silva , Per Runeson , Guilherme Horta Travassos
关键词: Conceptual framework 、 Software engineering 、 Sampling frame 、 Sampling (statistics) 、 Experimental software engineering 、 Computer science 、 The Conceptual Framework 、 Systematic sampling 、 Population 、 Data science 、 Crowdsourcing
摘要: Context: The low quality and small size of samples in empirical studies software engineering hamper the interpretation generalization their results. Therefore, enlarging sample sizes improving represent an important research challenge. Goal: We aim to define a conceptual framework, including requirements for establishing adequate sources sampling subjects surveys. Method: use previous experience on applying systematic strategies combined with contemporary web technologies previously executed surveys, organize framework. analyze its application different sampling. Results: framework was observed be feasible after nine large-scale Conclusions: analyzed crowdsourcing tools do not support essential considered sampling, while free-lancing professional social network do.
acm.org
sci-hub.se 参考文章(12)
R. Conradi, J. Li, O.P.N. Slyngstad, V.B. Kampenes, C. Bunse, M. Morisio, M. Torchiano, Reflections on conducting an international survey of software engineering international symposium on empirical software engineering. pp. 214- 223 ,(2005) , 10.1109/ISESE.2005.1541830
Rafael Maiani de Mello, Pedro Corrêa da Silva, Guilherme Horta Travassos, Investigating probabilistic sampling approaches for large-scale surveys in software engineering Journal of Software Engineering Research and Development. ,vol. 3, pp. 8- ,(2015) , 10.1186/S40411-015-0023-0
William B. Frakes, Christopher J. Fox, Sixteen questions about software reuse Communications of the ACM. ,vol. 38, pp. 75- 87 ,(1995) , 10.1145/203241.203260
Lesley M. Pickard, Barbara A. Kitchenham, Peter W. Jones, Combining empirical results in software engineering Information & Software Technology. ,vol. 40, pp. 811- 821 ,(1998) , 10.1016/S0950-5849(98)00101-3
Rafael M de Mello, Guilherme H Travassos, None, Would Sociable Software Engineers Observe Better empirical software engineering and measurement. pp. 279- 282 ,(2013) , 10.1109/ESEM.2013.33
Kathryn T. Stolee, Sebastian Elbaum, Exploring the use of crowdsourcing to support empirical studies in software engineering Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '10. pp. 35- ,(2010) , 10.1145/1852786.1852832
Bengt Swensson, Jan Hȧkan Wretman, Carl-Erik Särndal, Model assisted survey sampling ,(1997)
Kathryn T. Stolee, Sebastian Elbaum, On the Use of Input/Output Queries for Code Search empirical software engineering and measurement. pp. 251- 254 ,(2013) , 10.1109/ESEM.2013.35
D.I.K. Sjoeberg, J.E. Hannay, O. Hansen, V.B. Kampenes, A. Karahasanovic, N.-K. Liborg, A.C. Rekdal, A survey of controlled experiments in software engineering IEEE Transactions on Software Engineering. ,vol. 31, pp. 733- 753 ,(2005) , 10.1109/TSE.2005.97
Rafael M de Mello, Guilherme H Travassos, None, An ecological perspective towards the evolution of quantitative studies in software engineering Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering - EASE '13. pp. 216- 219 ,(2013) , 10.1145/2460999.2461031