Herbert west: deanonymizer

作者: William Aiello , Andrew Warfield , Mihir Nanavati , Nathan Taylor

DOI:

关键词:

摘要: The vast majority of scientific journal, conference, and grant selection processes withhold the names reviewers from original submitters, taking a better-safe-than-sorry approach for maintaining collegiality within small-world communities academia. While contents review may not color long-term relationship between submitter reviewer, it is best to require us all be saints. This paper raises question whether assumption reviewer anonymity still holds in face readily-available, high-quality machine learning toolkits. Our threat model focuses on how member community might, over time, amass large number unblinded reviews by serving conference committees. We show that with access even relatively small corpus such reviews, simple classification techniques existing toolkits successfully identify reasonably high accuracy. discuss implications findings describe some potential technical policy-based countermeasures.

参考文章(25)
Navot Akiva, Ido Dagan, Moshe Koppel, Feature instability as a criterion for selecting potential style markers: Special Topic Section on Computational Analysis of Style Journal of the Association for Information Science and Technology. ,vol. 57, pp. 1519- 1525 ,(2006) , 10.1002/ASI.V57:11
Guanfeng Liang, Nitin Vaidya, Multiparty equality function computation in networks with point-to-point links international conference on structural information and communication complexity. pp. 258- 269 ,(2011) , 10.1007/978-3-642-22212-2_23
Hinrich Schütze, Christopher D. Manning, Prabhakar Raghavan, Introduction to Information Retrieval ,(2005)
Rebecca M. Blank, The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review The American Economic Review. ,vol. 81, pp. 1041- 1067 ,(2016)
Mehran Sahami, Susan Dumais, Eric Horvitz, David Heckerman, A Bayesian Approach to Filtering Junk E-Mail national conference on artificial intelligence. ,(1998)
Stephen J. Ceci, Douglas Peters, How blind is blind review American Psychologist. ,vol. 39, pp. 1491- 1494 ,(1984) , 10.1037/0003-066X.39.12.1491
Moshe Koppel, Navot Akiva, Ido Dagan, Feature instability as a criterion for selecting potential style markers Journal of the Association for Information Science and Technology. ,vol. 57, pp. 1519- 1525 ,(2006) , 10.1002/ASI.20428