Association for Computing Machinery (ACM)

Reciprocal rank fusion outperforms condorcet and individual rank learning methods

Gordon V. Cormack ¹

Charles L A Clarke ¹

Stefan Buettcher ²

Hide authors affiliations Show authors affiliations: 2 affiliations

University of Waterloo, Waterloo, ON, Canada |

Google, Mountain View, CA, USA |

Publication type: Proceedings Article

Publication date: 2009-07-19

Association for Computing Machinery (ACM)

DOI: 10.1145/1571941.1572114

Copy DOI

Abstract

Reciprocal Rank Fusion (RRF), a simple method for combining the document rankings from multiple IR systems, consistently yields better results than any individual system, and better results than the standard method Condorcet Fuse. This result is demonstrated by using RRF to combine the results of several TREC experiments, and to build a meta-learner that ranks the LETOR 3 dataset better than any previously reported method

Found

Top-30

Journals

Publishers

	10 20 30 40 50 60 70 80 90 100
Association for Computing Machinery (ACM)	Association for Computing Machinery (ACM), 91, 29.35% Association for Computing Machinery (ACM) 91 publications, 29.35%
Springer Nature	Springer Nature, 81, 26.13% Springer Nature 81 publications, 26.13%
Institute of Electrical and Electronics Engineers (IEEE)	Institute of Electrical and Electronics Engineers (IEEE), 63, 20.32% Institute of Electrical and Electronics Engineers (IEEE) 63 publications, 20.32%
Elsevier	Elsevier, 14, 4.52% Elsevier 14 publications, 4.52%
MDPI	MDPI, 9, 2.9% MDPI 9 publications, 2.9%
JMIR Publications	JMIR Publications, 8, 2.58% JMIR Publications 8 publications, 2.58%
Wiley	Wiley, 7, 2.26% Wiley 7 publications, 2.26%
Cold Spring Harbor Laboratory	Cold Spring Harbor Laboratory, 5, 1.61% Cold Spring Harbor Laboratory 5 publications, 1.61%
IGI Global	IGI Global, 3, 0.97% IGI Global 3 publications, 0.97%
American Chemical Society (ACS)	American Chemical Society (ACS), 2, 0.65% American Chemical Society (ACS) 2 publications, 0.65%
SAGE	SAGE, 2, 0.65% SAGE 2 publications, 0.65%
Institute of Electronics, Information and Communications Engineers (IEICE)	Institute of Electronics, Information and Communications Engineers (IEICE), 2, 0.65% Institute of Electronics, Information and Communications Engineers (IEICE) 2 publications, 0.65%
Information Processing Society of Japan	Information Processing Society of Japan, 2, 0.65% Information Processing Society of Japan 2 publications, 0.65%
Emerald	Emerald, 2, 0.65% Emerald 2 publications, 0.65%
IOS Press	IOS Press, 1, 0.32% IOS Press 1 publication, 0.32%
MIT Press	MIT Press, 1, 0.32% MIT Press 1 publication, 0.32%
Public Library of Science (PLoS)	Public Library of Science (PLoS), 1, 0.32% Public Library of Science (PLoS) 1 publication, 0.32%
Cambridge University Press	Cambridge University Press, 1, 0.32% Cambridge University Press 1 publication, 0.32%
Institution of Engineering and Technology (IET)	Institution of Engineering and Technology (IET), 1, 0.32% Institution of Engineering and Technology (IET) 1 publication, 0.32%
Walter de Gruyter	Walter de Gruyter, 1, 0.32% Walter de Gruyter 1 publication, 0.32%
Novosibirsk State University (NSU)	Novosibirsk State University (NSU), 1, 0.32% Novosibirsk State University (NSU) 1 publication, 0.32%
	10 20 30 40 50 60 70 80 90 100

We do not take into account publications without a DOI.
Statistics recalculated weekly.

Are you a researcher?

Create a profile to get free access to personal recommendations for colleagues and new articles.

Metrics

315

Publisher

Association for Computing Machinery (ACM)

	5 10 15 20 25 30 35 40 45
Lecture Notes in Computer Science	Lecture Notes in Computer Science, 45, 14.52% Lecture Notes in Computer Science 45 publications, 14.52%
ACM Transactions on Information Systems	ACM Transactions on Information Systems, 4, 1.29% ACM Transactions on Information Systems 4 publications, 1.29%
Knowledge and Information Systems	Knowledge and Information Systems, 4, 1.29% Knowledge and Information Systems 4 publications, 1.29%
Journal of the Association for Information Science and Technology	Journal of the Association for Information Science and Technology, 4, 1.29% Journal of the Association for Information Science and Technology 4 publications, 1.29%
Communications in Computer and Information Science	Communications in Computer and Information Science, 4, 1.29% Communications in Computer and Information Science 4 publications, 1.29%
Multimedia Tools and Applications	Multimedia Tools and Applications, 3, 0.97% Multimedia Tools and Applications 3 publications, 0.97%
IEEE Transactions on Software Engineering	IEEE Transactions on Software Engineering, 3, 0.97% IEEE Transactions on Software Engineering 3 publications, 0.97%
IEEE Transactions on Knowledge and Data Engineering	IEEE Transactions on Knowledge and Data Engineering, 3, 0.97% IEEE Transactions on Knowledge and Data Engineering 3 publications, 0.97%
ACM Transactions on Intelligent Systems and Technology	ACM Transactions on Intelligent Systems and Technology, 2, 0.65% ACM Transactions on Intelligent Systems and Technology 2 publications, 0.65%
Journal of Medical Internet Research	Journal of Medical Internet Research, 2, 0.65% Journal of Medical Internet Research 2 publications, 0.65%
Journal of Intelligent Information Systems	Journal of Intelligent Information Systems, 2, 0.65% Journal of Intelligent Information Systems 2 publications, 0.65%
Information Retrieval	Information Retrieval, 2, 0.65% Information Retrieval 2 publications, 0.65%
Journal of Biomedical Informatics	Journal of Biomedical Informatics, 2, 0.65% Journal of Biomedical Informatics 2 publications, 0.65%
IEICE Transactions on Information and Systems	IEICE Transactions on Information and Systems, 2, 0.65% IEICE Transactions on Information and Systems 2 publications, 0.65%
IEEE Access	IEEE Access, 2, 0.65% IEEE Access 2 publications, 0.65%
Journal of Information Processing	Journal of Information Processing, 2, 0.65% Journal of Information Processing 2 publications, 0.65%
Lecture Notes in Networks and Systems	Lecture Notes in Networks and Systems, 2, 0.65% Lecture Notes in Networks and Systems 2 publications, 0.65%
Electronics (Switzerland)	Electronics (Switzerland), 2, 0.65% Electronics (Switzerland) 2 publications, 0.65%
Discover Computing	Discover Computing, 2, 0.65% Discover Computing 2 publications, 0.65%
Journal of Supercomputing	Journal of Supercomputing, 2, 0.65% Journal of Supercomputing 2 publications, 0.65%
ACM Transactions on the Web	ACM Transactions on the Web, 1, 0.32% ACM Transactions on the Web 1 publication, 0.32%
International Journal of Web Services Research	International Journal of Web Services Research, 1, 0.32% International Journal of Web Services Research 1 publication, 0.32%
Web Intelligence	Web Intelligence, 1, 0.32% Web Intelligence 1 publication, 0.32%
Transactions of the Association for Computational Linguistics	Transactions of the Association for Computational Linguistics, 1, 0.32% Transactions of the Association for Computational Linguistics 1 publication, 0.32%
IEEE Transactions on Image Processing	IEEE Transactions on Image Processing, 1, 0.32% IEEE Transactions on Image Processing 1 publication, 0.32%
Entropy	Entropy, 1, 0.32% Entropy 1 publication, 0.32%
International Journal on Digital Libraries	International Journal on Digital Libraries, 1, 0.32% International Journal on Digital Libraries 1 publication, 0.32%
Scientometrics	Scientometrics, 1, 0.32% Scientometrics 1 publication, 0.32%
Artificial Intelligence Review	Artificial Intelligence Review, 1, 0.32% Artificial Intelligence Review 1 publication, 0.32%
	5 10 15 20 25 30 35 40 45