Ranking 50 items individually can be lengthy and tedious, but it’s much easier for a community. Instead of each user submitting a complete list, we break down the rankings into smaller parts and recombine them after gathering enough votes. We’re using a modified ELO algorithm for this task.
In ELO, each item starts with a score that changes with every paired matchup. The point change depends on the score of the other item; defeating a top-ranked item yields a higher reward than defeating a lower-ranked one, and the same principle applies to penalties for losing. Originally designed for chess with more defined victory conditions than “user preference,” the ELO system has been adjusted to reduce the impact of significant upsets.
Thus, whenever you choose between two items on our Apple Top 50 list, you contribute to the overall community rankings. Thanks!
CREDITS
– Design: Kristen Radtke
– Engineer: Graham MacAree
– Editors: Nilay Patel, David Pierce, Meredith Haggerty
– Concept: Victoria Barrios, Travis Larchuk
– Copy edit: Kallie Plagge