The questions in a crowdsourcing task typically exhibit varying degrees of di culty and subjectivity. Their joint e ects give rise to the variation in responses to the same question by di erent crowdworkers. This variation is low when the question is easy to answer and objective, and high when it is di cult and subjective. Unfortunately, current quality control methods for crowdsourcing conside...
