Relation extraction (RE) is a fundamental NLP task that aims to identify relations between some entities regarding given text. RE forms the basis for many advanced tasks, such as question answering and text summarization, thus its quality critical relevant downstream applications. However, evaluating of models non-trivial. On one hand, obtaining ground truth labels individual test inputs tediou...