Improving Labeling Quality using Positive Label Frequency Threshold Algorithm

Label is a prominent issue in the classification area along with several potential negative sequences. For example, the predicted accuracy may reduce, but the complexity of inferred models and the number of necessary training samples may rise. Online outsourcing systems, such as Amazon’s Mechanical Turk, allow labelers to label the same objects but still lack in their quality. Mostly noisy labels have multiple labels for same examples. Thus, an agnostic algorithm Positive LAbel frequency Threshold (PLAT) is projected to handle the issue of imbalanced noisy labeling. The main objective is to generate the training dataset and integrated labels of examples. This method is used to solve the issue of minority sample and also able to deal with imbalanced multiple noisy labeling. The PLAT is applied to the imbalanced dataset collected from Amazon Mechanical Turk and the experiment results represents that the PLAT is efficient than other methods. Index Terms –repeated labeling, majority voting, imbalanced labeling