Abstract The ability of molecular property prediction is great significance to drug discovery, human health, and environmental protection. Despite considerable efforts, quantitative various properties remains a challenge. Although some machine learning models, such as bidirectional encoder from transformer, can incorporate massive unlabeled data into representations via self-supervised strategy...