Deep neural networks (DNNs) have shown great success in completing complex tasks. However, DNNs inevitably bring high computational cost and storage consumption due to the complexity of hierarchical structures, thereby hindering their wide deployment Internet-of-Things (IoT) devices, which limited capability capacity. Therefore, it is a necessity investigate technologies compact DNNs. Despite t...