SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentation
نویسندگان
چکیده
Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on an unlabeled target domain by utilizing the supervised model trained a labeled source domain. One popular solution is self-training, which retrains with pseudo labels instances. Plenty of approaches tend alleviate noisy labels, however, they ignore intrinsic connection training data, i.e., intra-class compactness and inter-class dispersion between pixel representations across within domains. In consequence, struggle handle cross-domain variations fail build well-structured embedding space, leading less discrimination poor generalization. this work, we propose Se xmlns:xlink="http://www.w3.org/1999/xlink">mantic-Guided xmlns:xlink="http://www.w3.org/1999/xlink">Pi xmlns:xlink="http://www.w3.org/1999/xlink">xel xmlns:xlink="http://www.w3.org/1999/xlink">Co xmlns:xlink="http://www.w3.org/1999/xlink">ntrast (SePiCo) , novel one-stage adaptation framework that highlights concepts individual pixels promote learning class-discriminative class-balanced domains, eventually boosting performance self-training methods. Specifically, explore proper concepts, first investigate xmlns:xlink="http://www.w3.org/1999/xlink">centroid-aware contrast employs category centroids entire or single image guide discriminative features. Considering possible lack diversity in then blaze trail distributional perspective involve sufficient quantity instances, namely xmlns:xlink="http://www.w3.org/1999/xlink">distribution-aware approximate true distribution each from statistics data. Moreover, such optimization objective can derive closed-form upper bound implicitly involving infinite number (dis)similar pairs, making it computationally efficient. Extensive experiments show SePiCo not only helps stabilize but also yields representations, significant progress both synthetic-to-real daytime-to-nighttime scenarios. The code models are available at https://github.com/BIT-DA/SePiCo
منابع مشابه
Per-Pixel Feedback for improving Semantic Segmentation
Semantic segmentation is the task of assigning a label to each pixel in the image.In recent years, deep convolutional neural networks have been driving advances in multiple tasks related to cognition. Although, DCNNs have resulted in unprecedented visual recognition performances, they offer little transparency. To understand how DCNN based models work at the task of semantic segmentation, we tr...
متن کاملObject Boundary Guided Semantic Segmentation
Semantic segmentation has been a major topic in computer vision, and has played an important role in understanding object classes as well as object localizations. Recent development in deep learning, especially in fully-convolutional neural network, has enabled pixel-level labeling for more accurate results. However most of the previous works, including FCN, did not take object boundary into co...
متن کاملAdaptive Affinity Field for Semantic Segmentation
Existing semantic segmentation methods mostly rely on per-pixel supervision, unable to capture structural regularity present in natural images. Instead of learning to enforce semantic labels on individual pixels, we propose to enforce affinity field patterns in individual pixel neighbourhoods, i.e., the semantic label patterns of whether neighbouring pixels are in the same segment should match ...
متن کاملLearning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation
The deficiency of segmentation labels is one of the main obstacles to semantic segmentation in the wild. To alleviate this issue, we present a novel framework that generates segmentation labels of images given their image-level class labels. In this weakly supervised setting, trained models have been known to segment local discriminative parts rather than the entire object area. Our solution is...
متن کاملA CNN Cascade for Landmark Guided Semantic Part Segmentation
This paper proposes a CNN cascade for semantic part segmentation guided by pose-specific information encoded in terms of a set of landmarks (or keypoints). There is large amount of prior work on each of these tasks separately, yet, to the best of our knowledge, this is the first time in literature that the interplay between pose estimation and semantic part segmentation is investigated. To addr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2023
ISSN: ['1939-3539', '2160-9292', '0162-8828']
DOI: https://doi.org/10.1109/tpami.2023.3237740