SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentation

نویسندگان

چکیده

Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on an unlabeled target domain by utilizing the supervised model trained a labeled source domain. One popular solution is self-training, which retrains with pseudo labels instances. Plenty of approaches tend alleviate noisy labels, however, they ignore intrinsic connection training data, i.e., intra-class compactness and inter-class dispersion between pixel representations across within domains. In consequence, struggle handle cross-domain variations fail build well-structured embedding space, leading less discrimination poor generalization. this work, we propose Se xmlns:xlink="http://www.w3.org/1999/xlink">mantic-Guided xmlns:xlink="http://www.w3.org/1999/xlink">Pi xmlns:xlink="http://www.w3.org/1999/xlink">xel xmlns:xlink="http://www.w3.org/1999/xlink">Co xmlns:xlink="http://www.w3.org/1999/xlink">ntrast (SePiCo) , novel one-stage adaptation framework that highlights concepts individual pixels promote learning class-discriminative class-balanced domains, eventually boosting performance self-training methods. Specifically, explore proper concepts, first investigate xmlns:xlink="http://www.w3.org/1999/xlink">centroid-aware contrast employs category centroids entire or single image guide discriminative features. Considering possible lack diversity in then blaze trail distributional perspective involve sufficient quantity instances, namely xmlns:xlink="http://www.w3.org/1999/xlink">distribution-aware approximate true distribution each from statistics data. Moreover, such optimization objective can derive closed-form upper bound implicitly involving infinite number (dis)similar pairs, making it computationally efficient. Extensive experiments show SePiCo not only helps stabilize but also yields representations, significant progress both synthetic-to-real daytime-to-nighttime scenarios. The code models are available at https://github.com/BIT-DA/SePiCo

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Per-Pixel Feedback for improving Semantic Segmentation

Semantic segmentation is the task of assigning a label to each pixel in the image.In recent years, deep convolutional neural networks have been driving advances in multiple tasks related to cognition. Although, DCNNs have resulted in unprecedented visual recognition performances, they offer little transparency. To understand how DCNN based models work at the task of semantic segmentation, we tr...

متن کامل

Object Boundary Guided Semantic Segmentation

Semantic segmentation has been a major topic in computer vision, and has played an important role in understanding object classes as well as object localizations. Recent development in deep learning, especially in fully-convolutional neural network, has enabled pixel-level labeling for more accurate results. However most of the previous works, including FCN, did not take object boundary into co...

متن کامل

Adaptive Affinity Field for Semantic Segmentation

Existing semantic segmentation methods mostly rely on per-pixel supervision, unable to capture structural regularity present in natural images. Instead of learning to enforce semantic labels on individual pixels, we propose to enforce affinity field patterns in individual pixel neighbourhoods, i.e., the semantic label patterns of whether neighbouring pixels are in the same segment should match ...

متن کامل

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation

The deficiency of segmentation labels is one of the main obstacles to semantic segmentation in the wild. To alleviate this issue, we present a novel framework that generates segmentation labels of images given their image-level class labels. In this weakly supervised setting, trained models have been known to segment local discriminative parts rather than the entire object area. Our solution is...

متن کامل

A CNN Cascade for Landmark Guided Semantic Part Segmentation

This paper proposes a CNN cascade for semantic part segmentation guided by pose-specific information encoded in terms of a set of landmarks (or keypoints). There is large amount of prior work on each of these tasks separately, yet, to the best of our knowledge, this is the first time in literature that the interplay between pose estimation and semantic part segmentation is investigated. To addr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence

سال: 2023

ISSN: ['1939-3539', '2160-9292', '0162-8828']

DOI: https://doi.org/10.1109/tpami.2023.3237740