Instance-Specific Feature Propagation for Referring Segmentation

نویسندگان

چکیده

Referring segmentation aims to generate a mask for the target instance indicated by natural language expression. There are typically two kinds of existing methods: one-stage methods that directly perform on fused vision and features; two-stage first utilize an model proposal then select one these instances via matching them with features. In this work, we propose novel framework simultaneously detects target-of-interest feature propagation generates fine-grained mask. our framework, each is represented Instance-Specific Feature (ISF), target-of-referring identified exchanging information among all ISFs using proposed Propagation Module (FPM). Our instance-aware approach learns relationship objects, which helps better locate than methods. Comparing methods, collaboratively interactively utilizes both synchronous identification segmentation. experimental tests, method outperforms previous start-of-the-art three RefCOCO series datasets.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Shape-aware Instance Segmentation

We address the problem of instance-level semantic segmentation, which aims at jointly detecting, segmenting and classifying every individual object in an image. In this context, existing methods typically propose candidate objects, usually as bounding boxes, and directly predict a binary mask within each such proposal. As a consequence, they cannot recover from errors in the object candidate ge...

متن کامل

Recurrent Instance Segmentation

Instance segmentation is the problem of detecting and delineating each distinct object of interest appearing in an image. Current instance segmentation approaches consist of ensembles of modules that are trained independently of each other, thus missing opportunities for joint learning. Here we propose a new instance segmentation paradigm consisting in an end-to-end method that learns how to se...

متن کامل

Amodal Instance Segmentation

We consider the problem of amodal instance segmentation, the objective of which is to predict the region encompassing both visible and occluded parts of each object. Thus far, the lack of publicly available amodal segmentation annotations has stymied the development of amodal segmentation methods. In this paper, we sidestep this issue by relying solely on standard modal instance segmentation an...

متن کامل

Sparse Motion Segmentation using Propagation of Feature Labels

The paper considers the problem of extracting background and foreground motions from image sequences based on the estimated displacements of a small set of image blocks. As a novelty, the uncertainty of local motion estimates is analyzed and exploited in the fitting of parametric object motion models which is done within a competitive framework. Prediction of patch labels is based on the tempor...

متن کامل

Path Aggregation Network for Instance Segmentation

The way that information propagates in neural networks is of great importance. In this paper, we propose Path Aggregation Network (PANet) aiming at boosting information flow in proposal-based instance segmentation framework. Specifically, we enhance the entire feature hierarchy with accurate localization signals in lower layers by bottom-up path augmentation, which shortens the information path...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Multimedia

سال: 2022

ISSN: ['1520-9210', '1941-0077']

DOI: https://doi.org/10.1109/tmm.2022.3163578