SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation

نویسندگان

چکیده

Detecting objects and estimating their 6D poses is essential for automated systems to interact safely with the environment. Most pose estimators, however, rely on a single camera frame suffer from occlusions ambiguities due object symmetries. We overcome this issue by presenting novel symmetry-aware multi-view estimator called SyMFM6D. Our approach efficiently fuses RGB-D frames multiple perspectives in deep multi-directional fusion network predicts predefined keypoints all scene simultaneously. Based an instance semantic segmentation, we compute least-squares fitting. To address ambiguity issues symmetric objects, propose training procedure keypoint detection including new objective function. SyMFM6D significantly outperforms state-of-the-art both single-view estimation. furthermore show effectiveness of our demonstrate that robust towards inaccurate calibration dynamic setups.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-view Object Categorization and Pose Estimation

Object and scene categorization has been a central topic of computer vision research in recent years. The problem is a highly challenging one. A single object may show tremendous variability in appearance and structure under various photometric and geometric conditions. In addition, members of the same class may differ from each other due to various degrees of intra-class variability. Recently,...

متن کامل

Neural Network-Based Head Pose Estimation and Multi-view Fusion

In this paper, we present two systems that were used for head pose estimation during the CLEAR06 Evaluation. We participated in two tasks: (1) estimating both pan and tilt orientation on synthetic, high resolution head captures, (2) estimating horizontal head orientation only on real seminar recordings that were captured with multiple cameras from different viewing angles. In both systems, we u...

متن کامل

Recovering 6D Object Pose: Multi-modal Analyses on Challenges

A large number of studies analyse object detection and pose estimation at visual level in 2D, discussing the effects of challenges such as occlusion, clutter, texture, etc., on the performances of the methods, which work in the context of RGB modality. Interpreting the depth data, the study in this paper presents thorough multi-modal analyses. It discusses the above-mentioned challenges for ful...

متن کامل

A Unified Framework for Multi-View Multi-Class Object Pose Estimation

One core challenge in object pose estimation is to ensure accurate and robust performance for large numbers of diverse foreground objects amidst complex background clutter. In this work, we present a scalable framework for accurately inferring six Degree-of-Freedom (6-DoF) pose for a large number of object classes from single or multiple views. To learn discriminative pose features, we integrat...

متن کامل

On Evaluation of 6D Object Pose Estimation

A pose of a rigid object has 6 degrees of freedom and its full knowledge is required in many robotic and scene understanding applications. Evaluation of 6D object pose estimates is not straightforward. Object pose may be ambiguous due to object symmetries and occlusions, i.e. there can be multiple object poses that are indistinguishable in the given image and should be therefore treated as equi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE robotics and automation letters

سال: 2023

ISSN: ['2377-3766']

DOI: https://doi.org/10.1109/lra.2023.3293317