In this work, we provide a solution for posturing the anthropomorphic Robonaut-2 hand and arm for grasping based on visual information. A mapping from visual features extracted from a convolutional neural network (CNN) to grasp points is learned. We demonstrate that a CNN pre-trained for image classification can be applied to a grasping task based on a small set of grasping examples. Our approa...

It has often been suggested that visual illusions affect perception but not actions such as grasping, as predicted by the "two-visual-systems" hypothesis of Milner and Goodale (1995, The Visual Brain in Action, Oxford University press). However, at least for the Ebbinghaus illusion, relevant studies seem to reveal a consistent illusion effect on grasping (Franz & Gegenfurtner, 2008. Grasping vi...

Subjects held an instrumented object in a tripod grasp and moved it in the horizontal plane in various directions. The contact forces at the digits were measured and the grip force was decomposed into 2 components: a manipulating force responsible for accelerating the object and a grasping force responsible for holding the object steady. The grasping forces increased during the movement, reachi...

In this work, we present an integrated approach for planning collision-free grasping motions. The proposed Grasp–RRT planner combines the three main tasks needed for grasping an object: building a feasible grasp, solving the inverse kinematics problem and searching a collision-free trajectory that brings the hand to the grasping pose. Therefore, RRT-based algorithms are used to build a tree of ...

Learning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by utilizing simulated robot experiments. Our neural network takes monocular RGB images and the instance segmentation mask of a specified target object as inpu...

While grasps must satisfy the grasping stability criteria, good grasps depend on the specific manipulation scenario: the object, its properties and functionalities, as well as the task and grasp constraints. In this paper, we consider such information for robot grasping by leveraging manifolds and symbolic object parts. Specifically, we introduce a new probabilistic logic module to first semant...

The grasping force of traditional under-actuated hands can hardly be kept during grasping. It is a crucial task to improve the grasping forces of robotic hands. Changeable grasping forces unit is one of the most effective solutions. This paper proposed a linkage changeable grasping force (CGF) unit integrated with linkage under-actuation mechanism in accordance with summary of proceeding work o...

Aiming at the inspection of rough stone and concrete wall surfaces, a grasping module of cross-arranged claw is designed. It can attach onto rough wall surfaces by hooking or grasping walls. First, based on the interaction mechanism of hooks and rough wall surfaces, the hook structures in claw tips are developed. Then, the size of the hook tip is calculated and the failure mode is analyzed. The...

Many researchers have turned to sensing, and in particular computer vision, to create more flexible robotic systems. Computer vision is often required to provide data for the grasping of a target. Using a vision system for grasping presents several issues with respect to sensing, control, and system configuration. This paper presents some of these issues in concert with the options available to...

Previous kinematic research suggests that visually guided grasping employs an accurate real-time control system in the dorsal stream, whereas delayed grasping relies on less accurate stored information derived by the perceptual system in the ventral stream. We explored these ideas in two experiments combining visually guided and delayed grasping with auditory tasks involving perception-based im...