We present a method that gets as input an audio of violin or piano playing, and outputs a video of skeleton predictions which are further used to animate an avatar. The key idea is to create an animation of an avatar that moves their hands similarly to how a pianist or violinist would do, just from audio. Aiming for a fully detailed correct arms and fingers motion is a goal, however, it’s not c...

The difficulty of describing the positions of the body-fixed axis of a rotating body is approached through the use of Euler angles: spin ψ̇, nutation θ and precession φ shown below in Figure 1. In this case we surmount the difficulty of keeping track of the principal axes fixed to the body by making their orientation the unknowns in our equations of motion; then the angular velocities and angula...

Practical problems like regulating robot grippers critically rely on accurately predicted friction forces. Qualified methods are derived and discussed subsequently. Special attention is paid to the question of solution existence. A time-stepping scheme which supports Coulomb friction and inelastic impacts is implemented and the numerical results are analyzed. The approach proofs to be stable, a...

It has been shown that sensory morphology and sensory–motor coordination enhance the capabilities of sensing in robotic systems. The tasks of categorization and category learning, for example, can be significantly simplified by exploiting the morphological constraints, sensory–motor couplings and the interaction with the environment. This paper argues that, in the context of sensory–motor contr...