Imperceptible On-Screen Markers for Arbitrary Background Images

In this demo, we present a system that can realize a spatial interaction between a handheld device and external displays via imperceptible on-screen markers. Our system can compute a full pose of the camera installed on the handheld device by extracting a marker from the external display, while a user does not notice where the marker is. This technology enables users to see Augmented Reality (AR) objects on top of the external display through their handheld devices. Additionally, we can implement a remote interface to access to the content on the external displays by touching the handheld device screen. Our method consists of two parts: marker embedding on external displays and marker detection. Compared to previous research, our system allows that the external display content can change and don’t need to be known in advance. Our method is working well with small movements, while large movements can lead to loss of tracking. We consider our work to be the first step towards large scale deployment of handheld AR content for a large number of users with unmodified devices.