Large digital displays are becoming a commonplace in urban centers, replacing the traditional static billboards.They are great for public advertisement and large data visualization. On the other hand, mobile devices have small screens, which are ideal for personal content. Connecting each other can lead to new interactions, allowing us to rethink the way I handle public, private and shared information.
In this research, I evaluated the performance of the Imperceptible Marker system in the context of interaction with large displays. From the results, I confirmed that two main factors affect the performance of marker detection: dynamicity of the content presented on the screen and camera movements. Thus, I developed a method to improve the robustness of the camera orientation, combining data from visual and inertial tracking.
I have developed a prototype and conducted experiments to evaluate the robustness of my work. In situations where the visual tracking fail to detect the markers, my method was able to provide a reasonable estimation of the camera orientation. As a result, the overall experience of observing a virtual object on a mobile device, when targeting a large display with imperceptible markers, was significantly improved.