December 2016

SmoothMoves

SmoothMoves is an interaction technique for Augmented Reality (AR), based on smooth pursuits head movements. Using AR, circular moving targets (or 'buttons') are overlaid on an interactable object. By ever so slightly moving your head along with these targets, you can select the buttons. The prototype was built to demonstrate potential use cases of the technique in real-world settings.

Technology

An Inertial Measurement Unit (IMU) attached to a spectacle frame continuously tracks head movements, whilst an Android application overlays moving targets on an AR marker. A laptop receives movement data of the targets and the user, and calculates a correlation between the two. If they match, the laptop will send instructions to interactable object. This prototype (as shown on the last two pictures) was later ported to a Microsoft Holo Lens, which removed the need for AR markers and the laptop.

Contribution

Using the code base of an existing research prototype, I created the Android AR app and further developed it into an interactive demo with a set of Phillips Hue lights. This included the design of the UI and video-graphing the overall interaction with the system. I further developed this technique into a smartwatch alternative, see WaveTrace.