In the world of augmented reality (AR) 2016 was dominated by Pokemon GO whilst this year its been far more focused on development, namely Apple’s ARKit and most recently Google’s ARCore. VRFocus has covered several interesting projects utilising both programmes and now here’s another. In what could be a first, videogame producer Rick Mendez has revealed a new project created using ARCore that uses Fingo hand tracking technology to paint with.
Simply called PaintAR, the only details Mendez has released so far all stem from a short tweeted video. In it he showcases how the app allows a user to paint by pinching their index finger and thumb together, with brush stokes easily viewable from any angle as he walks around it.
— Rick Mendez (@RickEM) September 6, 2017
That’s achieved with the right hand, while pinching with the left opens up a menu with various brushes to choose from, a colour wheel, and a brush size adjuster.
As ARCore has only just been made available to developers PaintAR is still in its early stages but what makes it unique is the implementation of Fingo. Created by uSens, Fingo is a 3D-stereo vision, hand-tracking device with 26DOF to track 22 finger joints. While the Fingo is a device that usually attaches to a head-mounted display (HMD) Mendez hasn’t shown how its been used with a mobile device.
uSens also happens to be working on SLAM-based 6DOF tracking for mobile virtual reality (VR) and AR which could also see use with ARCore in the future.
This week also saw ManoMotion release its software development kit (SDK) for ARKit, essentially allowing similar hand tracking inputs, with predefined gestures, such as point, push, pinch, swipe and grab.
Whilst still in the early stages it seems as though future AR content for consumers won’t just be a case of tapping on a screen, with them being able to bring their hands into these augmented worlds. As development continues VRFocus will keep you updated.