3D Hand Interaction in Mobile AR

Introduction of AR frameworks on mobile platforms has introduced new ways of exploring the real world with augmented data and digital content. AR frameworks provide the possibility for spatial placement of the digital content. Today, the input for placement of digital content in AR is highly dependent on the touchscreen or hand controllers in AR headsets. However, spatial interaction and AR are highly related to the real life experiences of humans in the physical space where direct control and manipulation of the items with hands are crucial. Hand tracking and gesture analysis technologies are the next generation revolutionary interfaces to facilitate the interaction between humans and computers. This article reflects on the usability and impact of hand tracking in mobile AR scenario from both technical perspective and user experience. Development of the hand tracking technology and product features at ManoMotion are highly inspired by the development of AR frameworks as hand tracking will be the best fit for spatial interaction in AR.

Read the full whitepaper