Um framework para apoio à captura de movimentos das mãos como forma de interação

Abstract

Motion capture (Mocap) is a concept based on capturing the motion of an object or person from the real world, in order to reproduce such motion on characters in virtual environment or provide interaction with systems or applications. For each motion, there are several techniques able to capture the motion in a more efficient way, because they present drastic differences to capture the hand motion, head motion, being the key points to capture the motion completely different according to each situation. Currently, there are various devices that offer different sources so that the developers can use on their applications, and systems of motion capture, however they still need specific knowledge in motion capture when compared to an interaction through a more traditional device such as the mouse, being this one used as main way of interaction when it is related to interaction in simple applications, because it provides suitable and easy development resources for such applications. This mater’s project aims to develop a framework to recognize the hand motion to be used in simple applications, focused on the actions of catching and turning, using the device Kinect v2.0 of Microsoft and a high-level approach for beginner developers, using the motion capture in a simple and optimized way, being possible to compare their difficulty and the resources to the most used traditionally device for this kind of interaction – the mouse. A case study will be developed using three different approaches: SDK available by Microsoft; the proposed framework – EasyMoCapHand – and the interaction through the mouse; exemplifying, this way, relevant aspects of the development of each approach. And later on, an experiment which participants develop activities that and through them have a perception of the use of each approach, contributing to the use of motion capture in simple applications that have their development always attached to the mouse use as a way of interaction, becoming this way of interaction an option for beginner developers who would not use on their interaction through motion capture