From Human Hand to Grasp Surface Detection, Tracking & Analysis

Hands are paramount for dexterous interactions that humans exhibit in daily life. Understanding the intricacies of human hand-object interactions is therefore necessary. Unfortunately, the limitations of state-of-the-art technologies make capturing the full hand-object complexity unfeasible, giving rise to the need for new technological means to achieve this aim. In this work, we propose an end-to-end framework in which individualized hand models are derived and used to capture quantitative personalized hand-object interaction information, precisely, hand shape, kinematics, and contact surfaces. The results of this study serve as a proof of concept that such a framework can significantly deepen personalized hand-object interaction analyses, providing, in perspective, insights for medical diagnoses and rehabilitation, among others.Clinical relevance - Our work showcases the need to incorporate bespoke human hand models in individualized hand function assessment technologies, as hand-object interaction information is subject-dependent.