Assessment of joint parameters in a Kinect sensor based rehabilitation game

A Kinect sensor based basketball game is developed for delivering post-stroke exercises in association with a newly developed elbow exoskeleton. Few interesting features such as audio-visual feedback and scoring have been added to the game platform to enhance patient’s engagement during exercises. After playing the game, the performance score has been calculated based on their reachable points and reaching time to measure their current health conditions. During exercises, joint parameters are measured using the motion capture technique of Kinect sensor. The measurement accuracy of Kinect sensor is validated by two comparative studies where two healthy subjects were asked to move elbow joint in front of Kinect sensor wearing the developed elbow exoskeleton. In the first study, the joint information collected from Kinect sensor was compared with the exoskeleton based sensor. In the next study, the length of upperarm and forearm measured by Kinect were compared with the standard anthropometric data. The measurement errors between Kinect and exoskeleton are turned out to be in the acceptable range; 1% for subject 1 and 0.44% for subject 2 in case of joint angle; 5.55% and 3.58% for subject 1 and subject 2 respectively in case of joint torque. The average errors of Kinect measurement as compared to the anthropometric data of the two subjects are 16.52% for upperarm length and 9.87% for forearm length. It shows that Kinect sensor can measure the activity of joint movement with a minimum margin of error.

[1] Piron, L., Turolla, A., Agostini, M., Zucconi, C., Tonin, P., Piccione, F., and Dam, M., 2009, "Assessment and treatment of the upper limb by means of virtual reality in post-stroke patients," Stud Health Technol Inform, 145, pp. 55-62.
[2] Smith, G. V., Silver, K. H., Goldberg, A. P., and Macko, R. F., 1999, "“Task-oriented” exercise improves hamstring strength and spastic reflexes in chronic stroke patients," Stroke, 30(10), pp. 2112-2118.
[3] Smithard, D., 2017, "Stroke in frail older people," Geriatrics, 2(3), p. 24.
[4] Shin, J.-H., Ryu, H., and Jang, S. H., 2014, "A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments," Journal of Neuroengineering and Rehabilitation, 11(1), p. 32.
[5] Tsekleves, E., Paraskevopoulos, I. T., Warland, A., and Kilbride, C., 2016, "Development and preliminary evaluation of a novel low cost VR-based upper limb stroke rehabilitation platform using Wii technology," Disability and Rehabilitation: Assistive Technology, 11(5), pp. 413-422.
[6] Levin, M. F., Weiss, P. L., and Keshner, E. A., 2015, "Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles," Physical Therapy, 95(3), pp. 415-425.
[7] Goude, D., Björk, S., and Rydmark, M., "Game design in virtual reality systems for stroke rehabilitation," Proc. MMVR, pp. 146-148.
[8] Roy, A. K., Soni, Y., and Dubey, S., "Enhancing effectiveness of motor rehabilitation using kinect motion sensing technology," Proc. 2013 IEEE Global Humanitarian Technology Conference: South Asia Satellite (GHTC-SAS), IEEE, pp. 298-304.
[9] Egglestone, S. R., Axelrod, L., Nind, T., Turk, R., Wilkinson, A., Burridge, J., Fitzpatrick, G., Mawson, S., Robertson, Z., and Hughes, A. M., "A design framework for a home-based stroke rehabilitation system: Identifying the key components," Proc. 2009 3rd International Conference on Pervasive Computing Technologies for Healthcare, IEEE, pp. 1-8.
[10] Windolf, M., Götzen, N., and Morlock, M., 2008, "Systematic accuracy and precision analysis of video motion capturing systems—exemplified on the Vicon-460 system," Journal of Biomechanics, 41(12), pp. 2776-2780.
[11] Hillstrom, H. J., Garg, R., Kraszewski, A., Lenhoff, M., Carter, T., Backus, S. I., Wolff, A., Syrkin, G., Cheng, R., and Wolfe, S. W., 2014, "Development of an anatomical wrist joint coordinate system to quantify motion during functional tasks," Journal of Applied Biomechanics, 30(4), pp. 586-593.
[12] Da Gama, A., Fallavollita, P., Teichrieb, V., and Navab, N., 2015, "Motor rehabilitation using Kinect: a systematic review," Games for Health Journal, 4(2), pp. 123-135.
[13] Sookhanaphibarn, K., Phukongchai, W., Santad, T., and Choensawat, W., "Towards Bilateral Upper-Limb Rehabilitation after Stroke using Kinect Game," Proc. 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), IEEE, pp. 818-819.
[14] Obdrzalek, S., Kurillo, G., Ofli, F., Bajcsy, R., Seto, E., Jimison, H., and Pavel, M., "Accuracy and robustness of Kinect pose estimation in the context of coaching of elderly population," Proc. 2012 Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC), IEEE, pp. 1188-1193.
[15] Lin, C.-H., Sun, P.-Y., and Yu, F., "Space connection: a new 3D tele-immersion platform for web-based gesture-collaborative games and services," Proc. Fourth International Workshop on Games and Software Engineering, IEEE Press, pp. 22-28.
[16] Lugrin, J.-L., Latt, J., and Latoschik, M. E., "Avatar anthropomorphism and illusion of body ownership in VR," Proc. 2015 IEEE Virtual Reality (VR), IEEE, pp. 229-230.
[17] Antón, D., Goñi, A., Illarramendi, A., Torres-Unda, J. J., and Seco, J., "KiReS: A Kinect-based telerehabilitation system," Proc. 2013 IEEE 15th International Conference on e-Health Networking, Applications & Services (Healthcom), IEEE, pp. 444-448.
[18] Jaume-i-Capó, A., Martínez-Bueso, P., Moyà-Alcover, B., and Varona, J., 2014, "Improving vision-based motor rehabilitation interactive systems for users with disabilities using mirror feedback," The Scientific World Journal, 2014.
[19] Chang, C.-Y., Lange, B., Zhang, M., Koenig, S., Requejo, P., Somboon, N., Sawchuk, A. A., and Rizzo, A. A., "Towards pervasive physical rehabilitation using Microsoft Kinect," Proc. PervasiveHealth, pp. 159-162.
[20] Guneysu, A., Siyli, R. D., and Salah, A. A., "Auto-evaluation of motion imitation in a child-robot imitation game for upper arm rehabilitation," Proc. The 23rd IEEE International Symposium on Robot and Human Interactive Communication, IEEE, pp. 199-204.
[21] Ma, M., Proffitt, R., and Skubic, M., "Quantitative assessment and validation of a stroke rehabilitation game," Proc. 2017 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE), IEEE, pp. 255-257.
[22] Wang, X., Li, X., Wang, J., and Luo, T., "A Kinect-Based Trajectory Capturing and Tracking Scheme for Upper-Limb Robot-Aided Rehabilitation," Proc. 2017 IEEE 7th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), IEEE, pp. 249-254.
[23] Bouteraa, Y., Abdallah, I. B., and Elmogy, A. M., 2019, "Training of Hand Rehabilitation Using Low Cost Exoskeleton and Vision-Based Game Interface," Journal of Intelligent & Robotic Systems, pp. 1-17.
[24] Manna, S. K., and Dubey, V. N., "Design Proposal for a Portable Elbow Exoskeleton," Proc. 2018 Design of Medical Devices Conference, American Society of Mechanical Engineers, pp. V001T003A013-V001T003A013.
[25] Winter, D. A., 1990, "Biomechanics and motor control of human motion," New York: Wiley-Interscience.
[26] Manna, S. K., and Dubey, V. N., "Design of a Game-based Rehabilitation System using Kinect Sensor," Proc. 2019 Design of Medical Devices Conference, American Society of Mechanical Engineers.