
(2) * Norsinnira Zainul Azlan

(3) Iswanto Suwarno

(4) Abdul Rahman Samewoi

(5) Nohaslinda Kamarudzaman

*corresponding author
AbstractUpper limb rehabilitation robot can facilitate patients to regain their original impaired arm function and reduce therapist’ workload. However, the patient does not have a direct control over his/ her arm movement, which may lead to discomfort or even injury. This paper focuses on the development of a self-motion rehabilitation robot using Perception Neuron motion capture, where the movement of the impaired arm imitates the motion of the healthy limb. The Axis Neuron software receives the healthy upper limb’s motion data from Perception Neuron. Unity serves as the simulation engine software that provides a 3-dimensional animation. ARDUnity acts as the communication platform between Unity software with Arduino. Arduino code is generated using Wire Editor, which avoids the need of the programming to be written in C++ or C#. Finally, Arduino instructs the exoskeleton motors that are connected to the impaired arm to move, following the healthy joint’s motion. The forward kinematics analysis for the robotic exoskeleton has been carried out to identify its workspace. Hardware experimental tests on the elbow and wrist flexion/ extension have shown the root-mean-square errors (RMSE) between the healthy and impaired arms movement to be 1.5809○ and 12.1955○ respectively. The average time delay between the healthy and impaired elbow movement is 0.1 seconds. For the wrist motion, the time delay is 1 second. The experimental results verified the feasibility and effectiveness of the Perception Neuron in realizing the self-motion control robot for upper limb rehabilitation. The proposed system enables the patients to conduct the rehabilitation therapy in a safer and more comfortable way as they can directly adjust the speed or stop the movement of the affected limb whenever they feel pain or discomfort.
KeywordsSelf-Motion Control; Master-Slave; Upper Limb Rehabilitation Robot; Perception Neuron; Unity; Axis Neuron; ARDUnity
|
DOIhttps://doi.org/10.31763/ijrcs.v5i1.1030 |
Article metrics10.31763/ijrcs.v5i1.1030 Abstract views : 112 | PDF views : 14 |
Cite |
Full Text![]() |
References
[1] R. Ranzani et al., “Neurocognitive robot-assisted rehabilitation of hand function: a randomized control trial on motor recovery in subacute stroke,†Journal of NeuroEngineering and Rehabilitation, vol. 17, pp. 1-13, 2020, https://doi.org/10.1186/s12984-020-00746-7.
[2] A. AdomaviÄienÄ—, K. DaunoraviÄienÄ—, R. Kubilius, L. VaržaitytÄ— and J. Raistenskis, “Influence of new technologies on post-stroke rehabilitation: A Comparison of Armeo Spring to the Kinect system,†Medicina, vol. 55, no. 4, p. 98, 2019, https://doi.org/10.3390/medicina55040098.
[3] I. Shahdad, N. Zainul Azlan and A. Jazlan, "Performance-based Impedance Control of a One Degree-of-Freedom Finger Extensor for Hand Rehabilitation," 2020 IEEE 8th Conference on Systems, Process and Control (ICSPC), pp. 173-177, 2020, https://doi.org/10.1109/ICSPC50992.2020.9305803.
[4] U. Kashtwari, N. Z. Azlan, and I. Shahdad, “Wearable upper limb motion assist robot for eating activity,†Applied Research and Smart Technology (ARSTech), vol. 1, no. 1, pp. 1-10, 2020, https://doi.org/10.23917/arstech.v1i1.28.
[5] L. Sheehy, A. Taillonâ€Hobson, H. Sveistrup, M. Bilodeau, C. Yang, and H. Finestone, “Sitting balance exercise performed using virtual reality training on a stroke rehabilitation inpatient service: a randomized controlled study,†PM&R, vol. 12, no. 8, pp. 754-765, 2020, https://doi.org/10.1002/pmrj.12331.
[6] Ü. D. Duran et al., “Comparison of the effectiveness of anti-gravity treadmill exercises and underwater walking exercises on cardiorespiratory fitness, functional capacity and balance in stroke patients,†Acta Neurologica Belgica, vol. 123, pp. 423–432, 2022, https://doi.org/10.1007/s13760-022-02012-0.
[7] J. H. Kim, “Effects of a virtual reality video game exercise program on upper extremity function and daily living activities in stroke patients,†Journal of Physical Therapy Science, vol. 30, no. 12, pp. 1408-1411, 2018, https://doi.org/10.1589/jpts.30.1408.
[8] C. T. Wulandari, S. Sulastyawati, and M. P. Lingling, “ROM and CIMT Treatment effects to stroke patients’s upper extremity functional ability,†Jurnal Ners & Kebidanan Indonesia (Indonesian Journal of Nursing & Midwifery, vol. 8, no. 3, pp. 223-231, 2020, http://dx.doi.org/10.21927/jnki.2020.8(3).223-231.
[9] Y. Yoshimura, H. Wakabayashi, F. Nagano, T. Bise, S. Shimazu and A. Shiraishi, “Chairâ€stand exercise improves postâ€stroke dysphagia,†Geriatrics & Gerontology International, vol. 20, no. 10, pp. 885-891, 2020, https://doi.org/10.1111/ggi.13998.
[10] P. M. Ostrowska, M. Śliwiński, R. Studnicki and R. Hansdorfer-Korzon, “Telerehabilitation of post-stroke patients as a therapeutic solution in the era of the covid-19 pandemic,†Healthcare, vol. 9, no. 6, p. 654, 2021, https://doi.org/10.3390/healthcare9060654.
[11] S. Y. A. Mounis, N. Z. Azlan and F. Sado, "Assist-as-Needed Robotic Rehabilitation Strategy Based on z-Spline Estimated Functional Ability," IEEE Access, vol. 8, pp. 157557-157571, 2020, https://doi.org/10.1109/ACCESS.2020.3019450.
[12] N. Z. Azlan and N. S. Lukman, “Assist as needed control strategy for upper limb rehabilitation robot in eating activity,†IIUM Engineering Journal, vol. 22, no. 1, pp. 298-322, 2021, https://doi.org/10.31436/iiumej.v22i1.1480.
[13] S. Y. A. Mounis, N. Z. Azlan and Z. Hussain, “Design and control of a robotic device for upper limb rehabilitation therapy,†Journal of Engineering Science and Technology, vol. 17, no. 2, pp. 1306-1327, 2022, https://jestec.taylors.edu.my/Vol%2017%20Issue%202%20April%20%202022/17_2_35.pdf.
[14] S. Y. A. Mounis, N. Z. Azlan and F. Sado, “Assist-as-needed control strategy for upper-limb rehabilitation based on subject’s functional ability,†Measurement and Control, vol. 52, no. 9-10, pp. 1354-1361, 2019, https://doi.org/10.1177/0020294019866844.
[15] H. Li and L. Cheng, "Preliminary study on the design and control of a pneumatically-actuated hand rehabilitation device," 2017 32nd Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp. 860-865, 2017, https://doi.org/10.1109/YAC.2017.7967530.
[16] J. Guo et al., "A soft robotic exo-sheath using fabric EMG sensing for hand rehabilitation and assistance," 2018 IEEE International Conference on Soft Robotics (RoboSoft), pp. 497-503, 2018, https://doi.org/10.1109/ROBOSOFT.2018.8405375.
[17] X. Chen et al., "A Wearable Hand Rehabilitation System With Soft Gloves," IEEE Transactions on Industrial Informatics, vol. 17, no. 2, pp. 943-952, 2021, https://doi.org/10.1109/TII.2020.3010369.
[18] P. A. D. Harischandra and A. M. H. S. Abeykoon, "Development of an upper limb master-slave robot for bimanual rehabilitation," 2017 Moratuwa Engineering Research Conference (MERCon), pp. 52-57, 2017, https://doi.org/10.1109/MERCon.2017.7980455.
[19] J. Liu, J. Mei, X. Zhang, X. Lu, and J. Huang, “Augmented reality-based training system for upper limb rehabilitation,†Multimedia Tools and Applications, vol. 76, no. 13, pp. 14847–14867, 2017, https://doi.org/10.1007/s11042-016-4067-x.
[20] M. Alimanova et al., "Gamification of Hand Rehabilitation Process Using Virtual Reality Tools: Using Leap Motion for Hand Rehabilitation," 2017 First IEEE International Conference on Robotic Computing (IRC), pp. 336-339, 2017, https://doi.org/10.1109/IRC.2017.76.
[21] G. Placidi, L. Cinque, M. Polsinelli and M. Spezialetti, “Measurements by a LEAP-based virtual glove for the upper limb rehabilitation,†Sensors, vol. 18, no. 3, p. 834, 2018, https://doi.org/10.3390/s18030834.
[22] I. B. Abdallah, Y. Bouteraa and C. Rekik, "Design and development of 3D printed myoelectric robotic exoskeleton for upper limb rehabilitation," International Journal on Smart Sensing and Intelligent Systems, vol. 10, no. 2, pp. 341–366, 2017, https://doi.org/10.21307/ijssis-2017-215.
[23] D. Wang, Q. Meng, Q. Meng, X. Li and H. Yu, "Design and Development of a Portable Exoskeleton for Hand Rehabilitation," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 26, no. 12, pp. 2376-2386, 2018, https://doi.org/10.1109/TNSRE.2018.2878778.
[24] S. Li et al., “Kinematics and performance analysis of a parallel 4-UPS/RRR trunk rehabilitation robot,†Journal of Mechanical Science and Technology, vol. 38, no. 11, pp. 6319–6333, 2024, https://doi.org/10.1007/s12206-024-1043-7.
[25] H. Hmaied, H. Sami, and B. Faouzi, “Design and Control of Two Degrees of Freedom Robot for a Passive Rehabilitation,†Journal of Control, Automation and Electrical Systems, vol. 35, no. 6, pp. 1078–1096, 2024, https://doi.org/10.1007/s40313-024-01131-8.
[26] G. Lu, X. Liu, Q. Zhang, Z. Zhao, R. Li, and Z. Li, “Design and Analysis of Rehabilitation Evaluation System for Finger Rehabilitation Robot,†International Journal of Automation Technology, vol. 18, no. 5, pp. 671–678, 2024, https://doi.org/10.20965/ijat.2024.p0671.
[27] C. K. Bitikofer, S. Rueda Parra, R. Maura, E. T. Wolbrecht, and J. C. Perry, “BLUE SABINO: Development of a BiLateral Upper-Limb Exoskeleton for Simultaneous Assessment of Biomechanical and Neuromuscular Output,†Machines, vol. 12, no. 9, p. 617, 2024, https://doi.org/10.3390/machines12090617.
[28] J. Cao et al., “Variable Admittance Control of High Compatibility Exoskeleton Based on Human–Robotic Interaction Force,†Chinese Journal of Mechanical Engineering, vol. 37, no. 1, 2024, https://doi.org/10.1186/s10033-024-01113-6.
[29] Y. Yang, “Research on Active–Passive Training Control Strategies for Upper Limb Rehabilitation Robot,†Machines, vol. 12, no. 11, p. 784, 2024, https://doi.org/10.3390/machines12110784.
[30] H. Wang et al., “Dynamics analysis and simulation experiments of twist spring drive upper limb rehabilitation robot,†Journal of the Brazilian Society of Mechanical Sciences and Engineering, vol. 46, no. 12, 2024, https://doi.org/10.1007/s40430-024-05278-y.
[31] C. Zhang, H. Yan, J. Wei, F. Zhang, Z. Shi, and X. Li, “Research on the Safety Design and Trajectory Planning for a New Dual Upper Limb Rehabilitation Robot,†Actuators, vol. 13, no. 9, p. 364, 2024, https://doi.org/10.3390/act13090364.
[32] J. Zhang, S. Yang, C. Liu, X. Wang, and S. Guo, “Configuration and Kinematics of a 3-DOF Generalized Spherical Parallel Mechanism for Ankle Rehabilitation,†Chinese Journal of Mechanical Engineering, vol. 37, no. 1, 2024, https://doi.org/10.1186/s10033-024-01003-x.
[33] Y. Liu, W. Lu, D. Fan, W. Tan, B. Hu, and D. Zeng, “Type Synthesis of Self-Alignment Parallel Ankle Rehabilitation Robot with Suitable Passive Degrees of Freedom,†Chinese Journal of Mechanical Engineering, vol. 37, no. 1, 2024, https://doi.org/10.1186/s10033-024-00996-9.
[34] T. P. Valayil and T. K. Tanev, “Optimal Design of a Bilateral Stand-Alone Robotic Motion-Assisted Finger Exoskeleton for Home Rehabilitation,†Machines, vol. 12, no. 10, p. 685, 2024, https://doi.org/10.3390/machines12100685.
[35] Y. Shi et al., “A cable-driven exosuit for upper limbs: design, control, and evaluation,†Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, vol. 238, no. 20, pp. 9810–9824, 2024, https://doi.org/10.1177/09544062241258909.
[36] M. Ni, J. Liu, Z. Sun, and T. Sun, “Design and Experiment of an Ankle Rehabilitation Robot After Fracture Surgery,†Journal of Mechanisms and Robotics, vol. 16, no. 12, p. 121014, 2024, https://doi.org/10.1115/1.4065392.
[37] J. Chen and H. Cheng, “Application of Artificial Neuromolecular System in Robotic Arm Control to Assist Progressive Rehabilitation for Upper Extremity Stroke Patients,†Actuators, vol. 13, no. 9, p. 362, 2024, https://doi.org/10.3390/act13090362.
[38] G. Huang et al., "Master-slave control of an intention-actuated exoskeletal robot for locomotion and lower extremity rehabilitation," International Journal of Precision Engineering and Manufacturing, vol. 19, no.7, pp. 983-991, 2018, https://doi.org/10.1007/s12541-018-0116-x.
[39] X. Tan, Q. Luo, S. Yang and Y. Jiang, "Hand-assisted rehabilitation robot based on human-machine master-slave motion mode," 2020 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), pp. 362-365, 2020, https://doi.org/10.1109/CyberC49757.2020.00068.
[40] H. Kawasaki et al., "Development of a Hand Motion Assist Robot for Rehabilitation Therapy by Patient Self-Motion Control," 2007 IEEE 10th International Conference on Rehabilitation Robotics, pp. 234-240, 2007, https://doi.org/10.1109/ICORR.2007.4428432.
[41] H. Kawasaki, H. Kimura, S. Ito, Y. Nishimoto, H. Hayashi and Sakaeda, "Hand Rehabilitation Support System Based on Self-Motion Control, with a Clinical Case Report," 2006 World Automation Congress, pp. 1-6, 2006, https://doi.org/10.1109/WAC.2006.375977.
[42] C. Li, Y. Inoue, T. Liu, K. Shibata and K. Oka, "A self-controlled robot for upper limb rehabilitation," The 2010 IEEE International Conference on Information and Automation, pp. 114-119, 2010, https://doi.org/10.1109/ICINFA.2010.5512343.
[43] J. Bae, Y. Kim and I. Moon, "Wearable hand rehabilitation robot capable of hand function assistance in stroke survivors," 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1482-1487, 2012, https://doi.org/10.1109/BioRob.2012.6290736.
[44] L. Zhang, S. Guo, and Q. Sun, "Development and analysis of a bilateral end-effecter upper limb rehabilitation robot," Journal of Mechanics in Medicine and Biology, vol. 21, no. 4, p. 2150032, 2021, https://doi.org/10.1142/S0219519421500329.
[45] R. Sers, S. Forrester, E. Moss, S. Ward, J. Ma and M. Zecca, “Validity of the Perception Neuron inertial motion capture system for upper body motion analysis,†Measurement, vol. 149, p. 107024, 2020, https://doi.org/10.1016/j.measurement.2019.107024.
[46] C. Z. Y. Choo, J. Y. Chow and J. Komar, “Validation of the Perception Neuron system for full-body motion capture,†PloS one, vol. 17, no. 1, p. e0262730, 2022, https://doi.org/10.1371/journal.pone.0262730.
[47] H. S. Kim et al., “Application of a perception neuron® system in simulation-based surgical training,†Journal of Clinical Medicine, vol. 8, no. 1, p. 124, 2019, https://doi.org/10.3390/jcm8010124.
[48] J. Jung, “Use of human motion data to train wearable robots,†Turkish Journal of Computer and Mathematics Education (TURCOMAT), vol. 12, no. 6, pp. 807-811, 2021, https://doi.org/10.17762/turcomat.v12i6.2100.
[49] F. Becattini, A. Ferracani, F. Principi, M. Ghianni, and A. D. Bimbo, “Neuron Unity Integration 2.0. A Unity Based Application for Motion Capture and Gesture Recognition,†Proceedings of the 27th ACM International Conference on Multimedia, pp. 2199-2201, 2019, https://doi.org/10.1145/3343031.3350598.
[50] Y. Wu, K. Tao, Q. Chen, Y. Tian and L. Sun, “A comprehensive analysis of the validity and reliability of the Perception Neuron Studio for upper-body motion capture,†Sensors, vol. 22, no. 18, p. 6954, 2022, https://doi.org/10.3390/s22186954.
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Mohamad Afwan Osman, Norsinnira Zainul Azlan, Iswanto Suwarno, Abdul Rahman Samewoi, Nohaslinda Kamarudzaman

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
About the Journal | Journal Policies | Author | Information |
International Journal of Robotics and Control Systems
e-ISSN: 2775-2658
Website: https://pubs2.ascee.org/index.php/IJRCS
Email: ijrcs@ascee.org
Organized by: Association for Scientific Computing Electronics and Engineering (ASCEE), Peneliti Teknologi Teknik Indonesia, Department of Electrical Engineering, Universitas Ahmad Dahlan and Kuliah Teknik Elektro
Published by: Association for Scientific Computing Electronics and Engineering (ASCEE)
Office: Jalan Janti, Karangjambe 130B, Banguntapan, Bantul, Daerah Istimewa Yogyakarta, Indonesia