Monte Carlo Simulations on 2D LRF Based People Tracking using Interactive Multiple Model Probabilistic Data Association Filter Tracker

(1) * Zulkarnain Zainudin Mail (Universiti Teknikal Malaysia Melaka (UTeM), Malaysia)
(2) Sarath Kodagoda Mail (University of Technology Sydney, Australia)
*corresponding author

Abstract


Consistency of tracking filter such as Interactive Multiple Model Probabilistic Data Association Filter (IMMPDAF) is the most important factor in targets tracking. Inaccurate tracking capability will lead to poor tracking performance when dealing with multiple people's interactions and occlusions. In order to validate the consistency, Normalized Estimation Error Squared (NEES) and Normalized Innovation Squared (NIS) were evaluated and tested using Monte Carlo experiments for 50 runs. These simulations has proven that the tracker is conditionally consistent on targets tracking despite the fact that it has difficulties on handling occlusions and maneuvering people. NEES requires ground truth of tracking data and predicted data, whereas NIS requires observation and predicted data for Monte Carlo simulations. In NEES simulations, the result emphasizes that state estimation errors of IMMPDAF tracker are inconsistent with filter-calculated covariances especially when dealing with sudden turns in zig-zag motion where quite a large number of points fall outside 95\% probability region. In NIS simulations, IMMPDAF tracker is confirmed to have difficulties to handle multiple targets with a short period of occlusion although a small number of points falls outside of 95\% probability region. Filter tracker is considered mismatched when dealing with zig-zag motion; however, it deemed to be optimistic when dealing with occlusions. As a result, the IMMPDAF tracker has limited capability in monitoring sharp turns under occlusion conditions, although it is acceptable when dealing with occlusions only.

Keywords


People Tracking; Interactive Multiple Model; Support Vector Machine; Human Robot Interaction; Laser Range Finde

   

DOI

https://doi.org/10.31763/ijrcs.v3i1.896
      

Article metrics

10.31763/ijrcs.v3i1.896 Abstract views : 1169 | PDF views : 353

   

Cite

   

Full Text

Download

References


[1] L. Beyer, A. Hermans, T. Linder, K. O. Arras, and B. Leibe, “Deep person detection in two dimensional range data,” IEEE Robotics and Automation Letters, vol. 3, pp. 2726–2733, 2018, https://doi.org/10.1109/LRA.2018.2835510.

[2] K. Koide, J. Miura, and E. Menegatti, “Monocular person tracking and identification with online deep feature selection for person following robots,” Robotics and Autonomous Systems, vol. 124, p. 103348, 2020, https://doi.org/10.1016/j.robot.2019.103348.

[3] A. Ramey, Alvaro Castro-Gonzalez, M. Malfaz, F. Alonso-Martin, and M. A. Salichs, “Vision-based people detection using depth information for social robots,” International Journal of Advanced Robotic Systems, vol. 14, p. 415–428, 2017, http://doi.org/10.1177/1729881417705923.

[4] G. T. Papadopoulos, A. Axenopoulos, and P. Daras, “Real-time skeleton-tracking-based human action recognition using kinect data,” in International Conference on Multimedia Modeling, 2014, pp. 473–483, http://doi.org/10.1007/978-3-319-04114-8_40.

[5] A. M. Ahmad, Z. Bazzal, and H. A. Youssef, “Kinect-based moving human tracking system with obstacle avoidance,” Advances in Science, Technology and Engineering Systems Journal, vol. 2, pp. 191–197, 2017, http://doi.org/10.25046/aj020325.

[6] A. Borcs, B. Nagy, and C. Benedek, “Instant object detection in lidar point clouds,” IEEE Geoscience and Remote Sensing Letters, vol. 14, no. 7, pp. 992–996, 2017, https://doi.org/10.1109/LGRS.2017.2674799.

[7] Z. Dai, A. Wolf, P. Ley, T. Gluck, M. C. Sundermeier, and R. Lachmayer, “Requirements for automotive lidar systems,” Sensors, vol. 22, no. 19, p. 7532, 2022, https://doi.org/10.3390/s22197532.

[8] M. E. Warren, “Automotive lidar technology,” in 2019 Symposium on VLSI Circuits, 2019, pp. C254–C255, https://doi.org/10.23919/vlsic.2019.8777993.

[9] Y. Li and J. Ibanez-Guzman, “Lidar for autonomous driving: The principles, challenges, and trends for automotive lidar and perception systems,” IEEE Signal Process. Mag., vol. 37, no. 4, pp. 50–61, 2020, https://doi.org/10.1109/MSP.2020.2973615.

[10] J. Shackleton, B. VanVoorst, and J. Hesch, “Tracking people with a 360-degree lidar,” in 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance, 2010, pp. 420–426, https://doi.org/10.1109/AVSS.2010.52.

[11] A. H. A. Rahman, K. A. Z. Ariffin, N. S. Sani, and H. Zamzuri, “Pedestrian detection using triple laser range finders” International Journal of Electrical & Computer Engineering, vol. 7, no. 6, 2017, http://doi.org/10.11591/ijece.v7i6.pp3037-3045.

[12] J. Chen, P. Ye, and Z. Sun, “Pedestrian detection and tracking based on 2d lidar,” The 2019 6th International Conference on Systems and Informatics (ICSAI 2019), pp. 421–426, 2019, https://doi.org/10.1109/ICSAI48974.2019.9010202.

[13] H. Beomsoo, A. A. Ravankar, and T. Emaru, “Mobile robot navigation based on deep reinforcement learning with 2d-lidar sensor using stochastic approach,” in 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), 2021, https://doi.org/10.1109/ISR50024.2021.9419565.

[14] H. Beomsoo, A. A. Ravankar, and T. Emaru, “Mobile robot navigation based on deep reinforcement learning with range only sensor,” in The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec), vol. 2021, 2021, pp. 1P1–L07, https://doi.org/10.1299/jsmermd.2021.1P1-L07.

[15] D. L. Tomasi and E. Todt, “Cbnav: Costmap based approach to deep reinforcement learning mobile robot navigation,” in 2021 Latin American Robotics Symposium (LARS), 2021 Brazilian Symposium on Robotics (SBR), and 2021 Workshop on Robotics in Education (WRE), 2021, https://doi.org/10.1109/LARS/SBR/WRE54079.2021.9605463.

[16] Z. Zhang and K. Kodagoda, “Multi-sensor approach for people detection,” in Proceedings of the 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing Conference, 2005., 2005, pp. 355–360, https://doi.org/10.1109/ISSNIP.2005.1595605.

[17] Z. Zivkovic and B. Krose, “Part based people detection using 2d range data and images,” in 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2007, pp. 214–219, https://doi.org/10.1109/IROS.2007.4399311.

[18] O. Mozos, R. Kurazume, and T. Hasegawa, “Multi-part people detection using 2d range data,” International Journal of Social Robotics, vol. 2, pp. 31–40, 2010, https://doi.org/10.1007/s12369-009-0041-3.

[19] K. Arras, O. Mozos, and W. Burgard, “Using boosted features for the detection of people in 2d range data,” in Proceedings 2007 IEEE International Conference on Robotics and Automation, 2007, pp. 3402–3407, https://doi.org/10.1109/ROBOT.2007.363998.

[20] Y. Nakamori, Y. Hiroi, and A. Ito, “Multiple player detection and tracking method using a laser range finder for a robot that plays with human,” ROBOMECH Journal, vol. 5, no. 1, pp. 1–15, 2018, https://doi.org/10.1186/s40648-018-0122-x.

[21] M. Simpson and D. Hutchinson, “Imaging — lidar,” in Encyclopedia of Modern Optics, R. D. Guenther, Ed. Oxford: Elsevier, 2005, pp. 169–178, https://doi.org/10.1016/B0-12-369395-0/00720-X.

[22] P. Dong and Q. Chen, LiDAR Remote Sensing and Applications. CRC Press, 2018, https://doi.org/10.4324/9781351233354.

[23] H. A. Blom and Y. Bar-Shalom, “The interacting multiple model algorithm for systems with markovian switching coefficients,” Automatic Control, IEEE Transactions on, vol. 33, no. 8, pp. 780–783, 1988, https://doi.org/10.1109/9.1299.

[24] Y. Bar-Shalom, T. E. Fortmann, and P. G. Cable, “Tracking and data association,” The Journal of the Acoustical Society of America, vol. 87, p. 918, 1990, https://doi.org/10.1121/1.398863.

[25] Y. Bar-Shalom, K. Chang, and H. A. Blom, “Tracking of splitting targets in clutter using an interacting multiple model joint probabilistic data association filter,” in [1991] Proceedings of the 30th IEEE Conference on Decision and Control, 1991, pp. 2043–2048, https://doi.org/10.1109/CDC.1991.261778.

[26] Y. Bar-Shalom, F. Daum, and J. Huang, “The probabilistic data association filter,” IEEE Control Systems Magazine, vol. 29, no. 6, pp. 82–100, 2009, https://doi.org/10.1109/MCS.2009.934469.

[27] G. S. Satapathi and S. Pathipati, “Waveform agile sensing approach for tracking benchmark in the presence of ecm using immpdaf,” Radioengineering, vol. 26, no. 1, pp. 227–239, 4 2017, https://www.radioeng.cz/fulltexts/2017/17_01_0227_0239.pdf.

[28] L. Cambuim and E. Barros, “Fpga-based pedestrian detection for collision prediction system,” Sensors, vol. 22, no. 12, p. 4421, 2022, https://doi.org/10.3390/s22124421.

[29] Z. Chen, W. Yuan, M. Yang, C. Wang, and B. Wang, “Svm based people counting method in the corridor scene using a single-layer laser scanner,” in 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), 2016, pp. 2632–2637, https://doi.org/10.1109/ITSC.2016.7795979.

[30] Y. Bar-Shalom and X.-R. Li, Estimation and tracking: principles, techniques, and software. Artech House Norwood, 1993, https://books.google.com.my/books?id=0YPAAAAACAAJ.

[31] Y. Bar-Shalom, X. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software. Wiley, 2001, https://doi.org/10.1002/0471221279.

[32] S. Bhaumik and P. Date, The Kalman filter and the extended Kalman filter. Chapman and Hall/CRC, 2019, ch. Book: Nonlinear Estimation, pp. 27–50, http://doi.org/10.1201/9781351012355-2.

[33] A. Roux, S. Changey, J. Weber, and J.-P. Lauffenburger, “Projectile trajectory estimation: performance analysis of an extended kalman filter and an imperfect invariant extended kalman filter,” in 2021 9th International Conference on Systems and Control (ICSC), 2021, pp. 274–281, https://doi.org/10.1109/ICSC50472.2021.9666713.

[34] I. Ullah, X. Su, X. Zhang, and D. Choi, “Simultaneous localization and mapping based on kalman filter and extended kalman filter,” Wirel. Commun. Mob. Comput., vol. 2020, pp. 1–12, 2020, http://doi.org/10.1155/2020/2138643.

[35] Z. Zainudin, S. Kodagoda, and G. Dissanayake, “Torso detection and tracking using a 2d laser range finder,” in Proceedings of the Australasian Conference on Robotics and Automation, 2010, http://hdl.handle.net/10453/16405.

[36] A. Fitzgibbon, M. Pilu, and R. B. Fisher, “Direct least square fitting of ellipses,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 5, pp. 476–480, 1999, https://doi.org/10.1109/TVT.2004.834875.

[37] K. Thurnhofer-Hemsi, E. Lopez-Rubio, M. A. Molina-Cabello, and K. Najarian, “Radial basis function kernel optimization for support vector machine classifiers,” arXiv preprint arXiv:2007.08233, Jul. 2020, https://doi.org/10.48550/arXiv.2007.08233.

[38] P. Dhivya and S. Vasuki, “Wavelet based mri brain image classification using radial basis function in svm,” in 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI), 2018, https://doi.org/10.1109/ICOEI.2018.8553738.

[39] C. W. Hsu, C. C. Chang, C. J. Lin et al., “A practical guide to support vector classification,” 2003, https://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf.

[40] B. Kovacevic, D. Ivkovic, and Z. Radosavljevic, “Immpdaf approach for l-band radar multiple target tracking,” in 2020 19th International Symposium INFOTEH-JAHORINA (INFOTEH), 2020, pp. 1–5, https://doi.org/10.1109/INFOTEH48170.2020.9066328.

[41] K. R. S. Kodagoda, S. S. Ge, W. S. Wijesoma, and A. P. Balasuriya, “Immpdaf approach for road-boundary tracking,” IEEE Transactions on Vehicular Technology, vol. 56, no. 2, pp. 478–486, 2007, https://doi.org/10.1109/TVT.2007.891426.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Zulkarnain Zainudin, Sarath Kodagoda

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 


About the JournalJournal PoliciesAuthor Information

International Journal of Robotics and Control Systems
e-ISSN: 2775-2658
Website: https://pubs2.ascee.org/index.php/IJRCS
Email: ijrcs@ascee.org
Organized by: Association for Scientific Computing Electronics and Engineering (ASCEE)Peneliti Teknologi Teknik IndonesiaDepartment of Electrical Engineering, Universitas Ahmad Dahlan and Kuliah Teknik Elektro
Published by: Association for Scientific Computing Electronics and Engineering (ASCEE)
Office: Jalan Janti, Karangjambe 130B, Banguntapan, Bantul, Daerah Istimewa Yogyakarta, Indonesia