Gaussian Processes-BayesFilters with Non-Parametric Data Optimization for Efficient 2D LiDAR Based People Tracking

(1) * Zulkarnain Zainudin Mail (Universiti Teknikal Malaysia Melaka, Malaysia)
(2) Sarath Kodagoda Mail (University of Technology Sydney, Australia)
*corresponding author

Abstract


A model for expressing and describing human motion patterns must be able to improve tracking accuracy. However, Conventional Bayesian Filters such as Kalman Filter (KF) and Particle Filter (PF) are vulnerable to failure when dealing with highly maneuverable targets and long-term occlusions. Gaussian Processes (GP) is then used to adapt human motion patterns and integrate the model with Bayesian Filters. In GP, all samples in training phase need to be included and periodically, new samples will be added into training samples whenever it is available. Larger amount of data will increase the computational time to produce the learned GP models due to data redundancies. As a result, Mutual Information (MI) based technique with Mahalanobis Distance (MD) is developed to keep only the informative data. This method is used to process data which is collected by a robot equipped with a LiDAR. Experiments have demonstrated that reducing data does not raise Average Root Mean Square Error (ARMSE) considerably. EKF, PF, GP-EKF and GP-PF are utilised as a tool for tracking people and all techniques have been analyzed in order to distinguish which method is more efficient. The performance of GP-EKF and GP-PF are then compared to EKF and PF where it proved that GP-BayesFilters performs better than Conventional Bayesian Filters. The proposed approach has reduced data points up to more than 90\% while keeping the ARMSE within acceptable limits. This data optimization technique will save computational time especially when deal with periodically accumulative data sets. Comparing on four tracking methods, both GP-PF and GP-EKF have achieved higher tracking performance when dealing with  highly maneuverable targets and occlusions.

Keywords


People Tracking; Gaussian Processes; Bayesian Filter; Particle Filter; Extended Kalman Filter

   

DOI

https://doi.org/10.31763/ijrcs.v3i2.901
      

Article metrics

10.31763/ijrcs.v3i2.901 Abstract views : 1015 | PDF views : 311

   

Cite

   

Full Text

Download

References


[1] K. Koide, J. Miura, and E. Menegatti, “Monocular person tracking and identification with on-line deep feature selection for person following robots,” Robotics and Autonomous Systems, vol. 124, p. 103348, 2020, https://doi.org/10.1016/j.robot.2019.103348.

[2] J. Alberts, S. Kleinschmidt, and B. Wagner, “Robust calibration procedure of a manipulator and a 2d laser scanner using a 1d calibration target,” in 17th International Conference on Informatics in Control, Automation and Robotics, 2019, https://www.scitepress.org/Papers/2019/79467/79467.pdf.

[3] A. H. A. Rahman, K. A. Z. Ariffin, N. S. Sani, and H. Zamzuri, “Pedestrian detection using triple laser range finders,” International Journal of Electrical & Computer Engineering, vol. 7, no. 6, 2017, http://doi.org/10.11591/ijece.v7i6.pp3037-3045.

[4] H. Beomsoo, A. A. Ravankar, and T. Emaru, “Mobile robot navigation based on deep reinforcement learning with 2d-lidar sensor using stochastic approach,” in 2021 IEEE International Conference on Intelligence and Safety for Robotics (ISR), 2021, https://doi.org/10.1109/ISR50024.2021.9419565.

[5] N. Tsoulias, G. Xanthopoulos, S. Fountas, and M. Zude, “In-situ detection of apple fruit using a 2d lidar laser scanner,” in 2020 IEEE International Workshop on Metrology for Agriculture and Forestry (MetroAgriFor), 2020, https://doi.org/10.1109/MetroAgriFor50201.2020.9277629.

[6] J. Chen, P. Ye, and Z. Sun, “Pedestrian detection and tracking based on 2d lidar,” The 2019 6th International Conference on Systems and Informatics (ICSAI 2019), pp. 421–426, 2019, https://doi.org/10.1109/ICSAI48974.2019.9010202.

[7] L. Beyer, A. Hermans, T. Linder, K. O. Arras, and B. Leibe, “Deep person detection in two-dimensional range data,” IEEE Robotics and Automation Letters, vol. 3, pp. 2726–2733, 2018, https://doi.org/10.1109/LRA.2018.2835510.

[8] S. Chan, R. E. Warburton, G. Gariepy, J. Leach, and D. Faccio, “Non-line-of-sight tracking of people at long range,” Optic Express, vol. 25, no. 9, pp. 10109-10117, 2017, https://doi.org/10.1364/OE.25.010109.

[9] A. Borcs, B. Nagy, and C. Benedek, “Instant object detection in lidar point clouds,” IEEE Geoscience and Remote Sensing Letters, pp. 992–996, 2017, https://doi.org/10.1109/LGRS.2017.2674799.

[10] Y. Li and J. Ibanez-Guzman, “Lidar for autonomous driving: The principles, challenges, and trends for automotive lidar and perception systems,” IEEE Signal Process. Mag., vol. 37, no. 4, pp. 50–61, 2020, https://doi.org/10.1109/MSP.2020.2973615.

[11] Y. Nakamori, Y. Hiroi, and A. Ito, “Multiple player detection and tracking method using a laser range finder for a robot that plays with human,” ROBOMECH Journal, vol. 5, no. 1, pp. 1–15, 9 2018, https://doi.org/10.1186/s40648-018-0122-x.

[12] D. Gruyer and M.-C. Rahal, “Multi-layer laser scanner strategy for obstacle detection and tracking,” in 2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA), 2019, https://doi.org/10.1109/AICCSA47632.2019.9035243.

[13] M. E. Warren, “Automotive lidar technology,” in 2019 Symposium on VLSI Circuits, 2019, pp. C254–C255, https://doi.org/10.23919/VLSIC.2019.8777993.

[14] D. Katkoria and J. Sreevalsan-Nair, “Rosels: Road surface extraction for 3d automotive lidar point cloud sequence,” in Proceedings of the 3rd International Conference on Deep Learning Theory and Applications - DeLTA, 2022, pp. 55–67, https://www.scitepress.org/PublishedPapers/2022/113017/113017.pdf.

[15] Z. Dai, A. Wolf, P. Ley, T. Gluck, M. C. Sundermeier, and R. Lachmayer, “Requirements for automotive lidar systems,” Sensors, vol. 22, no. 19, p. 7532, 2022, https://doi.org/10.3390/s22197532.

[16] V. L. Popov, S. A. Ahmed, N. G. Shakev, and A. V. Topalov, “Detection and following of moving targets by an indoor mobile robot using microsoft kinect and 2d lidar data,” in 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), 2018, pp. 280–285, https://doi.org/10.1109/ICARCV.2018.8581231.

[17] M. L. Simpson and D. P. Hutchinson, “Imaging — lidar,” in Encyclopedia of Modern Optics, R. D. Guenther, Ed. Oxford: Elsevier, 2005, pp. 169–178, https://doi.org/10.1016/B0-12-369395-0/00720-X.

[18] P. Dong and Q. Chen, LiDAR Remote Sensing and Applications. CRC Press, 2018, https://doi.org/10.4324/9781351233354.

[19] S. Bhaumik and P. Date, The Kalman filter and the extended Kalman filter. Chapman and Hall/CRC, 2019, ch. Book: Nonlinear Estimation, pp. 27–50, http://dx.doi.org/10.1201/9781351012355-2.

[20] D. Schulz, W. Burgard, D. Fox, and A. B. Cremers, “People tracking with mobile robots using samplebased joint probabilistic data association filters,” International Journal of Robotics Research, vol. 22, no. 2, pp. 99–116, 2003, https://doi.org/10.1177/0278364903022002002.

[21] I. Ullah, X. Su, X. Zhang, and D. Choi, “Simultaneous localization and mapping based on kalman filter and extended kalman filter,” Wirel. Commun. Mob. Comput., vol. 2020, pp. 1–12, 2020, https://doi.org/10.1155/2020/2138643.

[22] A. Roux, S. Changey, J. Weber, and J.-P. Lauffenburger, “Projectile trajectory estimation: performance analysis of an extended kalman filter and an imperfect invariant extended kalman filter,” in 2021 9th International Conference on Systems and Control (ICSC), 2021, https://doi.org/10.1109/ICSC50472.2021.9666713.

[23] D. Schulz, D. Fox, and J. Hightower, “People tracking with anonymous and id-sensors using raoblackwellised particle filters,” in Proceedings of the 18th international joint conference on Artificial intelligence, 2003, pp. 921–928, https://dl.acm.org/doi/10.5555/1630659.1630792.

[24] B. Kovacevic, D. Ivkovic, and Z. Radosavljevic, “Immpdaf approach for l-band radar multiple target tracking,” in 2020 19th International Symposium INFOTEH-JAHORINA (INFOTEH), 2020, pp. 1–5, https://doi.org/10.1109/INFOTEH48170.2020.9066328.

[25] K. R. S. Kodagoda, S. S. Ge, W. S. Wijesoma, and A. P. Balasuriya, “Immpdaf approach for roadboundary tracking,” IEEE Transactions on Vehicular Technology, vol. 56, no. 2, pp. 478–486, 2007, https://doi.org/10.1109/TVT.2007.891426.

[26] A. Escobedo, A. Spalanzani, C. Laugier et al., “Experimental setup for human aware navigation,” in Control Architectures of Robots, 2012, http://hal.inria.fr/hal-00746567/.

[27] S. Morishita, A. Nishimura, and H. Asama, “A method to estimate destination of a walking person with hidden markov model for safety of human friendly robots,” in Safety, Security and Rescue Robotics, 2008. SSRR 2008. IEEE International Workshop on, 2008, pp. 115–120, https://doi.org/10.1109/SSRR.2008.4745887.

[28] J. Ko and D. Fox, “Gp-bayesfilters: Bayesian filtering using gaussian process prediction and observation models,” Autonomous Robots, vol. 27, no. 1, pp. 75–90, 2009, https://doi.org/10.1007/s10514-009-9119-x.

[29] J. Ko and D. Fox, “Gp-bayesfilters: Bayesian filtering using gaussian process prediction and observation models,” in 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2008, https://doi.org/10.1109/iros.2008.4651188.

[30] C. Plagemann, D. Fox, and W. Burgard, “Efficient failure detection on mobile robots using particle filters with gaussian process proposals,” in Proc. of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI), 2007, https://dl.acm.org/doi/10.5555/1625275.1625628.

[31] A. Fod, A. Howard, and M. Mataric, “A laser-based people tracker,” in Proceedings. ICRA’02. IEEE International Conference on Robotics and Automation, 2002., vol. 3, 2002, pp. 3024–3029, https://doi.org/10.1109/ROBOT.2002.1013691.

[32] M. F. Bugallo, S. Xu, and P. M. Djuric, “Comparison of ekf- and pf-based methods in tracking maneuvering targets,” in 2006 IEEE Aerospace Conference, 2006, https://doi.org/10.1109/AERO.2006.1655921.

[33] C. Guestrin, A. Krause, and A. Singh, “Near-optimal sensor placements in gaussian processes,” in Proceedings of the 22nd international conference on Machine learning, 2005, pp. 265–272, https://doi.org/10.1145/1102351.1102385.

[34] R. De Maesschalck, D. Jouan-Rimbaud, and D. L. Massart, “The mahalanobis distance,” Chemometrics and Intelligent Laboratory Systems, vol. 50, no. 1, pp. 1–18, 2000, https://doi.org/10.1016/S0169-7439(99)00047-7.

[35] Z. Zainudin, M. M. Ibrahim, and S. Kodagoda, “Non-parametric data optimization for 2d laser based people tracking,” in 12th IEEE Conference on Industrial Electronics and Applications (ICIEA), 2017, pp. 1887–1892, https://doi.org/10.1109/ICIEA.2017.8283146.

[36] Z. Zainudin, S. Kodagoda, and G. Dissanayake, “Mutual information based data selection in gaussian processes for 2d laser range finder based people tracking,” in 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2013, pp. 477–482, https://doi.org/10.1109/AIM.2013.6584137.

[37] G. Schay, Introduction to probability with statistical applications. Birkhauser, 2007, https://doi.org/10.1007/978-3-319-30620-9.

[38] C. E. Rasmussen and C. K. I. Williams, Gaussian processes for machine learning. MIT press Cambridge, 2006, https://books.google.co.id/books?id=Tr34DwAAQBAJ.

[39] A. Girard, C. E. Rasmussen, J. Q. Candela, and R. Murray-Smith, “Gaussian process priors with uncertain inputs - application to multiple-step ahead time series forecasting,” in Advances in Neural Information Processing Systems, 2002, pp. 529–536, https://proceedings.neurips.cc/paper/2002/hash/f3ac63c91272f19ce97c7397825cc15f-Abstract.html.

[40] Z. Zainudin, S. Kodagoda, and G. Dissanayake, “Torso detection and tracking using a 2d laser range finder,” in Proceedings of the Australasian Conference on Robotics and Automation, 2010, http://hdl.handle.net/10453/16405.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Zulkarnain Zainudin, Sarath Kodagoda

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 


About the JournalJournal PoliciesAuthor Information

International Journal of Robotics and Control Systems
e-ISSN: 2775-2658
Website: https://pubs2.ascee.org/index.php/IJRCS
Email: ijrcs@ascee.org
Organized by: Association for Scientific Computing Electronics and Engineering (ASCEE)Peneliti Teknologi Teknik IndonesiaDepartment of Electrical Engineering, Universitas Ahmad Dahlan and Kuliah Teknik Elektro
Published by: Association for Scientific Computing Electronics and Engineering (ASCEE)
Office: Jalan Janti, Karangjambe 130B, Banguntapan, Bantul, Daerah Istimewa Yogyakarta, Indonesia