A Particle Filter-Based Reinforcement Learning Approach for Reliable Wireless Indoor Positioning

作者: Jose Luis Carrera Villacres , Zhongliang Zhao , Torsten Braun , Zan Li

DOI: 10.1109/JSAC.2019.2933886

关键词: Reinforcement learningReal-time computingEnsemble learningRobustness (computer science)Computer scienceHidden Markov modelIndoor positioning systemParticle filterWirelessComputer Networks and CommunicationsElectrical and Electronic Engineering

摘要: Positioning is envisioned as an essential enabler of future fifth generation (5G) mobile networks due to the massive number use cases that would benefit from knowing users’ positions. In this work, we propose a particle filter-based reinforcement learning (PFRL) approach for robust wireless indoor positioning system. Our algorithm integrates information zone prediction, inertial measurement units, radio-based ranging, and floor plan into filter. The prediction method designed with ensemble by integrating individual discriminative methods Hidden Markov Models. Further, integrate filter learning-based resampling provide robustness against localization failure problems such kidnapping robot problem. PFRL validated on two-tier architecture, in which distributed machine tasks are hosted at client edge layer. Experiment results show our system outperforms traditional terminal-based approaches both stability accuracy.

参考文章(35)
Daisuke Kamisaka, Takafumi Watanabe, Shigeki Muramatsu, Arei Kobayashi, Hiroyuki Yokoyama, Estimating Position Relation between Two Pedestrians Using Mobile Phones Lecture Notes in Computer Science. pp. 307- 324 ,(2012) , 10.1007/978-3-642-31205-2_19
Christopher J.C.H. Watkins, Peter Dayan, Technical Note Q-Learning Machine Learning. ,vol. 8, pp. 279- 292 ,(1992) , 10.1023/A:1022676722315
Zan Li, Torsten Braun, Desislava C. Dimitrova, A time-based passive source localization system for narrow-band signal 2015 IEEE International Conference on Communications (ICC). pp. 4599- 4605 ,(2015) , 10.1109/ICC.2015.7249048
Dieter Fox, Sebastian Burgard, Wolfram, Thrun, Markov localization for mobile robots in dynamic environments Journal of Artificial Intelligence Research. ,vol. 11, pp. 391- 427 ,(1999) , 10.1613/JAIR.616
Noriaki Kakiuchi, Shunsuke Kamijo, Pedestrian dead reckoning for mobile phones through walking and running mode recognition international conference on intelligent transportation systems. pp. 261- 267 ,(2013) , 10.1109/ITSC.2013.6728243
Eckehard Steinbach Sebastian Hilsenbeck, Dmytro Bobkov, Georg Schroth, Robert Huitl, Eckehard Steinbach, S H, G S, ..., None, Graph-based data fusion of pedometer and WiFi measurements for mobile indoor positioning ubiquitous computing. pp. 147- 158 ,(2014) , 10.1145/2632048.2636079
Michael Wallbaum, Otto Spaniol, Indoor Positioning UsingWireless Local Area Networks IEEE John Vincent Atanasoff 2006 International Symposium on Modern Computing (JVA'06). pp. 17- 26 ,(2006) , 10.1109/JVA.2006.28
Genshiro Kitagawa, Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models Journal of Computational and Graphical Statistics. ,vol. 5, pp. 1- 25 ,(1996) , 10.1080/10618600.1996.10474692
Jingbin Liu, Ruizhi Chen, Ling Pei, Robert Guinness, Heidi Kuusniemi, A Hybrid Smartphone Indoor Positioning Solution for Mobile LBS Sensors. ,vol. 12, pp. 17208- 17233 ,(2012) , 10.3390/S121217208