Automated synchronization of driving data using vibration and steering events

作者: Lex Fridman , Daniel E. Brown , William Angell , Irman Abdić , Bryan Reimer

DOI: 10.1016/J.PATREC.2016.02.011

关键词: Data streamSynchronizationFrame synchronization (video)Computer scienceSynchronization (computer science)Context (language use)Real-time computingData bufferAdvanced driver assistance systemsOptical flow

摘要: A passive synchronization method for driving data is proposedSynchronization of vehicle sensors uses vibration and steering events.Dense optical flow video used to capture significant car vibrations events.Cross correlation sensor pairs achieves 13.5ms accuracy. We propose a automated useful the study multi-modal driver behavior design advanced assistance systems. Multi-sensor decision fusion relies on synchronized streams in (1) offline supervised learning context (2) online prediction context. In practice, such are often out sync due absence real-time clock, use multiple recording devices, or improper thread scheduling buffer management. Cross-correlation accelerometer, telemetry, audio, dense from three achieve an average error 13 milliseconds. The insight underlying effectiveness proposed approach that described overlapping aspects allowing cross-correlation function serve as way compute delay shift each sensor. Furthermore, we show decrease duration stream.

参考文章(18)
Gunnar Farnebäck, Two-frame motion estimation based on polynomial expansion scandinavian conference on image analysis. ,vol. 2749, pp. 363- 370 ,(2003) , 10.1007/3-540-45103-X_50
Volker Grabe, Heinrich H. Bülthoff, Davide Scaramuzza, Paolo Robuffo Giordano, Nonlinear ego-motion estimation from optical flow for online control of a quadrotor UAV The International Journal of Robotics Research. ,vol. 34, pp. 1114- 1135 ,(2015) , 10.1177/0278364915578646
E Olson, A passive solution to the sensor synchronization problem intelligent robots and systems. pp. 1059- 1064 ,(2010) , 10.1109/IROS.2010.5650579
C. Knapp, G. Carter, The generalized correlation method for estimation of time delay IEEE Transactions on Acoustics, Speech, and Signal Processing. ,vol. 24, pp. 320- 327 ,(1976) , 10.1109/TASSP.1976.1162830
William Q. Meeker, Yili Hong, Reliability Meets Big Data: Opportunities and Challenges Quality Engineering. ,vol. 26, pp. 102- 116 ,(2014) , 10.1080/08982112.2014.846119
Thomas Plotz, Chen Chen, Nils Y. Hammerla, Gregory D. Abowd, Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation -- A Practical Approach international symposium on wearable computers. pp. 100- 103 ,(2012) , 10.1109/ISWC.2012.15
P.H. Batavia, D.E. Pomerleau, C.E. Thorpe, Overtaking vehicle detection using implicit optical flow ieee intelligent transportation systems. pp. 729- 734 ,(1997) , 10.1109/ITSC.1997.660564