Optimized static and video EEG rapid serial visual presentation (RSVP) paradigm based on motion surprise computation

作者: Deepak Khosla , David J. Huber , Rajan Bhattacharyya

DOI: 10.1117/12.2262911

关键词: ComputationDecoding methodsComputer visionRapid serial visual presentationMotion (physics)Computer scienceSurpriseContextual image classificationArtificial intelligence

摘要: In this paper, we describe an algorithm and system for optimizing search detection performance “items of interest” (IOI) in large-sized images videos that employ the Rapid Serial Visual Presentation (RSVP) based EEG paradigm and surprise algorithms incorporate motion processing to determine whether static or video RSVP is used. The system works by first computing a surprise map on image sub-regions (chips) incoming sensor data then uses those maps label chips as either “static” “moving”. This information tells use a static presentation decoding order optimize IOI each chip. Using method, are able demonstrate classification series regions from with azimuth value of 1, indicating perfect classification, over range display frequencies speeds.

参考文章(8)
Matthew Weiden, Deepak Khosla, Matthew Keegan, Electroencephalographic detection of visual saliency of motion towards a practical brain-computer interface for video analysis international conference on multimodal interfaces. pp. 601- 606 ,(2012) , 10.1145/2388676.2388800
Deepak Khosla, David J. Huber, Online recursive estimation of attention and salient regions in visual scenes Proceedings of SPIE. ,vol. 7696, pp. 769614- ,(2010) , 10.1117/12.850758
Deepak Khosla, David J. Huber, Rajan Bhattacharyya, Mike Daily, Penn Tasinga, Neurally Inspired Rapid Detection of Sparse Objects in videos Proceedings of SPIE. ,vol. 7697, ,(2010) , 10.1117/12.850760
Laurent Itti, Pierre Baldi, Bayesian surprise attracts human attention. Vision Research. ,vol. 49, pp. 1295- 1306 ,(2009) , 10.1016/J.VISRES.2008.09.007
David J. Huber, Deepak Khosla, A bio-inspired method and system for visual object-based attention and segmentation Proceedings of SPIE. ,vol. 7696, pp. 769613- ,(2010) , 10.1117/12.850757
Deepak Khosla, Rajan Bhattacharyya, Penn Tasinga, David J. Huber, Optimal detection of objects in images and videos using electroencephalography (EEG) Proceedings of SPIE. ,vol. 8050, ,(2011) , 10.1117/12.883586
Simon Thorpe, Denis Fize, Catherine Marlot, Speed of processing in the human visual system. Nature. ,vol. 381, pp. 520- 522 ,(1996) , 10.1038/381520A0
A.D. Gerson, L.C. Parra, P. Sajda, Cortically coupled computer vision for rapid image search international conference of the ieee engineering in medicine and biology society. ,vol. 14, pp. 174- 179 ,(2006) , 10.1109/TNSRE.2006.875550