Cursive Handwritten Segmentation and Recognition for Instructional Videos

作者: Ali Shariq Imran , Sukalpa Chanda , Faouzi Alaya Cheikh , Katrin Franke , Umapada Pal

DOI: 10.1109/SITIS.2012.33

关键词: Blackboard (design pattern)Text segmentationSearch engine indexingHandwritingHandwriting recognitionComputer scienceCursiveSegmentationSpeech recognitionImage segmentation

摘要: In this paper, we address the issues pertaining to segmentation and recognition of cursive handwritten text from chalkboard lecture videos. Recognizing is a challenging problem in instructor-led video. The task gets even tougher with varying handwriting styles blackboard type. Unlike on whiteboard electronic boards, represents serious challenges such as, lack uniform edge density, weak chalk contrast against leftover dust noise as result erasing -- many others. Moreover, color boards illumination changes within video makes it impossible use trivial thresholding techniques, for extraction content. Many universities throughout world still heavily rely mode instruction. Therefore, recognizing these content will not only aid indexing retrieval applications but also help understand high level semantics, useful Multi-media Learning Objects (MLO). order encounter those adversaries, here propose system We first create foreground model segment background blackboard. then characters using one-dimensional vertical histogram. Later, extract gradient based features classify an SVM classifier. obtained encouraging accuracy 86.28% 5-fold cross validation.

参考文章(15)
Liu Jianzhuang, Li Wenqing, Tian Yupeng, Automatic thresholding of gray-level pictures using two-dimension Otsu method china international conference on circuits and systems. pp. 325- 327 ,(1991) , 10.1109/CICCAS.1991.184351
Ting-Fan Wu, Chih-Jen Lin, Ruby Weng, None, Probability Estimates for Multi-class Classification by Pairwise Coupling Journal of Machine Learning Research. ,vol. 5, pp. 975- 1005 ,(2004) , 10.5555/1005332.1016791
Umapada Pal, Nabin Sharma, Tetsushi Wakabayashi, Fumitaka Kimura, Handwritten Numeral Recognition of Six Popular Indian Scripts international conference on document analysis and recognition. ,vol. 2, pp. 749- 753 ,(2007) , 10.1109/ICDAR.2007.4377015
C. Choudary, Tiecheng Liu, Summarization of Visual Content in Instructional Videos IEEE Transactions on Multimedia. ,vol. 9, pp. 1443- 1455 ,(2007) , 10.1109/TMM.2007.906602
A. Prati, I. Mikic, M.M. Trivedi, R. Cucchiara, Detecting moving shadows: algorithms and evaluation IEEE Transactions on Pattern Analysis and Machine Intelligence. ,vol. 25, pp. 918- 923 ,(2003) , 10.1109/TPAMI.2003.1206520
M. Liwicki, H. Bunke, Combining On-Line and Off-Line Systems for Handwriting Recognition international conference on document analysis and recognition. ,vol. 1, pp. 372- 376 ,(2007) , 10.1109/ICDAR.2007.4378734
Lijun Tang, J.R. Kender, Semantic Indexing for Instructional Video Via Combination of Handwriting Recognition and Information Retrieval international conference on multimedia and expo. pp. 920- 923 ,(2005) , 10.1109/ICME.2005.1521574
Rafael MO Cruz, George DC Cavalcanti, Tsang Ing Ren, None, An ensemble classifier for offline cursive character recognition using multiple feature extraction techniques international joint conference on neural network. pp. 1- 8 ,(2010) , 10.1109/IJCNN.2010.5596482
M. Wienecke, G.A. Fink, G. Sagerer, Towards automatic video-based whiteboard reading international conference on document analysis and recognition. pp. 87- 91 ,(2003) , 10.1109/ICDAR.2003.1227633
Suneeta V Budihal, R.M. Banakar, An Off Line Cursive Script Recognition System Using Fourier -Wavelet Features computational intelligence. ,vol. 2, pp. 506- 510 ,(2007) , 10.1109/ICCIMA.2007.81