Locally Competitive Algorithms for Sparse Approximation

作者: Christopher Rozell , Don Johnson , Richard Baraniuk , Bruno Olshausen

DOI: 10.1109/ICIP.2007.4379981

关键词:

摘要: Practical sparse approximation algorithms (particularly greedy algorithms) suffer two significant drawbacks: they are difficult to implement in hardware, and inefficient for time-varying stimuli (e.g., video) because produce erratic temporal coefficient sequences. We present a class of locally competitive (LCAs) that correspond collection principles minimizing weighted combination reconstruction MSE cost function. These systems use thresholding functions induce local nonlinear competitions dynamical system. Simple analog hardware can the required nonlinearities competitions. show our LCAs stable under normal operating conditions sparsity levels comparable existing methods. Additionally, these coefficients video sequences more regular (i.e., smoother predictable) than produced by algorithms.

参考文章(14)
Andrea Bacciotti, Lionel Rosier, Liapunov functions and stability in control theory ,(2001)
N. Kingsbury, T. Reeves, Redundant representation with complex wavelets: how to achieve sparsity international conference on image processing. ,vol. 1, pp. 45- 48 ,(2003) , 10.1109/ICIP.2003.1246894
B. K. Natarajan, Sparse Approximate Solutions to Linear Systems SIAM Journal on Computing. ,vol. 24, pp. 227- 234 ,(1995) , 10.1137/S0097539792240406
Luis Mancera, Javier Portilla, L0-Norm-Based Sparse Representation Through Alternate Projections international conference on image processing. pp. 2089- 2092 ,(2006) , 10.1109/ICIP.2006.312819
B OLSHAUSEN, D FIELD, Sparse coding of sensory inputs. Current Opinion in Neurobiology. ,vol. 14, pp. 481- 487 ,(2004) , 10.1016/J.CONB.2004.07.007
Scott Shaobing Chen, David L. Donoho, Michael A. Saunders, Atomic Decomposition by Basis Pursuit SIAM Review. ,vol. 43, pp. 129- 159 ,(2001) , 10.1137/S003614450037906X
E.P. Simoncelli, W.T. Freeman, The steerable pyramid: a flexible architecture for multi-scale derivative computation international conference on image processing. ,vol. 3, pp. 3444- 3444 ,(1995) , 10.1109/ICIP.1995.537667
Martin Rehn, Friedrich T. Sommer, A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields Journal of Computational Neuroscience. ,vol. 22, pp. 135- 146 ,(2007) , 10.1007/S10827-006-0003-9
J.A. Tropp, Greed is good: algorithmic results for sparse approximation IEEE Transactions on Information Theory. ,vol. 50, pp. 2231- 2242 ,(2004) , 10.1109/TIT.2004.834793
E.J. Candes, J. Romberg, T. Tao, Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information IEEE Transactions on Information Theory. ,vol. 52, pp. 489- 509 ,(2006) , 10.1109/TIT.2005.862083