Verifying Properties of Binarized Deep Neural Networks

作者: Leonid Ryzhyk , Nina Narodytska , Shiva Prasad Kasiviswanathan , Mooly Sagiv , Toby Walsh

DOI:

关键词:

摘要: Understanding properties of deep neural networks is an important challenge in learning. In this paper, we take a step direction by proposing rigorous way verifying popular class networks, Binarized Neural Networks, using the well-developed means Boolean satisfiability. Our main contribution construction that creates representation binarized network as formula. encoding first exact network. Using encoding, leverage power modern SAT solvers along with proposed counterexample-guided search procedure to verify various these networks. A particular focus will be on critical property robustness adversarial perturbations. For property, our experimental results demonstrate approach scales medium-size used image classification tasks. To best knowledge, work

参考文章(23)
Gilles Audemard, Laurent Simon, Predicting learnt clauses quality in modern SAT solvers international joint conference on artificial intelligence. pp. 399- 404 ,(2009)
Stephen G. Nash, Ariela Sofer, Igor Griva, Linear and Nonlinear Optimization ,(2009)
Luca Pulina, Armando Tacchella, Challenging SMT solvers to verify neural networks Ai Communications. ,vol. 25, pp. 117- 135 ,(2012) , 10.3233/AIC-2012-0525
K. L. McMillan, Interpolation and SAT-Based Model Checking computer aided verification. pp. 1- 13 ,(2003) , 10.1007/978-3-540-45069-6_1
Pavel Pudlák, Lower Bounds for Resolution and Cutting Plane Proofs and Monotone Computations Journal of Symbolic Logic. ,vol. 62, pp. 981- 998 ,(1997) , 10.2307/2275583
Carsten Sinz, Towards an Optimal CNF Encoding of Boolean Cardinality Constraints Principles and Practice of Constraint Programming - CP 2005. pp. 827- 831 ,(2005) , 10.1007/11564751_73
Y. Lecun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition Proceedings of the IEEE. ,vol. 86, pp. 2278- 2324 ,(1998) , 10.1109/5.726791
Edmund Clarke, Orna Grumberg, Somesh Jha, Yuan Lu, Helmut Veith, Counterexample-guided abstraction refinement for symbolic model checking Journal of the ACM. ,vol. 50, pp. 752- 794 ,(2003) , 10.1145/876638.876643
Nicolas Papernot, Patrick McDaniel, Somesh Jha, Matt Fredrikson, Z. Berkay Celik, Ananthram Swami, The Limitations of Deep Learning in Adversarial Settings ieee european symposium on security and privacy. pp. 372- 387 ,(2016) , 10.1109/EUROSP.2016.36
Seyed-Mohsen Moosavi-Dezfooli, Alhussein Fawzi, Pascal Frossard, DeepFool: A Simple and Accurate Method to Fool Deep Neural Networks computer vision and pattern recognition. pp. 2574- 2582 ,(2016) , 10.1109/CVPR.2016.282