Seminar: Stefan Leue (University of Konstanz, Germany), (Some) Formal Guarantees for Deep Neural Networks
Content
Speaker
Stefan Leue (Department of Computer and Information Science, University of Konstanz, Germany)
Abstract
Machine learning models, and in particular deep neural networks (DNNs), are increasingly used as components of critical systems. The applicability of classical semi-formal and formal software and systems verification techniques to these models is limited by the absence of complex logical code structures in DNNs that these techniques rely on. At the same time, legal norms and societal expectations demand dependability guarantees for machine learning models when used in a critical context. In this talk, I will introduce two techniques that provide some formal guarantees for deep neural networks. I will first discuss the SpecRepair approach for specification-based repair. It relies on counterexample search and a penalty-function based fine-tuning of a DNN. I will also present some termination results for this repair method. Next, I will introduce the PV-approach to specification-based probabilistic verification of DNNs. It relies on a branch-and-bound technique that allows for properties such as fairness and network safety to be specified. I will conclude with a discussion of the limits of applicability of these approaches and perspectives for future research.
Bio
Stefan Leue obtained a diploma in Computer Science and Economics from the University of Hamburg (Germany) in 1990 and a PhD in Computer Science from the University of Bern (Switzerland) in 1995. From 1995 to 2000, he was first an Assistant Professor and then an Associate Professor in the Department of Electrical and Computer Engineering at the University of Waterloo (Canada). In 1998, he was a Member of Technical Staff at the Computing and Mathematics Research Centre of Bell Laboratories in Murray Hill (USA). In 2000, he accepted an Associate Professorship of Computer Networks and Telematics at the University of Freiburg (Germany). In 2004, he was appointed Full Professor and holder of the Chair for Software and Systems Engineering at the University of Konstanz (Germany). His visiting
appointments include positions at the Université Joseph Fourier in Grenoble (France), the Swiss Federal Institute of Technology in Zurich (Switzerland), New York University (USA), and TU Wien (Austria). His research interests lie in developing methods for complex systems engineering, with a particular focus on the foundations of formal methods and their application to system safety, machine learning, automotive systems engineering, and legal tech.
Host