Program Analysis and Synthesis

Spring 2017
Martin Vechev
Dimitar Dimitrov, Petar Tsankov
EDoz Link
EDoz link
Monday, 1-4pm

The last decade has seen an explosion in modern program analysis and synthesis techniques. These techniques are increasingly being used to reason about a vast range of computational paradigms, from finding security flaws in systems software (e.g., drivers) to automating the construction of programs (e.g., for end user programming), to programmable networks, to reliable machine learning models (e.g., probabilistic programming). This course provides a comprehensive introduction to these methods. The course consists of 3 parts:

Part I: Theory and Practice of Static Analysis
Static analysis is the science of creating precise and scalable finite approximations of potentially infinite behaviors so to enable a machine to automatically reason about these. These behaviors may come from programs but also other dynamic systems (e.g., biological). Hence the theory and principles of static analysis are widely applicable. We will cover:
- concepts: abstract interpretation, abstract domains, precision vs. asymptotic complexity
- applications: JavaScript type checking (as in Facebook's Flow), security analysis, parallelism and concurrency reasoning (e.g., GPU, weak memory).

Part II: Theory and Practice of Synthesis
Modern program synthesis is an approach for automating the construction of programs from (partial) user intent. Recent years have seen exciting breakthroughs in techniques and algorithms that discover complex programs purely from input/output examples, natural language, partial programs (sketches) and many others forms of supervision and intent. Modern program synthesis can be seen as a path towards the ultimate goal of explainable machine learning. We will cover:
- concepts: version spaces, counter-example guided inductive synthesis, SMT solvers.
- applications: programming by example (e.g., Microsoft's FlashFill), programmable networks (e.g., SyNet).

Part III: Programming Languages (PL) and Machine Learning (ML)
We will cover the latest and most exciting developments bridging the areas of machine learning and programming languages. These trends include both directions: (i) PL techniques applied to ML problems, and (ii) ML techniques applies to PL tasks (e.g., reasoning about a program). Here, we will cover:
- concepts: probabilistic programming, advanced neural network architectures (e.g., Neural Turing Machines), program synthesis with noise
- applications: approximate computing, probabilistic code synthesis and de-obfuscation (e.g.,,, enforcing security properties

Connections between Topics
In each of the 3 parts, we will also see how the parts connect. For instance, techniques from Part I are used to compute abstractions that are then fed to techniques from Part III. Similarly, the synthesis techniques from Part II connect with Part III in applications such as enforcing security policies with certain probabilistic guarantees (this has applications to privacy preservation, secure machine learning and other problems).

Course Project
To gain a deeper understanding of how to apply these techniques, the course involves a hands-on programming project. The project description is here PDF, and the project skeleton is here ZIP

Lectures (Tentative Schedule):

No. DateContentSlides Exercises Solutions
1 Feb 20 Motivation, topics, organization PDF PDF Haskell source
Part I: Program Analysis
2 Feb 27 Program Analysis: Foundations and Applications PDF PDF PDF
3 March 6 Intervals (cont.) + Analysis of GPU/HPC programs PDF PDF PDF PDF
4 March 13 Analysis of GPU/HPC programs, Relational Domains PDF PDF PDF PDF
Part II: Program Synthesis
5 March 20 Counter-example guided inductive synthesis (CEGIS), SMT PDF PDF PDF
6 March 27 Synthesis from Examples, Version Spaces PDF PDF PDF
7 April 3Synthesis for Networks Programmability PDF PDF PDF
8 April 10Synthesis for Machine Learning PDF PDF PDF
Part III: Probabilistic Programming and Applications
9, 10 May 8, 15 Probabilistic Programming: Foundations and Security Applications PDF PDF PDF
11 May 22 Neural Abstract Machines (Guest Lecture) PDF
12 May 29 Course Review