Elements of inference
Tommi Jaakkola, MIT
November 27, 2007
Most engineering and science problems involve modeling. We need inference calculations to draw predictions from the models or to estimate them from available measurements. In many cases the inference calculations can be done only approximately as in decoding, sensor networks, or in modeling biological systems. At the core, inference tasks tie together three types of problems: counting (partition function), geometry (valid marginals), and uncertainty (entropy). Most approximate inference methods can be viewed as different ways of simplifying this three-way combination. Much of recent effort has been spent on developing and understanding distributed approximation algorithms that reduce to local operations in an effort to solve a global problem. In this talk I will provide an optimization view of approximate inference algorithms, exemplify recent advances, and outline some of the many open problems and connections that are emerging due to modern applications.
Tommi Jaakkola received the M.Sc. degree in theoretical physics from Helsinki University of Technology, Finland, and Ph.D. from MIT in computational neuroscience. Following a postdoctoral position in computational molecular biology (DOE/Sloan fellow, UCSC) he joined the MIT EECS faculty 1998. He received the Sloan Research Fellowship 2002. His research interests include many aspects of machine learning, statistical inference and estimation, and algorithms for various modern estimation problems such as those involving multiple predominantly incomplete data sources. His applied research focuses on problems in computational biology such as transcriptional regulation.