OPTIMIZATION AND LEARNING VIA STOCHASTIC GRADIENT SEARCH

This book explains gradient-based stochastic optimization, exploiting the methodologies of stochastic approximation and gradient estimation. Although the approach is theoretical, the book emphasizes developing algorithms that implement the methods. The underlying philosophy of this book is that when solving real problems, mathematical theory, the art of modeling, and numerical algorithms complement each other, with no one outlook dominating the others. The book first covers the theory of stochastic approximation including advanced models and state-of-the-art analysis methodology, treating applications that do not require the use of gradient estimation. It then presents gradient estimation, developing a modern approach that incorporates cutting-edge numerical algorithms. Finally, the book culminates in a rich set of case studies that integrate the concepts previously discussed into fully worked models. The use of stochastic approximation in statistics and machine learning is discussed, and in-depth theoretical treatments for selected gradient estimation approaches are included. Numerous examples show how the methods are applied concretely, and end-of-chapter exercises enable readers to consolidate their knowledge. Many chapters end with a section on "Practical Considerations" that addresses typical tradeoffs encountered in implementation. The book provides the first unified treatment of the topic, written for a wide audience that includes researchers and graduate students in applied mathematics, engineering, computer science, physics, and economics.