- eBook:Machine Learning: A Bayesian and Optimization Perspective, 2nd Edition
- Author:Sergios Theodoridis
- Edition:2 edition
- Data:July 31, 2020
- Pages:1160 pages
This palette of techniques concludes with an extended chapter on neural networks and deep learning architectures. The book also covers the fundamentals of statistical parameter estimation, Wiener and Kalman filtering, convexity and convex optimization, including a chapter on stochastic approximation and the gradient descent family of algorithms, presenting related online learning techniques as well as concepts and algorithmic versions for distributed optimization.
Focusing on the physical reasoning behind the mathematics, without sacrificing rigor, all the various methods and techniques are explained in depth, supported by examples and problems, giving an invaluable resource to the student and researcher for understanding and applying machine learning concepts. Most of the chapters include typical case studies and computer exercises, both in MATLAB and Python.
The chapters are written to be as self-contained as possible, making the text suitable for different courses: pattern recognition, statistical/adaptive signal processing, statistical/Bayesian learning, as well as courses on sparse modeling, deep learning, and probabilistic graphical models.
New to this edition:
- Complete re-write of the chapter on Neural Networks and Deep Learning to reflect the latest advances since the 1st edition. The chapter, starting from the basic perceptron and feed-forward neural networks concepts, now presents an in depth treatment of deep networks, including recent optimization algorithms, batch normalization, regularization techniques such as the dropout method, convolutional neural networks, recurrent neural networks, attention mechanisms, adversarial examples and training, capsule networks and generative architectures, such as restricted Boltzman machines (RBMs), variational autoencoders and generative adversarial networks (GANs).
- Expanded treatment of Bayesian learning to include nonparametric Bayesian methods, with a focus on the Chinese restaurant and the Indian buffet processes.
CHAPTER 2. Probability and Stochastic Processes
CHAPTER 3. Learning in Parametric Modeling: Basic Concepts and Directions
CHAPTER 4. Mean-Square Error Linear Estimation
CHAPTER 5. Online Learning: the Stochastic Gradient Descent Family of Algorithms
CHAPTER 6. The Least-Squares Family
CHAPTER 7. Classification: a Tour of the Classics
CHAPTER 8. Parameter Learning: a Convex Analytic Path
CHAPTER 9. Sparsity-Aware Learning: Concepts and Theoretical Foundations
CHAPTER 10. Sparsity-Aware Learning: Algorithms and Applications
CHAPTER 11. Learning in Reproducing Kernel Hilbert Spaces
CHAPTER 12. Bayesian Learning: Inference and the EM Algorithm
CHAPTER 13. Bayesian Learning: Approximate Inference and Nonparametric Models
CHAPTER 14. Monte Carlo Methods
CHAPTER 15. Probabilistic Graphical Models: Part I
CHAPTER 16. Probabilistic Graphical Models: Part II
CHAPTER 17. Particle Filtering
CHAPTER 18. Neural Networks and Deep Learning
CHAPTER 19. Dimensionality Reduction and Latent Variable Modeling
Download Machine Learning: A Bayesian and Optimization Perspective, 2nd Edition PDF or ePUB format free