Course
Dual DegreeSemester
ElectivesSubject Code
AV493Subject Title
Machine Learning for Signal ProcessingSyllabus
Introduction: Representing text, Sounds and Images text, speech, image, and video. Signal processing for feature extraction: for Text (BoW), Speech (LPC, Mel-frequency Capstral coefficients, STFT and Wavelet features), Images (HoG, BoVW, FV), Videos (BoVW). Machine Learning basics - Introduction to pattern recognition, Bayesian decision theory, supervised learning from data, parametric and non parametric estimation of density functions, Bayes and nearest neighbor classifiers, introduction to statistical learning theory, empirical risk minimization, discriminant functions, learning linear discriminant functions, Perceptron, linear least squares regression, LMS algorithm, Supervised and Unsupervised learning, Classification and Regression (linear models), Evaluation metrics, Probability Models and Expectation-Maximization Algorithm, Gaussian Mixture Models, Neural Networks and Deep Learning, Multi-class classification and Multilabel classification, Different kinds of non-linearities, objective functions, and learning methods, ML for Audio Classification, Time Series Analysis, LSTMs, and CNNs, ML for Speech Recognition, Hidden Markov Models, Finite State Transducers and Dynamic Programming, ML for Music Information Retrieval, Latent Variable Models, Matrix Factorization and Signal Separation, ML for Image Processing, Transfer Learning, Attention models, Attribute-based learning, ML for Communication, Deep learning for wireless applications
Text Books
1. Pattern Classification (Pt.1) 2nd Edition, by Richard O. Duda (Author), Peter E. Hart (Author), David G. Stork (Author)
2. “Pattern Recognition and Machine Learning”, C.M. Bishop, 2nd Edition, Springer, 2011.
3. Sergios Theodoridis, "Machine Learning: A Bayesian and Optimization Perspective". Elsevier, 2015.
References
1. Deep Learning By Ian Goodfellow, Yoshua Bengio, Aaron Courville Online book, 2017
2. Neural Networks and Deep Learning By Michael Nielsen Online book, 2016
3. Deep Learning with Python By J. Brownlee
4. Deep Learning Step by Step with Python: A Very Gentle Introduction to Deep Neural Networks for Practical Data Science By N. D. Lewis
5. “Pattern Recognition and Machine Learning”, C.M. Bishop, 2nd Edition, Springer, 2011.
6. “Machine Learning for Audio, Image and Video Analysis”, F. Camastra, Vinciarelli, Springer, 2007. link http://www.dcs.gla.ac.uk/~vincia/textbook.pdf
7. "Automatic Speech Recognition: A Deep Learning Approach", D. Yu and L. Deng, Springer, 2016.
8. Aurelio Uncini, "Introduction to Adaptive Algorithms and Machine Learning", 2018 .
9. Kevin P. Murphy, "Machine Learning: A Probabilistic Perspective". The MIT Press, 2012.97
10. Sergios Theodoridis, "Machine Learning: A Bayesian and Optimization Perspective". Elsevier, 2015.
11. Danilo Comminiello and José C. Príncipe (Eds.), "Adaptive Learning Methods for Nonlinear System Modeling". Elsevier, 2018