Foundation of data analysis
Scientific Disciplinary Sector (SSD)
MAT/08 - NUMERICAL ANALYSIS
II semestre dal Mar 1, 2021 al Jun 11, 2021.
After successful completion of the module students will be able to understand and apply the basic notions, concepts, and methods of computational linear algebra, convex optimization and differential geometry used for data analysis. In particular, they will master the use of singular value decomposition method as well as random matrices for low dimensional data representations, including fundamentals of sparse recovery problems, as e.g., compressed sensing, low rank matrix recovery, and dictionary learning algorithms. The students will be also able to manage the representation of data as clusters around manifolds in high dimensions and in random graphs, acquiring methods to construct local charts and clusters for the data. In complementary laboratory sessions they will get acquainted with suitable programming tools and environment in order to analyse relevant case studies.
*Introduction to signal processing continuous and discrete
- Fourier Transform, Discrete Fourier Transform, Discrete Time Fourier Transform.
- Fast Fourier Transform algorithm.
- Application to signal and image analysis: denoising, compression.
* Singular Value Decomposition:
- Best k-rank approximation, Randomize SVD
- Principal Component Analysis, Pseudo-Inverse.
* Compressed Sensing
- Basis pursuit problem: l1-minimization and sparse recovery
- Application to signals and images reconstruction.
* Data Analysis
- Dimensionality reduction techniques: (Local Linear Embedding, ISOMAP, diffusion map).
- Supervised learning for classification: Support Vector Machine
- Unsupervised learning for clustering: K-means.
- Artificial Neural Networks and applications.
||A Wavelet Tour of Signal Processing
|| First-Order Methods In Optimization
||MOS-SIAM Series on Optimization
|Avrim Blum, John Hopcroft, Ravi Kannan,
||Foundations of Data Science
||Cambridge University Press
|John A. Lee, Michel Verleysen
||Nonlinear Dimensionality Reduction
The exam consists of an oral examination with written questions and discussion. The development of a project is encouraged (but not mandatory) as an integration of the oral examination.
The online exam is granted for all the students will require it during the academic year 2020/21.