Teaching code

4S003737

Credits

6

Coordinatore

Gloria Menegaz

Language

Italian

Also offered in courses:

• Visual intelligence of the course Master's degree in Computer Science and Engineering
• Visual intelligence - Teoria of the course Master's degree in Computer Science and Engineering
• Visual intelligence - Laboratorio of the course Master's degree in Computer Science and Engineering

Scientific Disciplinary Sector (SSD)

INF/01 - INFORMATICS

Moodle Seminars

The teaching is organized as follows:

Learning outcomes

The course aims at providing competence about analysis, modeling and interpretation of multidimensional signals and images with focus on artificial vision and machine learning aspects, targeting applications in the field of multimedia and interpretable machine learning. At the end of the course the students will be able to autonomously solve typical problems requiring multidimensional signal modeling, feature extraction, analysis and interpretation of the outcomes of machine learning algorithms in the field of multimedia and artificial vision.

Program

The course aims at providing competence about analysis, modeling and interpretation of multidimensional signals and images with focus on artificial vision and machine learning aspects, targeting applications in the field of multimedia and interpretable machine learning. At the end of the course the students will be able to autonomously solve typical problems requiring multidimensional signal modeling, feature extraction, analysis and interpretation of the outcomes of machine learning algorithms in the field of multimedia and artificial vision with particular focus on convolutional neural networks.

Syllabus
The course consists of three blocks: modeling of the Human Visual System (HVS), multiresolution signal representation and analysis of deep learning algorithms with focus Convolutional Neural Networks (CNNs).

Part 1: Human Visual System (HVS) – 10 hours
Introduction to Visual Intelligence
Foudations of vision, stimulus encoding, representation and interpretation
HVS modeling: multiscale processing of the visual stimuli, Contrast Sensitivity Function (CSF), color vision and perception, Color Matching Functions (CMFs)
High-level modeling of the HVS: structural and functional connectivity and graph-based modeling

Part 2: Multiresolution analysis – 20 hours
Background
Mathematical tools
Fourier transform in 1D and 2D
Windowed Fourier Transform
Wavelets and multiresolution representations
Wavelets Bases
Families of Wavelet Transforms (WT) and their properties
Fast Discrete Wavelet Tranforms (DWT)
WT in two dimensions
Scattering transform

Part 3: Application to the analysis and interpretation of deep convolutional neural networks (CNNs)– 10 hours
Overview on CNNs
The issue of interpretability, main approaches
CNN, HVS and multiresolution: getting to a unified view
CNN interpretation based on multiresolution theory and HVS models
Examples of interpretable DL

LABORATORY
Laboratory sessions will consist in Matlab and Python exercises on the topics covered in the theory lessons.

Bibliography

Examination Methods

The exam will consist of a project and a colloquium on the topics of the course.