Teaching code

4S00254

Academic staff

Paolo Dai Pra, Luca Di Persio

Coordinator

Paolo Dai Pra

Credits

6

Language

Italian

Scientific Disciplinary Sector (SSD)

MAT/06 - PROBABILITY AND STATISTICS

Period

I semestre dal Oct 1, 2019 al Jan 31, 2020.

Lessons timetable Moodle Seminars 0

Learning outcomes

Stochastic Systems [ Applied Mathematics ]
AA 2018/2019

The Stochastic Systems course aims at giving an introduction to the basic concepts underlying the rigorous mathematical description of the temporal dynamics for random quantities.

The course prerequisites are those of a standard course in Probability, for Mathematics / Physics.

It is supposed that students are familiar with the basics Probability calculus, in the Kolmogorov assiomatisation setting, in particular with respect to the concepts of density function, probability distribution, conditional probability, conditional expectation for random variables, measure theory (basic ), characteristic functions of random variables, convrgence theorems (in measure, almost everywhere, etc.), central limit theorem and its (basic) applications, etc.

The Stochastic Systems course aims, in particular, to provide the basic concepts of: Filtered probability space, martingale processes, stopping times, Doob theorems, theory of Markov chains in discrete and continuous time (classification of states, invariant and limit,measures, ergodic theorems, etc.), basics on queues theory and an introduction to Brownian motion.

A part of the course is devoted to the computer implementation of operational concepts underlying the discussion of stochastic systems of the Markov chain type, both in discrete and continuous time.

A part of the course is dedicated to the introduction and the operational study, via computer simulations, to univariate time series.

It is important to emphasize how the Stochastic Systems course is organized in such a way that students can concretely complete and further develop their own:
° capacity of analysis, synthesis and abstraction;
° specific computational and computer skills;
° ability to understand texts, even advanced, of Mathematics in general and Applied Mathematics in particular;
• ability to develop mathematical models for physical and natural sciences, while being able to analyze its limits and actual applicability, even from a computational point of view;
° skills concerning how to develop mathematical and statistical models for the economy and financial markets;
° capacity to extract qualitative information from quantitative data;
° knowledge of programming languages or specific software.

Program

Stochastic Systems [ Applied Mathematics ]
AA 2018/2019 Syllabus

1) Markov chains with discrete time and finite state space: irreducibility and aperiodicity, stationary distributions, classification of states, MCMC.

2) Markov chains with countable state space: recurrence, positivity.

3) The Poisson process and other counting processes. Introduction to queuing theory.

4) Markov chains with finite state space and continuous time: associated semigroup, generator, stationary distributions, Kolmogorov equations, rate of convergence to equilibrium and functional inequalities,

Examination Methods

Stochastic Systems [ Applied Mathematics ]
AA 2018/2019

The course is diveded into the following three parts

1) Theory of stochastic systems
2) Introduction to time-series analysis
3) Computer exercises ( mainly based on the theory of Markov Chains, in discrete as well in continuous time )

Part (2) will be mainly performed in laboratory mode, using computer equipped classrooms, with the possibility, for each student to use a computer in order to implement , real time, the models proposed during the lesson. This activity will be supported by a tutor for a total amount of 24 (frontal) hours.

Part (3) will be taught by Prof. Caliari in a computer equipped laboratory.

The exam will be subdivided into the following three parts

* a written exam concerning point (1)
* a project presented in agreement with the programme developed with prof. Marco Caliari (point 3)
* exercises and a project concerning point (2)

The programme concerning the written exam, with respect to point (1), is the one reported in the Program section.
The project to be presented with prof. Caliari has to be decided with him.
The project to be presented with respect to point (2), will be chosen, by each student, within the the following list

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@Projects
@
@Warning: Since the list of projects may vary during the year, Students are warmly invited to directly contact prof. Di @Persio in order to choose the right project to develop, within the list of arguments that will be actually developed @during laboratory hours
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@

1-Compare the following methods of estimate and/or elimination of time series trends

*First order differences study
*Smoothing with moving average filter
*Fourier transform
*Exponential Smoothing
*Polynomial Data fitting

2- Describe and provide a numerical implementation of the one-step predictor for the following models

FIR(4)
ARX(3,1)
OE(3,1)
ARMA(2,3)
ARMAX(2,1,2)
Box-Jenkins(nb,nc,nd,nf)

3- Compare the Prediction Error Minimization (PEM) and the Maximum Likelihood (ML) approach for the identification of the model parameters (it requires a personal effort in the homes ML)

4- Provide a concrete implementation for the k-fold cross-validation, e.g. using Matlab/Octave, following the example-test that has been given during the lessons

5-Detailed explanation of (at least) one of the following test
*Shapiro-Wilk
*Kolmogorov-Smirnov
*Lilliefors

Practical implementation of the project chosen by the student can be realized exploiting one of the following software frameworks : R, Python, Matlab, Gnu Octave, Excel

The final grade, expressed in thirtieths, will result from the following formula
Rating = (5/6) * T + (1/6) * E + P
where
T is the mark out of 30 on the part of Theory (written exam with prof. Di Persio)
It is the mark out of 30 on the part of Exercises (oral exam with prof. Caliari)
P is a score within the range [0,2]

It is important to emphasize how the objectives of the exam are also centered on assessing the individual student's ability to:

° carry out technical tasks defined in the model-mathematical settings;
° extract qualitative information from quantitative data with particular reference to the analysis of historical series, the study and the realization of predictive models, the development of automatic processes in the analysis of random phenomena;
° use computer/software tools such as R, Matlab, Gnu Octave, etc. , to realize models analyzed in the course and / or implemented in laboratory hours.