Teaching code

4S004553

Teacher

Pietro Sala

Coordinatore

Pietro Sala

Credits

6

Language

English

Scientific Disciplinary Sector (SSD)

INF/01 - INFORMATICS

Period

II sem. dal Mar 1, 2017 al Jun 9, 2017.

Moodle Seminars

Learning outcomes

Knowledge and understanding

The course aims to introduce principles that form the foundations of the Decision Support System with particular focus on their use in Biomedical applications.

Applying knowledge and understanding

During the course students will aquire the following competences:
- they will be able to choose and use the appropriate components in order to provide solution for supporting decision to the medical staff;
- they will be able torealize complex operations of Extraction, Transformation, and Loading (ETL) on several clinical data types coming from different sources (Relational Databases, API, Websites, and so on)
and encoded in both structure (relational tables)
and semi-structured (XML) fashion;
-they will be able to model and realize OLAP (On-Line Analytical Processing) solutions for supportuing decisions in a Biomedical context;
-they will be able to use or adapt advanced data-mining techniques (Approximate Functional Dependencies, Association Rules, Entropy-based Classifiers, and so on) for extracting knowledge from large amounts of data.

Making judgements

Allo studente verranno fornite le conoscenze necessarie per gestire in modo autonomo:
- la scelta e applicazione delle tecniche di data mining per l'estrazione di sapere medico da grosse quantità di dati;
- la scelta delle rappresentazioni grafiche e interattive più appropriate per la visualizzazione di determinate informazioni in ambito clinico.

Students will develop the required skills in order to be autonomous in the following tasks:

- choose and apply data mining techniques for extracting medical knowledge from large amount of data;
- choose the appropriate graphical/interactive representations for represent specific clinical information.

Communication skills

The students will be able to effectively use use BPMN as a medium for representing clinical processes as well as
ETL processes.

Learning skills

The students will be introduced to the main algorithms and techniques used in the clinical data mining field,
together with the description of the factors that affect their efficiency and effectiveness.
This knowledge will be the basis for comprehend more specific techniques adopted nowadays
for data mining for clinical domain.

Program

Functional Dependencies (FD):
concepts and applications of FDs, forcing and verifying FDs in PostgreSQL

Approximate Functional Dependencies (AFD):
introducing approximation in FDs as confidence measure. Clinical knowledge extraction using AFD: examples. AFD analysis in the biomedical context.

Algorithms for extracting AFDs:
minimal AFDs: definition, semantics and analysis. Theoretical Lower Bounds on the number of minimal AFD: the curse of cardinality. Basic algorthm for extracting minimal AFD. Compact representations of
sets of extracte AFDs. Randomized algorithms for extracting minimal AFDs:
theory and implementation.

Approximation in presence of measures:
Delta Functional Dependencies (DFDs) : definition, application, and verification. Analysis of DFDs extracted from the biomedical domain. Approximated DFDs
(ADFD):
definition, applications and analysis in the biomedical domain (examples). Algorithm for verifying single ADFD restricted to the case of 2 measures (2ADFD):
complexity, implementation. Extraction of minimal 2ADFD from clinical data.

Association Rules (ARs):
definition, examples in the biomedical domain. Extraction of di AR: support and confidence. Theoretical analysis: the curse of cardinality. Frequent Itemsets (FIs): definition, role in the extraction
of ARs, and algorithm for vandidates generation. ARs extraction from sets of FIs. Sets of FIs: minimal sets, closed sets.
Strategies for exploring FIs lattices. Alternatives to standard extraction algorithm using specific data structures (hash trees, FP-trees). Evaluation of association patterns: drawbacks of the support/confidence framework. Examples of paradoxes. alternative measures for association pattern analysis:
definition and examples.

Extraction Transformation and Loading (ETL):
definition, functions, role inside a data warehouse, data flows. Basic entities of ETL procedures and how they work: Job, Transformations, Job, Step, Transformation Step. Conceptual modelling of ETL procedures in Business Process Model and Notation (BPMN). Modelling examples: case studies. Embedding external procedures into ETL procedures: comunication, staging and managing of errors. API (Application Programming Interface) usage inside ETL procedures. Short description of XPATH constructs and how to use them. Screen scraping of websites in ETL procedures by using XPATH. Using Business Intellingence tools to realize ETL procedures.

Entropy-based classifiers:
introduction to the concept of Entropy. Decision Trees in the biomedical context. The Iterative Dichotomiser 3 (ID3) classifier: algorithm, examples and implementation. Measures discretization. Using ID3 for discretizing measures:
problems, modification and implementation. Temporal analysis application to adverse drug reactions.

Reporting and OLAP (Online Analytical Processing):
Interactive reporting systems: querying the clinical databases, parametrization of the reports. Dynamic retrieval of report information by using ETAL transformation. Modelling analysis using OLAP cubes and theri implementation: case studies. Using Business Intellingence tools to realize dynamic/interactive reports and OLAP cubes

SUGGESTED TEXTS:

DJ Hand, H Mannila, P Smyth
Principles of data mining
MIT Press Cambridge, MA, USA ©2001
ISBN:0-262-08290-X 9780262082907

Roland Bouman, Jos van Dongen
Pentaho Solutions: Business Intelligence and Data Warehousing with Pentaho and MySQL
Wiley Publishing, Inc.
ISBN: 978-0-470-48432-6
648 pages
September 2009

Fulton, Hal and Olsen, Russ
The ruby way: solutions and techniques in ruby programming, third edition
Addison-Wesley Professional ©2014
ISBN:0-321-71463-6

COURSE MATERIAL:

class slides;
example data (in .csv format) for completing the exercises proposed during classes;
implementation of the procedures introduced during the course.

Examination Methods

The exam modality aims to verify the autonomy and the skills of the student
in applying the concepts provided during the course for realising Decision Support Systems.
The exam consists of an interview on the implementation
of two projects assigned during classes, one for each macro-topic of the course:
1) Data Mining;
2) OLAP Analysis.
The two projects must be realised individually. Moreover, a necessary but not sufficient condition
for passing the exam is that both the implementations of the projects must be complete. In particular, each project will be evaluated on a scale going from 1 to 15 included, the final grade is given by the sum of the two individual
project grades.

There is no difference in the exam modality between students that attended the course and students that did not.

Bibliography