Parallel Programming (2021/2022)
Scientific Disciplinary Sector (SSD)
INF/01 - INFORMATICS
The teaching is organized as follows:
This course aims at providing theoretical and practical knowledge about programming and analysis of advanced computational architectures, with emphasis on multiprocessor and GPU platforms. At the end of the course the student will have to demonstrate the ability to apply the knowledge necessary to: identify techniques for parallel programming, also in a research context, through analysis of application efficiency and by considering both functional and non-functional design constraints (correctness, performance, energy consumption). This knowledge will allow the student to be able to analyze performance and to perform code profiling, by identifying critical zone and the corresponding optimizations by considering the architectural characteristics of the platform. At the end of the course the student will be able to compare parallel patterns and to select the best one by considering the use case; by defining the structure of the optimized code, demonstrate the ability to identify the proper architectural choices, by considering the target application and platform contexts. During the definition of the optimized code structure, the student will have the ability to continue the study autonomously in the field of the parallel programming languages and of the Software development for parallel embedded platforms.
- Parallel architectures
- Parallel programming models
- Performance measurement
- Perspective on Parallel Programming
- Designing parallel programs
- GPUs and CUDA:
overview , parallel programming model, threads
- Graph algorithms on GPUs
data representations: Adj. matriX/lists, edge lists
Parallel algorithms for graph traversal (BFS)
Parallel algorithms for graph analysis (SSSP, APSP)
Parallel algorithms for graphs: load balancing and memory accesses: issues and management
To pass the exam, the student has to demonstrate:
- he/she has understood the principles related to the parallel programming
- he/she is able to describe the concepts in a clear and exhaustive way without digressions
- he/she is able to apply the acquired knowledge to solve application scenarios described by means of exercises, questions and projects.
The exam consists of a written test, which contains questions with multiple answers, questions with open answers, and exercises related both the theoretical and lab modules. The student can elaborate a project assigned by the teacher for a bonus (up to +5 points).