URL study guide

https://studiegids.vu.nl/en/courses/2024-2025/XM_40017

Course Objective

At the end of the course, students will be able toUnderstand the main principles of High Performance Computing (Knowledge and understanding)Design and implement efficient parallel algorithms on distributed-memory parallel computers (Applying knowledge and understanding)Recognize and compare different parallel computer architectures (Knowledge and understanding, Making judgements)Make use of different parallel programming models and environments such as MPI and Julia’s task-based distributed-computing model (Applying knowledge and understanding).Analyze the performance of parallel applications and network topologies (Making judgements)Identify the main computational challenges in selected parallel computing applications (Knowledge and understanding)Design parallel algorithms using the Julia Programming Language (Applying knowledge and understanding)

Course Content

This course discusses how to write computer programs that can run in parallel on a large number of processors with the main goal of reducing execution time and solving large problems that cannot fit in a single compute node. You will learn how to design such parallel algorithms in order to minimize communication overhead and load imbalance, how to implement them using different parallel computing models, and how to analyze the performance of the resulting codes and the underlying hardware. Among all parallel programming models and environments available for High Performance Computing, this course focuses on distributed-memory parallelization. You will learn established techniques such as message-passing with MPI, but also more modern approaches like the task-based distributed-computing model provided by the Julia programming language. Several parallel applications are discussed in the course, including partial differential equations, deep learning, N-body simulation, and search algorithms.

Teaching Methods

There are 2 class sessions per week. Part of the course follows the flipped classroom method. Pre-recordings, lecture notes, and exercises are made available in advance for self study, and follow up discussions take place in class meetings to deepen understanding.The course also includes the opportunity to run experiments on the DAS computer cluster.Computer codes used in the course are implemented in the Julia programming language. Previous knowledge of Julia is not required as it will be learned as part of the course.

Method of Assessment

Written exam.

Literature

Course material will be made available on Canvas.

Target Audience

Master Business Analytics Master Computational Science Master Computer Science Master Computer Security

Additional Information

There is also a separate Parallel Programming Practical (6 EC) in Period 3, whose aim is to complement the contents of this course with further practical skills and experience.
Academic year1/09/2431/08/25
Course level6.00 EC

Language of Tuition

  • English

Study type

  • Master