School on Parallel Programming and Parallel Architecture for High Performance Computing

Administration

Description

An ICTP 60^th Anniversary satellite event

Link to lecture material is HERE

This school has the goal of teaching participating scientists basic parallel programming paradigms and tools for scientific computing. Through an intensive programme combining lectures and exercises with focus on practical skills, it shall provide a foundation for future computational research using HPC. The ideal candidate is an early career scientist that either will start soon or has already started working on a research project strongly tied to intensive computing for simulations and/or data analysis. Providing a referral letter from the PI supervising the project is strongly recommended.

Participants will learn fundamental techniques in parallel programming, GPU programming and machine learning. The target is to improve the efficiency of their research workflows, and to parallelize them where possible and meaningful. Lectures are meant to provide an overview and relevant references on the presented topics, while the hands-on sessions will allow participants to practice on small example problems of general scientific interest. The programme specifically addresses the needs of scientists using, writing, or modifying modern workflows for scientific computing. During second week participants will work on applied project of parallel programming of their own choosing if it fits into the scope of the workshop, otherwise assigned by the lecturers on a range of typical problems.

Main presented topics includes foundation of modern HPC:

Building of software environments for scientific computing
Parallel programming tools (MPI & OpenMP)
GPU Computing
Machine Learning
Mixing of compiled and scripting languages

Lecturers:

S. DI GIOIA, ICTP, Italy

I. GIROTTO, ICTP, Italy

A. KOHLMEYER, Temple University, USA
T. NGUYEN, University of Chicago, USA

Grants: A limited number of grants are available to support the attendance of selected participants, with priority given to participants from developing countries. There is no registration fee.

Material

Final list of Participants How to choose your Time Zone Lecture material link on Github Poster group photo

School on Parallel Programming and Parallel Architecture for High Performance Computing | (smr 3935)

Go to day

Monday, 22 April 2024

05:15 - 05:45 Registration

05:45 - 06:15 Arrival of Guests

(Dean, NPS President, MoEST representative)

06:15 - 07:15 Inaugural Session

06:15 National Anthem 2'
06:17 Brief Introduction about the School 4'

Speaker: Ivan GIROTTO (ICTP, Italy)
06:21 Inauguration by the Chief Guest 4'

Speaker: Prof. Dr. Binil ARYAL, Dean (IoST, TU)

06:25 Introduction of the Lecturers 4'

Name and Affiliations

Speaker:

Serafina DI GIOIA (ICTP, Italy), Ivan GIROTTO (ICTP, Italy), Axel KOHLMEYER (Temple University, USA), Trung NGUYEN (University of Chicago, USA)

06:29 Speech by invited Guests 4'

Speaker: MoEST representative, and NPS President
06:33 Speech by ICTP Director 4'

Speaker: Atish DABHOLKAR (ICTP Director, Italy)
06:37 Speech by the Chief Guest 4'
06:41 Role of ICTP, and Vote of thanks 4'

Speaker: Prof. Dr. Narayan PRASAD ADHIKARI (Tribhuvan University, Nepal)
06:45 Coffee Break 30'

07:15 - 13:45
- 07:15 Intro HPC/School 45'
  
  Speaker: Ivan GIROTTO (ICTP, Italy)
- 08:00 Compiled Languages 45'
```
(basics of code compilation) 
```
  Speaker: Ivan GIROTTO (ICTP, Italy), Axel KOHLMEYER (Temple University, USA)
- 08:45 Lunch Break 1h30'
- 10:15 Review of memory allocation and pointers 1h30'
  
  Speaker: Ivan GIROTTO (ICTP, Italy), Axel KOHLMEYER (Temple University, USA)
- 11:45 Coffee Break 30'
- 12:15 Examples for learning pointers 1h30'
  
  Speaker: Ivan GIROTTO (ICTP, Italy), Axel KOHLMEYER (Temple University, USA)

Tuesday, 23 April 2024
- 05:15 - 13:45
  - 05:15 Thinking in Parallel: Parallel Programming 101 1h30'
    
    Speaker: Axel KOHLMEYER (Temple University, USA)
  - 06:45 Coffee Break 30'
  - 07:15 Distributed Parallel Programming using MPI 1h30'
    
    Speaker: Ivan GIROTTO (ICTP, Italy)
  - 08:45 Lunch Break 1h30'
  - 10:15 Lab session: Distributed Parallel Programming using MPI 1h30'
    
    Speaker: Ivan GIROTTO (ICTP, Italy)
  - 11:45 Coffee Break 30'
  - 12:15 Lab session: Distributed Parallel Programming using MPI 1h30'
    
    Speaker: Ivan GIROTTO (ICTP, Italy)
Wednesday, 24 April 2024
- 05:15 - 13:45
  - 05:15 Parallel Programming on Shared Memory (Intro to OpenMP) 1h30'
    
    Speaker: Ivan GIROTTO (ICTP, Italy), Axel KOHLMEYER (Temple University, USA)
  - 06:45 Coffee Break 30'
  - 07:15 Overview of accelerated computer architectures/GPGPU Programming using CUDA 1h30'
    
    Speaker: Trung NGUYEN (University of Chicago, USA)
  - 08:45 Lunch Break 1h30'
  - 10:15 Lab session: GPGPU Programming using CUDA 1h30'
    
    Speaker: Trung NGUYEN (University of Chicago, USA)
  - 11:45 Coffee Break 30'
  - 12:15 Lab session: GPGPU Programming using CUDA 1h30'
    
    Speaker: Trung NGUYEN (University of Chicago, USA)
Thursday, 25 April 2024
- 05:15 - 13:45
  - 05:15 GPGPU Advaced Programming using CUDA 1h30'
    
    Speaker: Trung NGUYEN (University of Chicago, USA)
  - 06:45 Coffee Break 30'
  - 07:15 GPGPU Advaced Programming using CUDA 1h30'
    
    Speaker: Trung NGUYEN (University of Chicago, USA)
  - 08:45 Lunch Break 1h0'
  - 09:45 Python 101/SciPy/cuPy 2h0'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 11:45 Coffee Break 30'
  - 12:15 Python 101/SciPy/cuPy 1h30'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
Friday, 26 April 2024
- 05:15 - 13:45
  - 05:15 Intro to Machine Learning 1h30'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 06:45 Coffee Break 30'
  - 07:15 Intro to Machine Learning 1h30'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 08:45 Lunch Break 1h0'
  - 09:45 Lab session: ML 2h0'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 11:45 Coffee Break 30'
  - 12:15 Lab session: ML 1h30'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
Monday, 29 April 2024
- 05:15 - 13:45
  - 05:15 Wrap up on previous week 45'
    
    Speaker: Ivan GIROTTO (ICTP, Italy)
  - 06:00 MPI with Python 45'
    
    Speaker: Axel KOHLMEYER (Temple University, USA)
  - 06:45 Coffee Break 30'
  - 07:15 Basic ML on GPU (cuML) 1h30'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 08:45 Lunch Break 1h30'
  - 10:15 Working on projects 1h30'
  - 11:45 Coffee Break 30'
  - 12:15 Working on projects 1h30'
Tuesday, 30 April 2024
- 05:15 - 13:45
  - 05:15 Development of HPC facilities in Nepal 1h30'
    
    Speaker: Narayan ADHIKARI (Tribhuvan University, Nepal)
  - 06:45 Coffee Break 30'
  - 07:15 Floating point Math 1h30'
    
    Speaker: Axel KOHLMEYER (Temple University, USA)
  - 08:45 Lunch Break 1h30'
  - 10:15 Working on projects 1h30'
  - 11:45 Coffee Break 30'
  - 12:15 Working on projects 1h30'
Wednesday, 1 May 2024
- 05:15 - 13:45
  - 05:15 HPC Best Practises: LAMMPS 45'
    
    Speaker: Axel KOHLMEYER (Temple University, USA)
  - 06:00 HPC Best Practises: HPC at the University of Chicago 45'
    
    Speaker: Trung NGUYEN (University of Chicago, USA)
  - 06:45 Coffee Break 30'
  - 07:15 HPC Best Practises: Multicomponent fluid simulation at the mesoscale 1h30'
    
    Speaker: Ivan GIROTTO (ICTP, Italy)
  - 08:45 Lunch Break 1h30'
  - 10:15 Working on projects 1h30'
  - 11:45 Coffee Break 30'
  - 12:15 Working on projects 1h30'
Thursday, 2 May 2024
- 05:15 - 13:45
  - 05:15 ML Best Practices 30'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 05:45 Parallel ML using Dask 1h0'
    
    Speaker: Serafina DI GIOIA (ICTP, Italy)
  - 06:45 Coffee Break 30'
  - 07:15 Working on projects 1h30'
  - 08:45 Lunch Break 1h30'
  - 10:15 Working on projects 1h30'
  - 11:45 Coffee Break 30'
  - 12:15 Working on projects 1h30'
Friday, 3 May 2024
- 05:15 - 08:45
  - 05:15 HPC in Nepal 30'
    
    Speaker: Umesh Upadhyaya and Rupesh Basnet (HPCNepal)
  - 05:45 Project presentations 1h0'
  - 06:45 Coffee Break 30'
  - 07:15 Project Presentation 30'
  - 07:45 Closing and hand-out certificates 1h0'