June 24, 2025 - by CSCS

This course offers a concise introduction to the fundamental concepts of deep learning, covering neural network basics, training methods, and specific applications such as convolutional neural networks for computer vision and transformer models for natural language processing. 

More specifically, the following topics will be covered:

  • Fundamentals of neural networks
  • Training deep learning models: stochastic gradient descent, optimizers, loss functions, regularization, etc.
  • Training on multiple GPUs
  • Convolutional Neural Networks (CNNs) for computer vision
  • Natural Language Processing (NLP) with transformers: attention mechanisms, transformer architecture, etc. 

The lessons will combine theoretical content with hands-on practice using PyTorch. Practical exercises will be run on the Piz Daint supercomputer at CSCS. 

This workshop is designed for researchers who are beginning to use deep learning in their work and are seeking a fast-paced introduction to the field. The goal is to provide foundational knowledge and guidance so that participants can continue their deep learning journey independently. 

Deadline for registration: Wednesday, June 25, 2025.

More details can be found in the Event webpage >  

We look forward to welcoming you at CSCS!