Students learn the basics and theoretical background of Deep Learning and its applications.
Deep Learning (GAINBAN-MELYTANU-1)
Basic data
Instructors
Course objectives
Course content
Lectures
1. Supervised learning. Perceptron, Neural network architecture. Deep learning. 2. Activation functions, backpropagation algorithm. 3. Training strategies, optimization algorithms (Gradient Descent, SGD, Adam), initialization. Hyperparameters. 4. Model evaluation: metrics, validation strategies, bias-variance tradeoff. 5. Regularization techniques (dropout, batch normalization). 6. Convolutional Neural Networks (CNN) and their applications in image processing. 7. Transfer learning techniques and the use of pre-trained models. 8. Recurrent Neural Networks (RNN), LSTM and GRU architectures for sequential data processing. 9. Transformers and the attention mechanism. 10. Unsupervised learning. GAN, Autoencoders (VAE), diffusion models. 11. Vision Language Models (VLM) and multimodal applications. 12. Interpretability and responsible AI. 13. Midterm exam 14. Make-up / Retake midterm exam
Labs
Writing, exploring, and completing Python code snippets related to the lectures, utilizing TensorFlow, PyTorch, JAX, and Keras libraries.
Acquired competences
Knowledge
–
Skills
–
Attitude
–
Autonomy and responsibilities
–
Requirements, evaluation and grading
Mid-term study requirements
Theoretical and practical midterm exam. Completing assigned short tasks / short assignments.
Generative AI usage
Use of GAI tools is permitted in a limited manner (e.g., for literature search support or specific tools). In this case, the course instructor is responsible for defining where and how GAI tools may be used in assignments. The course description must specify in detail how GAI tools may be used during the course.
Study aids, laboratory background
Slides and notes. Practical problems.
Readings
Compulsory readings
https://udlbook.github.io/udlbook/
Recommended readings
François Chollet, Matthew Watson: Deep Learning with Python, third edition, 2025, ISBN 9781633436589, https://deeplearningwithpython.io/ https://d2l.ai/ https://www.bishopbook.com/