Due to the advancements on Deep Learning (DL), we are now in the age of Narrow Artificial Intelligence, where a computer program is able to surpass people in very narrow tasks, such as image classification, speech recognition and auto-reply. In addition, software agents are able to outperform human performance by choosing their own strategies in complex puzzle games such as chess and Go as well as multiplayer video games such as StarCraft II, which are based on Deep Reinforcement Learning (DRL) algorithms. Next, Deep Learning algorithms have the ability to create artificial images whichcan be indistinguishable from humans. However, in order to enter the age of General Artificial Intelligence, Deep Learning models must be able to learn from a small amount of data and apply their knowledge from one field to another field, as people do. The aim of the course is to present advanced Deep Learning methodswhich are able to train models in small data-sets as well as to perform transfer of learning among different fields. Furthermore, in this course students will become familiar with Deep Reinforcement Learning methods in order to apply them to electronic games, robotic system simulators as well as finding the optimal Deep Learning architectures.The notes as well as the proposed exercises, are based on the teaching material and suggestions which have been developed for this purpose by the NVIDIA Deep Learning Institute (https://developer.nvidia.com/teaching-kits).

• Deep learning techniques for tackling small datasets:
  • Zero/One/Few-shot learning (Siamese networks)
  • Active Learning
  • Learning to learn: Meta-learning
  • Self-supervised learning
• Deep generative models:
  • Variational Auto-Encoders
  • Generative Adversarial Networks (GANs)
  • Cycle-GANs
• Deep Reinforcement Learning (DRL):
  • Deep Q-Network, Deep Deterministic Policy Gradient, Advantage Actor Critic (A2C),
• Relational DRL, Curiosity-driven RL
  • AutoML: Neural Architecture Search

• Develop Siamese Neural Networks for one-shot learning
• Develop an Active Learning application for image classification
• Create fake celebrity images from noise
• Image-to-Image Translation
• Develop AI agents to play arcade games
• Develop AI agents for robotic control