Covers the concept of gradient descent in scalar cases, focusing on finding the minimum of a function by iteratively moving in the direction of the negative gradient.
Covers model-free prediction methods in reinforcement learning, focusing on Monte Carlo and Temporal Differences for estimating value functions without transition dynamics knowledge.
Explores deep learning for autonomous vehicles, covering perception, action, and social forecasting in the context of sensor technologies and ethical considerations.