Architecture Patterns, Learning Paradigms, and Planning Methods
The RSSM you built in P02 is the RNN baseline. This lecture takes it as the starting point and unfolds in two parts:
- Part A: Architecture Patterns: Principles and a selection guide for seven architecture families (RNN/RSSM, Transformer, Diffusion, JEPA, RWM, Genie, WAM), plus the knowledge boundaries of four learning paradigms
- Part B: Planning Mechanisms: CEM-MPC random search, Dreamer latent Actor-Critic, and TD-MPC hybrid approach. This is the direct prerequisite for P03 and P04.
The architecture section does not require implementation; that is the work of later projects. The focus is on understanding design trade-offs and building judgment about when to use what. The planning section requires careful reading.