Temporal Abstraction

Representing and reasoning at multiple timescales — enabling long-horizon planning by abstracting away low-level details. The options framework (semi-MDPs with sub-policies and termination conditions) is the formal framework for temporal abstraction in RL. Temporal abstraction enables efficient credit assignment across many timesteps in long-horizon manipulation tasks.