Visual Imitation

Imitation learning from video demonstrations captured from third-person or first-person viewpoints, without proprioceptive information. Visual imitation leverages the abundance of instructional videos online (cooking, assembly, sports) to learn robot policies. Key challenges include correspondence between human and robot morphology and action space inference from observation only.