Occupancy Map Learning

Learning to predict 3D occupancy maps from sensor observations, either to reconstruct the current scene or predict future scene states. Occupancy map predictions from a single camera frame (learned from paired depth data) enable 3D-aware manipulation without depth cameras. Differentiable occupancy map renderers enable gradient-based optimization.