Leveraging Structure for Learning Robot Control and Reactive Planning