A framework that transfers robot policies learned in simulation back to real-world robots through intermediate real-world data collection.