Structure to Learn, Freedom to Explore