Effective Offline Training And Efficient Online Adaptation