Good Teachers Hold the Key to Learning Loss Recovery