To Retain, You Must Train