GOP restrainers say Trump abandoned them