Mortgage worries persist