Howard’s criticism shows the moment is slipping away from Albanese