PM can’t rely on his history as his government falls short