Inside the White House frustrations with Sean Duffy