Americans were apprehensive of Trump’s tariffs even before this week’s fallout