We lose many great candidates because of our in-office policy—but we are still better for it