Doctors and patients need the trust AI is shattering |
Pennsylvania’s recent lawsuit against Character.AI may ultimately be remembered as more than a dispute over chatbots. It may mark the beginning of a far larger societal reckoning: What happens when artificial intelligence no longer simply provides information, but begins to imitate professional identity itself?
According to the complaint, certain AI-generated "characters" allegedly presented themselves as licensed psychiatrists, claimed to hold medical credentials and engaged users in conversations about mental health symptoms and treatment. The concern extends well beyond one lawsuit.
A recent investigation found that when a Boston psychiatrist posed as a teenage patient to test popular AI chatbots, several presented themselves as licensed human therapists, discouraged users from seeing real clinicians and, in some cases, crossed into dangerous territory entirely.
Young people may be the most vulnerable, and the least equipped to question the authority of a confident, empathetic voice.
The question is no longer whether AI can sound like a clinician. It clearly can. The question is whether society will allow systems with no licensure, no fiduciary duty, no accountability and no independently validated evidence base to occupy the same psychological and legal space as professionals entrusted with human lives.
Medicine relies on trust. AI threatens that.
For generations, medicine has relied on a social contract built around trust.
Physicians undergo years of training, licensing examinations,........