Sam Altman, CEO of OpenAI, cautions users to exercise discretion when seeking medical treatment or emotional support through AI applications such as ChatGPT. Altman highlights a critical concern: the AI industry has yet to devise robust mechanisms to safeguard user privacy in these highly sensitive interactions. He underscores that when AI assumes the role of a physician, the sanctity of traditional doctor-patient confidentiality is compromised. User-shared private information with ChatGPT may be compelled to be disclosed in legal proceedings, thereby foregoing the legal confidentiality protections afforded to communications with psychologists, lawyers, or traditional medical professionals.