While more generative AI tools are becoming available in healthcare for diagnostics and patient communication, it is important for clinicians and healthcare staff to be aware of the security, privacy, and compliance risks when entering protected health information (PHI) into a tool like ChatGPT.