Canada’s privacy watchdog has found that xAI’s Grok chatbot lacks sufficient safeguards against the creation and dissemination of non-consensual, sexualized deepfake images. The investigation revealed vulnerabilities allowing users to generate such content without adequate restrictions. This finding adds to increasing global scrutiny surrounding the ethical and legal implications of artificial intelligence and deepfake technology. Concerns center on the potential for misuse and harm caused by easily created, realistic but fabricated imagery. The watchdog’s report highlights a need for stronger protective measures within AI systems to prevent privacy violations. xAI has not yet publicly responded to the specific findings. This case underscores the challenges of regulating rapidly evolving AI technologies and protecting individuals from potential abuse.