Background of the Investigation
French prosecutors recently raided X's Paris office as part of a criminal probe into the alleged distribution of deepfakes and child‑abuse imagery. The inquiry goes beyond examining user behaviour; it focuses on what the platform and its AI subsidiary, xAI, failed to prevent.
New Safeguards Announced by X
X has said it is rolling out stronger safeguards, including blocking specific image‑generation pathways and restricting the creation of altered photos involving minors. However, once such content spreads on a network as large as X, complete removal becomes extremely difficult.
Risks Posed by Advanced AI Tools
Tools like xAI’s Grok can produce convincing explicit imagery from ordinary selfies, blurring the line between genuine and fabricated content. This raises serious privacy and reputational risks for everyday users, not just public figures.
Calls for Stronger Regulation
Experts are urging enforceable safety‑by‑design requirements and greater transparency about model training data and guardrails. Increased pressure is expected on tech companies to disclose how they mitigate harmful outputs.
What Users Can Do
- Stay informed about platform safety updates.
- Limit sharing of personal photos publicly.
- Report suspicious or abusive AI‑generated content.