Content-Moderation

Introduction TL;DR: Grok image generation became a high-profile example of how “digital undressing” (nudification) and CSAM-adjacent risks can scale fast when person-image editing, virality defaults, and monetization intersect. Context: Regulators (EU DSA) and national authorities are now treating this as a systemic risk management problem, not just “bad content.” Definitions and scope One-sentence definition Digital undressing is the misuse of generative image tools to create nonconsensual sexualized imagery of identifiable people (nudification). ...

Introduction TL;DR: Reports in early January 2026 say Grok’s image editing on X was abused to create non-consensual sexualized edits of real people, including minors. India’s IT Ministry reportedly ordered X to implement safeguards and submit an action-taken report within 72 hours. France referred the matter to prosecutors and flagged potential EU DSA compliance concerns. This post summarizes what’s confirmed, and provides a practical guardrail checklist for teams shipping “real-person image editing” features (no misuse instructions included). 1) What happened (2026-01-02 to 2026-01-03) 1.1 Real-person image editing escalates harm quickly Reuters reported that users on X sent requests to Grok to produce sexualized edits of real people and that Reuters identified cases involving children as well. ...