Elon Musk’s xAI and its chatbot Grok have been banned from creating non-consensual AI-generated images of adults and children by a Dutch court, adding to growing legal pressure on the company.
Amsterdam’s District Court issued a legal order on Thursday prohibiting xAI from generating and distributing sexual imagery “whereby persons are partially or wholly be stripped naked without having given explicit permission for this,” according to a Google translation of the court statement.
The ruling, a first-of-its-kind case against Grok in Europe, extends to child sexual abuse material and prevents the platform X, formerly known as Twitter, from offering Grok as a function in the region. xAI faces a penalty of 100,000 euros ($115,000) for every day it fails to comply with the ruling, with a maximum fine of 10 million euros, per the injunction.
The case was brought by Dutch non-profit group Offlimits, which fights online sexual abuse, particularly against children and young people. xAI was also ordered to pay Offlimits legal costs of 2.2 million euros within 14 days.
“The judge drew a clear line yesterday: technology is not a license to violate human rights online,” Robbert Hoving, managing director at Offlimits, said in a statement. “It is also wonderful that a vote was held in Europe yesterday for a ban on Nudify tools. It is a double celebration, because that is important. You should enjoy the same online rights in every European country.”
