Child safety watchdog calls for child protection guidelines to be built into AI models from the outset

A chatbot site offering explicit scenarios with preteen characters, illustrated by illegal abuse images has raised fresh fears about the misuse of artificial intelligence.

A report by a child safety watchdog has triggered calls for the UK government to impose safety guidelines on AI companies, amid a surge in child sexual abuse material (CSAM) created by the technology.

The Internet Watch Foundation said it had been alerted to a chatbot site that offered a number of scenarios including “child prostitute in a hotel”, “sex with your child while your wife is on holiday” and “child and teacher alone after class”.

In some cases, according to the IWF, chatbot icons expanded into full-screen depictions of child sexual abuse imagery when clicked upon – and formed the background image for subsequent chats between the bot and the user.