Concerns over child sexual exploitation and abuse as AI use grows

A report by Child Fund and Strathmore University has pointed out the growing influence of Artificial Intelligence, which has contributed to cases of child abuse and exploitation online. As AI grows, so do the threats to children in cyberspace, who use Generative AI tools or whose data is fed into machines. 

Researchers from Child Fund and Strathmore University note gaps in regulations that protect children online.

They highlight the failure by platforms, including social media sites, AI chatbots and Search Engines to create child-safe environments. 

Studies have identified failure by technology companies to design digital solutions with children in mind or based on their experiences.

However, governments have also failed in holding technology platforms accountable for harms caused to children. 

Experts from Child Fund and Strathmore University therefore recommend that technology platforms should be designed with children in mind and based on their experiences and African cultural values to safeguard and protect children. 

AI applications have recently been faulted for failure to protect children and exposing them to OCSEA.

In early 2026, xAI’s was under scrutiny after its chatbot, Grok, enabled the creation of sexually explicit deepfakes using images of children and women. 

In the troubling trend, X users made prompts asking Grok to manipulate images of children and women by undressing them or displaying them in bikinis. 

What started as a ploy to use Grok to transform images raised concerns about sexual abuse of children and Technology-facilitated Gender-based violence (TFGBV). 

From “remove her clothes” to “put her in a bikini”. Grok responded to such prompts to undress people in photos that were shared on X. 

One such instance was a case where Grok was prompted to remove clothes from the picture of a 14-year-old girl. 

After mass uproar, the platform removed the sexually explicit images generated by its built-in chatbot.

Multiple suits have so far been filed against Xai. Last week, a court in Amsterdam ordered Grok, owned by billionaire Elon Musk, to stop generating non-consensual nude pictures and child sexual abuse material.

Separately, Meta and Google were recently found culpable of “intentionally” building addictive social media platforms that harmed a teenager’s mental health. 

The victim, now 20 years old, was awarded $6m in damages, a judgment that the technology companies disagreed with.