THE DARK SIDE OF AI: GROWING CONCERNS OVER CONSENT, DEEPFAKES AND THE RISE OF GROK

Courtesy of Depositphotos.com

Artificial intelligence has rapidly become part of everyday life, from generating images and videos to answering questions and creating personalised content. But as AI tools become increasingly capable, concerns are growing around how the technology can be used against people without their consent — with women increasingly at the centre of the conversation.

@poki

let’s talk s*xual ai images & deep fakes

♬ original sound – pokimane

One of the most controversial areas is the creation of AI-generated sexualised imagery, often referred to as “nudification” or non-consensual intimate imagery. Unlike traditional photographs, these images can be created without a camera ever being present, using photographs of real people as the basis for manipulated or entirely synthetic content.

Grok, the AI chatbot developed by Elon Musk’s xAI and integrated into X, has faced particular scrutiny over the generation of sexualised images. Recent legal and regulatory developments have placed further attention on the potential consequences of AI tools being used to create explicit or manipulated images of people without their permission.

Why This Is A Problem.

For many women, the issue is not simply about AI producing an inappropriate image. The bigger concern is what happens when somebody’s face, photographs or identity can be incorporated into an image that they never agreed to create.

A normal photograph can already be copied, edited or shared without permission. Generative AI potentially makes the process considerably easier, allowing users to create convincing manipulated imagery from relatively limited source material.

@bbcnews

Ofcom has made urgent contact with Elon Musk’s company xAI following reports its AI tool Grok can be used to make “sexualised images of children” and undress women. #AI #Grok ElonMusk] #BBCNews

♬ original sound – BBC News – BBC News

That raises questions around consent, privacy, harassment and the responsibility of technology companies to prevent their systems from being used to target individuals.

The issue also sits within a wider conversation about women’s experiences online. AI-generated imagery can potentially be used for harassment, humiliation or intimidation, particularly when the person depicted is identifiable.

Grok has become one of the most visible examples in the wider debate because of its image-generation capabilities and the controversy surrounding sexualised AI imagery.

In September 2026, xAI asked a US federal appeals court to halt enforcement of Minnesota legislation targeting AI-generated “nudified” images while its legal challenge proceeds. The legislation is intended to address the creation and distribution of manipulated explicit imagery generated using AI.

@lolabunnyz

i am sick #fyp #ai #grok #twitter #safety

♬ original sound – lola 🪷

The legal dispute illustrates one of the central problems facing the technology industry: AI capabilities are developing rapidly, while governments are still determining how existing laws should apply to synthetic images and what new protections may be necessary.

For women whose images are used without consent, however, the issue is considerably more immediate than a debate about technology regulation.

When An AI Image Becomes Someone Else’s Problem.

One of the uncomfortable realities of generative AI is that creating an image can take seconds, while dealing with the consequences can potentially take considerably longer.

An individual may have no involvement in creating an image but could still find themselves having to report it, request its removal, explain that it is fake or deal with people who believe it to be genuine.

@everyones_invited_

Breaking news: Ofcom is investigating X’s AI chatbot Grok, over sexual deepfakes of people, namely women and children. The investigation will assess whether X has complied with the law under the Online Safety Act. If you’ve missed it, here’s what’s happened ⬆️ The UK government says X’s response is “insulting” to victims, after Elon Musk limited the feature to paid users, not banning it. Freedom of expression should never come at the cost of women’s safety. 📌 If you’ve been affected, report it to Ofcom https://www.ofcom.org.uk/make-a-complaint/complain-about-a-video-sharing-platform-vsp 🔗 Share to raise awareness #GrokAI #OnlineSafety #Deepfakes #WomensSafety #TechAccountability

♬ Blade Runner 2049 – Synthwave Goose

That distinction is particularly important with deepfakes.

AI-generated content does not necessarily have to be realistic enough to fool everyone to cause harm. An image can be obviously manipulated to some viewers while still being distressing, embarrassing or threatening to the person depicted.

Evie: “Every one has got a lot worse.”

One of the women to speak publicly about the Grok controversy was Evie, a 22-year-old photographer from Lincolnshire.

In January 2026, Evie discovered that photographs of her that showed her fully clothed had been manipulated using Grok to depict her wearing a bikini.

Rather than quietly removing herself from the conversation, Evie shared a censored version of one of the images to demonstrate what was happening and raise awareness about the technology.

The decision resulted in further abuse.

According to The Guardian, users subsequently generated increasingly explicit images of Evie, including fabricated images depicting her naked and in sexual situations. She said the images became progressively more disturbing after people realised that she was upset by them.

The experience demonstrates one of the most unsettling aspects of AI-generated abuse: once an image exists, the victim can have very little control over what happens next.

A person can report one image, only for somebody else to create another.

The photograph can be removed, but another version can potentially be generated from the same source material.

For someone like Evie, the issue therefore wasn’t simply that somebody had made a fake photograph.

It was that people had discovered they could manipulate her appearance and repeatedly use that ability to target her.

Maya Jama: When Your Family Warns You

British broadcaster Maya Jama has also spoken about being affected by manipulated explicit imagery.

During the January 2026 Grok controversy, Jama said her mother had alerted her to sexually explicit digitally altered images of her appearing on X.

The incident illustrates another particularly difficult element of deepfake abuse: victims do not necessarily discover the material themselves.

Sometimes it is a family member, friend, colleague or follower who encounters the image first.

That can make an already disturbing situation even more uncomfortable.

A photograph originally posted as an ordinary social-media picture can suddenly become the raw material for an entirely fabricated sexual scenario — one that the person depicted never agreed to participate in.

Narinder Kaur: “It’s like being violated”

Broadcaster Narinder Kaur, 53, also described discovering fabricated videos of herself during the Grok controversy.

The Guardian reported that videos had been generated showing Kaur in compromising sexual situations, including a fabricated video depicting her kissing a man who had been trolling her online.

Kaur described the experience as confusing because, for a moment, the material could appear believable.

That is one of the central problems with deepfake technology.

The victim knows the event never happened.

The people viewing the content may not.

And even when viewers know that an image or video is fabricated, the person depicted still has to live with the knowledge that thousands of strangers may have seen a sexualised representation of them.

The psychological and emotional impact therefore does not depend entirely on whether somebody believes the content is authentic.

Jessaline Caine: A Photograph From Childhood

Perhaps one of the most disturbing examples involved Jessaline Caine, a planning-enforcement worker and survivor of childhood sexual abuse.

Caine had spoken publicly about concerns surrounding Grok’s image-generation capabilities. She subsequently reported that users were able to manipulate a photograph of her as a fully dressed three-year-old and generate an image depicting the child in a bikini.

The incident prompted further abuse directed towards Caine after she discussed it publicly.

She described the phenomenon as a way of silencing women online — essentially turning the ability to manipulate someone’s body into another form of harassment.

The fact that the original photograph showed Caine as a child adds another layer to the concerns surrounding AI-generated imagery.

It demonstrates that the source material does not necessarily have to be sexual, adult or even recent for somebody to attempt to turn it into something disturbing.

Ashley St. Clair: A Legal Battle Over Grok

Another high-profile case involving Grok concerns writer and political strategist Ashley St. Clair.

In January 2026, St. Clair filed a lawsuit against xAI alleging that Grok had been used to create sexually exploitative deepfake images of her.

According to the Associated Press, the allegations included manipulated images based on a photograph of St. Clair when she was 14, as well as sexualised images of her as an adult.

St. Clair said she experienced humiliation and emotional distress as a result.

@hitsradionews

Journalist Jasmine Oak became a victim of deepfake abuse when someone online used AI to alter photos from her social media to make her appear undressed – without her consent. She’s sharing her journey alongside @misscallyjane, Jess Asato MP, Narinder Kaur, and Helen Mort to explore the impact it has on victims – and how new powers are being used to tackle the issue at source. But will it be enough? Search Deepfaked in Rayo to hear Jas’ story 🔉 If you’ve been impacted by Deepfakes or online image abuse, you can get support and advice from: The Cyber Helpline who offer advice to victims of online harm The Revenge Porn Helpline supports all adult victims of intimate image abuse in the UK. And the Police have advice about the next steps you can take if you’ve been a victim. deepfaked deepfake misogyny onlineabuse onlineeducation socialmedia grokai

♬ original sound – Greatest Hits Radio News – Hits Radio News

The case is significant because it moves the discussion beyond individual social-media posts and into the courtroom.

It raises questions about what responsibility AI companies should have when their systems are allegedly used to generate sexualised representations of real people without their permission.

It is important to note that the allegations are disputed and form part of ongoing litigation. They should therefore be understood as claims made in court rather than established findings against xAI.

Nevertheless, the lawsuit demonstrates how the consequences of generative AI are increasingly being tested through legal systems.

A Woman’s Childhood Photograph Became Thousands of Fake Images.

Another case reported in August 2026 demonstrates just how extreme the potential consequences can become.

The Washington Post reported on a Wyoming woman identified in court documents as Jane Doe 4, who alleged that her stepfather used Grok to create thousands of sexually explicit fake images of her from a childhood photograph.

According to the lawsuit, the photograph showed her at approximately 11 years old, fully clothed on a couch.

The filing alleges that the image was manipulated into thousands of explicit images and that some of the material was shared online. The woman later discovered the alleged abuse after law enforcement searched her stepfather’s devices.

@dear.big.tech

Narinder Kaur has been a victim of horrendous deepfake abuse, including Grok-generated content on X. Now, she’s backing Jess Asato’s legal case to hold Musk to account. #ai #musk #elonmusk #fyp

♬ biting bullets – ridgeclub

The case is particularly disturbing because the original photograph was not sexual.

It was simply a childhood photograph.

That is an important distinction in discussions about AI safety. The risk does not necessarily begin when somebody uploads an intimate photograph.

An ordinary image can potentially become the starting point for something entirely different.

Again, these allegations are contained in ongoing litigation and have not been established as findings against xAI.

It Isn’t Just Celebrities.

While the cases involving public figures have attracted considerable attention, deepfake abuse is not limited to celebrities.

In the United States, a 14-year-old girl named Dorota was among a group of students at Westfield High School who were targeted with AI-generated fake nude images.

Her mother, speaking to The Guardian, described being shocked by how quickly a single photograph could be transformed. The images had reportedly been created using an AI application and circulated among students.

The incident highlights why concerns about AI-generated sexual imagery extend far beyond famous people.

@thetimes

Laws to criminalise non-consensual sexual deepfakes will be brought into force this week after digital “undressing” by Elon Musk’s Grok AI chatbot prompted concerns. Women were stripped without their consent and child abuse images created by the tool have been discovered on the dark web, causing an international row. Now, Ofcom is investigating X for possible breaches of the Online Safety Act, which requires it to take down illegal content and prevent users from seeing deepfake nudes. Click the link in bio to read more Grok ai deepfakes feminism

♬ original sound – The Times and The Sunday Times – The Times and Sunday Times

A teenager does not need millions of followers.

She does not need to be an influencer.

She simply needs to have a photograph somewhere online.

The technology can potentially turn an ordinary social-media picture into something deeply personal and humiliating without the person ever having participated in creating the resulting content.

Research published in 2026 has also documented cases reported by teachers in which students created and shared AI-generated sexual imagery of female classmates. One teacher described an incident involving three sixth-form boys who created a sexual deepfake of a female student.

When Children Become Targets.

Perhaps the most alarming part of the AI deepfake debate is the effect it can have on children and teenagers.

Young people have grown up documenting their lives online. School photographs, Instagram posts, TikTok videos, Snapchat stories and ordinary selfies can all become publicly accessible pieces of someone’s digital identity.

That means a child does not necessarily have to create or share an intimate photograph to become the subject of sexualised AI-generated material.

@hitsradionews

‘I’m so used to the abuse that it’s normalised’ Advancements in AI means deepfakes are becoming easier to make, often ‘nudifying’ women or creating images where they’re engaging in sexual acts. We spoke to five women, from a Love Islander to an MP who have all been victims of deepfake images about their experiences. You can hear the full conversation tomorrow morning. @misscallyjane @thecyberhelpline deepfake deepfaked onlineabuse misogyny onlineeducation socialmedia grokai AI

♬ original sound – Greatest Hits Radio News – Hits Radio News

An ordinary photograph can potentially be manipulated.

And unlike adults, children may have fewer resources, less understanding of what is happening and less confidence about where to seek help.

The problem has already appeared in schools.

In the United States, a number of students have been targeted with AI-generated fake nude images created by classmates.

One widely reported case involved students at Westfield High School in New Jersey, where teenage girls discovered that fake nude images had allegedly been created and circulated among students.

The incident caused widespread concern among parents and educators and became part of a growing debate about whether existing school policies and laws were equipped to deal with AI-generated sexual imagery.

The issue is particularly troubling because the perpetrators and victims can be children themselves.

A teenager may be using the same technology as their classmates, without necessarily understanding that creating or distributing a sexualised image of another child can have extremely serious consequences.

That is why education is becoming an increasingly important part of the conversation around AI safety.

The UK Is Already Seeing the Wider Impact.

The concerns surrounding AI deepfakes are part of a much wider problem involving image-based abuse.

In September 2026, a new report from Refuge and End Violence Against Women highlighted the scale of online abuse experienced by women.

The report found that 47% of women aged 16–24 surveyed had experienced some form of online violence. Eighteen per cent reported image-based abuse, including unsolicited images or intimate images being shared without consent, while 9% said they had experienced doxing.

One woman, identified as Jane, described having intimate photographs taken from hacked private accounts and posted online without her consent.

@kimberleyonline

please stay safe and protect yourself

♬ original sound – ♡ Kim ♡ | Commentary

She said strangers subsequently used personal information about her to contact her directly, leaving her feeling exposed, harassed and unsafe.

Although Jane’s case involved stolen intimate photographs rather than AI-generated images, it demonstrates the wider environment in which AI deepfake abuse is emerging.

The technology is effectively adding another potential route through which someone’s likeness can be exploited.

@katiclyzmyt

let’s watch tiktok not push this one too #ai #grok #onlinesafety #parents

♬ Satie Gymnopedie No. 1 Healing(980355) – Tani Taka

The Difference Between “Fake” and Harmless.

One argument sometimes heard in discussions about deepfakes is simple: “It’s not real.”

Technically, that can be true.

The event depicted did not happen.

But that does not mean there are no real-world consequences.

Imagine discovering that an explicit image of yourself has been created.

You know it is fake.

But you don’t know who has downloaded it.

You don’t know who has shared it.

You don’t know whether somebody at your workplace has seen it.

You don’t know whether a family member has encountered it.

And you may have no idea how many copies exist.

That uncertainty can itself become part of the harm.

@rikki

if you’ve never heard of grok before, watch this 💙 it’s basically twitter (or x) AI feature & men are using it to do the most disgusting things 😔 we need to stop this!!! #makeuptutorial #makeup @MaybellineUK @NARS Cosmetics @Laura Mercier @Diorbeauty @maccosmetics @Westman-Atelier

♬ Somewhere Only We Know – Instrumental – Keane

More from Taye Rowland-Dixon
CELEBRATE NATIONAL TEQUILA DAY WITH £15 TACOS & TEQUILA OFFER
Family Estate, additive-free tequila brand Cazcabel has announced its latest offering, as part...
Read More
0 replies on “THE DARK SIDE OF AI: GROWING CONCERNS OVER CONSENT, DEEPFAKES AND THE RISE OF GROK”