AI-generated child sexual abuse images could flood the internet; UK watchdog calls for action
1 year, 5 months ago

AI-generated child sexual abuse images could flood the internet; UK watchdog calls for action

The Hindu  

The already-alarming proliferation of child sexual abuse images on the internet could become much worse if something is not done to put controls on artificial intelligence tools that generate deepfake photos, a watchdog agency warned on Tuesday. In a written report, the U.K.-based Internet Watch Foundation urges governments and technology providers to act quickly before a flood of AI-generated images of child sexual abuse overwhelms law enforcement investigators and vastly expands the pool of potential victims. If it isn’t stopped, the flood of deepfake child sexual abuse images could bog investigators down trying to rescue children who turn out to be virtual characters. “That is just incredibly shocking.” Sexton said his charity organisation, which is focused on combating online child sexual abuse, first began fielding reports about abusive AI-generated imagery earlier this year. “So how do you get to the point where they can’t use openly available software to create harmful content like this?” Most AI-generated child sexual abuse images would be considered illegal under existing laws in the U.S., U.K. and elsewhere, but it remains to be seen whether law enforcement has the tools to combat them.

Technology Law Enforcement Abuse Child Content Report Images Ai Sexual Sexton Child Sexual Abuse Iwf Stable Diffusion Technology Providers  uk  internet  watchdog  flood  content  technology  aigenerated  report  action  child  tools  abuse  calls  images  children  ai  sexual

History of this topic

Dozens of women targeted by AI-generated nudes, experts raise alarm
2 weeks, 1 day ago

Dozens of women targeted by AI-generated nudes, experts raise alarm

NL Times  

The number of victims of AI-generated nude images has surged over the past year, raising serious concerns among experts and support organizations. These deepfake images, created using so-called "undressing apps," have become one of the fastest-growing forms of online abuse, according to data from expertise center Offlimits. "It doesn't matter whether the photo is real or not," said Marthe Goudsmit …

Aggressive pornography acts as a gateway to child sexual content, charity warns
3 weeks, 3 days ago

Aggressive pornography acts as a gateway to child sexual content, charity warns

Daily Mail  

Pornography is acting as a ‘gateway’ to child sexual abuse with one in five Britons who watch adult films now viewing more ‘aggressive or extreme’ content, a child protection charity has warned. The charity said 275,000 people with concerns about their own or somebody else’s sexual behaviour towards children sought its support last year - an increase of 26 per …

UK launches probe into how TikTok uses children’s personal data to recommend content
3 weeks, 5 days ago

UK launches probe into how TikTok uses children’s personal data to recommend content

Firstpost  

The UK data watchdog has also launched similar probes against Reddit and Imgur, focusing on their handling of children’s data. The investigation will especially check how these platforms verify the users’ age and enforce age-related content regulation Chinese social media platform TikTok is facing a probe by the UK’s data watchdog over its handling of children’s data. The probe will …

UK launches investigation into TikTok, Reddit over children's personal data practices
3 weeks, 5 days ago

UK launches investigation into TikTok, Reddit over children's personal data practices

The Hindu  

Britain's privacy watchdog, the Information Commissioner's Office, on Monday launched an investigation into how TikTok, Reddit and online image sharing website Imgur safeguard children's privacy. The watchdog said it is probing how ByteDance's short-form video-sharing platform TikTok uses 13–17-year-olds' personal information to suggest content in their feed. Britain has previously passed legislation that set tougher rules for social media platforms, …

UK watchdog cracks down on TikTok, Reddit over children's privacy concerns
3 weeks, 5 days ago

UK watchdog cracks down on TikTok, Reddit over children's privacy concerns

Firstpost  

The watchdog is investigating how ByteDance’s short-form video-sharing site TikTok utilises personal information from 13-17-year-olds to recommend material in their feed The Information Commissioner’s Office, Britain’s privacy watchdog, began looking into how Reddit, TikTok, and online picture sharing platform Imgur protect children’s privacy on Monday. The watchdog is investigating how ByteDance’s short-form video-sharing site TikTok utilises personal information from 13-17-year-olds …

Gang arrested over distributing AI-generated child abuse images
1 month ago

Gang arrested over distributing AI-generated child abuse images

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Sign up to our free breaking news emails SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Two dozen people were arrested …

Bluesky boosts safety tools as user numbers continue to rise
1 month, 1 week ago

Bluesky boosts safety tools as user numbers continue to rise

The Independent  

Sign up to our free weekly IndyTech newsletter delivered straight to your inbox Sign up to our free IndyTech newsletter Sign up to our free IndyTech newsletter SIGN UP I would like to be emailed about offers, events and updates from The Independent. The platform has become a member of the Internet Watch Foundation, the non-profit organisation which helps find …

Urgent warning to tighten controls issued to popular parenting website as it is targeted by sick trolls posting vile child sex abuse images
Trending News
1 month, 3 weeks ago

Urgent warning to tighten controls issued to popular parenting website as it is targeted by sick trolls posting vile child sex abuse images

Daily Mail  

Trolls posted vile child sexual abuse images on Mumsnet, sparking a row over how the popular parenting forum is governed. Last night, Mumsnet founder Justine Roberts CBE said new controls would be implemented, including an AI system that can detect offensive images before they are posted. ustine Roberts CBE said new AI controls would help detect offensive images posted on …

The surprising way the British government is leading the world on AI
Trending News
1 month, 3 weeks ago

The surprising way the British government is leading the world on AI

The Independent  

The government has announced that the possession and distribution of AI tools used to produce images of child sexual abuse will become illegal, making Britain the first country in the world to build in this type of protection. He has exploited victim trauma to push his own political agenda via his platform X, which has itself faced serious concerns about …

AI tools have put child sexual abuse ‘on steroids’, Home Secretary warns
1 month, 3 weeks ago

AI tools have put child sexual abuse ‘on steroids’, Home Secretary warns

The Independent  

Sign up for the View from Westminster email for expert analysis straight to your inbox Get our free View from Westminster email Get our free View from Westminster email SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Artificial intelligence has put child sexual abuse “on steroids”, the Home …

UK becomes first country in the world to criminalise AI child abuse tools
Trending News
1 month, 3 weeks ago

UK becomes first country in the world to criminalise AI child abuse tools

Firstpost  

It will also be illegal to possess AI “paedophile manuals” which teach people how to use AI to sexually abuse children, punishable by up to three years in prison UK becomes the first country in the world to criminalise AI child abuse tools. File image/Reuters Britain will become the first country to introduce laws against AI tools used to generate …

Yvette Cooper says Britain will become the first country in the world to make owning AI tools for creating child abuse illegal
Top News
1 month, 4 weeks ago

Yvette Cooper says Britain will become the first country in the world to make owning AI tools for creating child abuse illegal

Daily Mail  

Yvette Cooper has announced the UK will be the first country in the world to make it illegal to own AI tools designed to generate images of child sexual abuse. Yvette Cooper has announced the UK will be the first country in the world to make it illegal to own AI tools designed to generate images of child sexual abuse …

Creators of AI child sex abuse images face up to five years in prison under crackdown
Trending News
1 month, 4 weeks ago

Creators of AI child sex abuse images face up to five years in prison under crackdown

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Sign up to our free breaking news emails SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Creators of AI-generated images of …

UK to become first country to criminalise AI child abuse tools
1 month, 4 weeks ago

UK to become first country to criminalise AI child abuse tools

Al Jazeera  

UK will make it a crime to possess, create or distribute artificial intelliegence tools that generate sexual content targeting children. AI tools are being used to generate child sexual abuse images by “nudeifying” real-life images of children or by “stitching the faces of other children onto existing images”, said the government. It will also be a crime punishable by up …

AI action plans should be slowed until safeguards for children in place – NSPCC
2 months ago

AI action plans should be slowed until safeguards for children in place – NSPCC

The Independent  

Sign up to our free weekly IndyTech newsletter delivered straight to your inbox Sign up to our free IndyTech newsletter Sign up to our free IndyTech newsletter SIGN UP I would like to be emailed about offers, events and updates from The Independent. The NSPCC said generative AI is already being used to create sexual abuse images of children, and …

Sydney teenager reported to police over deepfake explicit images of female classmates
2 months, 2 weeks ago

Sydney teenager reported to police over deepfake explicit images of female classmates

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Sign up to our free breaking news emails SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy A Sydney teenager is under …

AI-generated deepfakes targeting women politicians around the world
2 months, 3 weeks ago

AI-generated deepfakes targeting women politicians around the world

The Hindu  

From the United States to Italy, Britain, and Pakistan, female politicians are increasingly becoming victims of AI-generated deepfake pornography or sexualised images, in a troubling trend that researchers say threatens women’s participation in public life. In the United Kingdom, Deputy Prime Minister Angela Rayner was among more than 30 British female politicians found to be targeted by a deepfake porn …

Britain to make sexually explicit 'deepfakes' a crime
2 months, 3 weeks ago

Britain to make sexually explicit 'deepfakes' a crime

The Hindu  

Creating and sharing sexually explicit "deepfakes" will become a criminal offence in Britain, the government said on Tuesday, in a bid to tackle a surge in the proliferation of such images, mainly targeting women and girls. The previous Conservative government, which lost power to the Labour Party in July, announced similar plans to make sexually explicit deepfakes a criminal offence. …

Labour to crack down on deepfakes and sharing of illicit intimate images
2 months, 3 weeks ago

Labour to crack down on deepfakes and sharing of illicit intimate images

The Independent  

Sign up for the View from Westminster email for expert analysis straight to your inbox Get our free View from Westminster email Get our free View from Westminster email SIGN UP I would like to be emailed about offers, events and updates from The Independent. Those who take intimate images of other people without their consent, or who install equipment …

How UK watchdog plans to 'drive out' children from social media sites
3 months ago

How UK watchdog plans to 'drive out' children from social media sites

Hindustan Times  

Social media companies in the UK will be implementing the use of facial recognition age checks to “drive out” under-age children from their sites. John Higham, the online regulator’s head of online safety policy, said platforms would be expected to remove potentially millions of children from their sites by using “highly accurate and effective” age checks. According to estimates by …

Telegram to work with internet watchdog on child sexual abuse material crackdown
3 months, 3 weeks ago

Telegram to work with internet watchdog on child sexual abuse material crackdown

The Independent  

Sign up to our free weekly IndyTech newsletter delivered straight to your inbox Sign up to our free IndyTech newsletter Sign up to our free IndyTech newsletter SIGN UP I would like to be emailed about offers, events and updates from The Independent. The platform is to work with the Internet Watch Foundation, a leading organisation for finding and removing …

Study reveals disturbing reason men send unsolicited genital pictures - as half of UK women say they've received one
4 months ago

Study reveals disturbing reason men send unsolicited genital pictures - as half of UK women say they've received one

Daily Mail  

Experts studying the sexual harassment of women online have revealed some of the disturbing reasons why men send unsolicited pictures of their genitals. Commonly known as 'd*** pics' or 'cyberflashing', the advent of mobile cameras and public social media profiles has given men an easy way to send explicit images to women for their own perverse delight. The study also …

Sickening deepfake and AI-generated child abuse images are doubling every six months, Britain's FBI warns
4 months, 1 week ago

Sickening deepfake and AI-generated child abuse images are doubling every six months, Britain's FBI warns

Daily Mail  

The amount of deepfake and AI-generated child abuse images online is doubling every six months, a National Crime Agency director has warned. The images are generated by software which learns from photos and videos of real child abuse, Mr Murray, who is also the AI lead for the National Police Chiefs' Council, added. The amount of deepfake and AI-generated child …

Make revenge porn a civil offence to avoid ‘retraumatising’ trials, MPs told
4 months, 2 weeks ago

Make revenge porn a civil offence to avoid ‘retraumatising’ trials, MPs told

The Independent  

Sign up for the Independent Women email for the latest news, opinion and features Get the Independent Women email for free Get the Independent Women email for free SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Revenge porn should be made a statutory civil offence to allow victims …

AI means anyone can be a victim of deepfake porn. Here’s how to protect yourself
4 months, 2 weeks ago

AI means anyone can be a victim of deepfake porn. Here’s how to protect yourself

CNN  

New York CNN — “All we have to have is just a human form to be a victim.” That’s how lawyer Carrie Goldberg describes the risk of deepfake porn in the age of artificial intelligence. While revenge porn — or the nonconsensual sharing of sexual images — has been around for nearly as long as the internet, the proliferation of …

British man sentenced to 18 years for using AI to make child sexual abuse imagery
5 months ago

British man sentenced to 18 years for using AI to make child sexual abuse imagery

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Please enter a valid email address Please enter a valid email address SIGN UP I would like to be emailed about offers, events and updates from The Independent. The company said the licensing …

AI Images Are Spreading, Law Enforcement Is Racing to Stop Them
5 months ago

AI Images Are Spreading, Law Enforcement Is Racing to Stop Them

Associated Press  

A disturbing trend of child sexual abuse imagery created through artificial intelligence technology is gaining momentum across the United States. Law enforcement agencies are working aggressively to stop these offenders, with several cases involving AI-generated images leading to arrests and charges. The spread of child sexual abuse images generated through AI tools poses a significant threat to children, and lawmakers …

AI-generated child sexual abuse images are spreading. Law enforcement is racing to stop them
5 months ago

AI-generated child sexual abuse images are spreading. Law enforcement is racing to stop them

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Please enter a valid email address Please enter a valid email address SIGN UP I would like to be emailed about offers, events and updates from The Independent. Justice Department officials say they're …

AI-generated child sex abuse content increasingly found on open web – watchdog
5 months, 1 week ago

AI-generated child sex abuse content increasingly found on open web – watchdog

The Independent  

Sign up to our free weekly IndyTech newsletter delivered straight to your inbox Sign up to our free IndyTech newsletter Sign up to our free IndyTech newsletter SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy AI-generated child sexual abuse content is increasingly being found on publicly accessible areas …

Statement: NSW Police
5 months, 2 weeks ago

Statement: NSW Police

ABC  

In response to the Australian Story program 'Betrayal', aired October 14, 2024. On Thursday 3 February 2022, officers attached to Inner West Police Area Command received a report that sexual deepfake images of a woman were being spread online. Responding to a growing trend: The NSW Police Force along with law enforcement partners around the world are facing a number …

Inside depraved AI deepfake porn Telegram group that encourages users to share naked pictures of their female family members in vile 'humiliation rooms'
5 months, 2 weeks ago

Inside depraved AI deepfake porn Telegram group that encourages users to share naked pictures of their female family members in vile 'humiliation rooms'

Daily Mail  

In dark corners of the internet, depraved content creators are sharing pornographic pictures and videos made with artificial intelligence to make money - and humiliate their loved ones. Four years after police concluded a massive bust of depraved content creators in South Korea, deepfake technology brings a sinister new dimension to channels, with hundreds of thousands of people signed up …

California governor signs bills to protect children from AI deepfake nudes
6 months ago

California governor signs bills to protect children from AI deepfake nudes

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Please enter a valid email address Please enter a valid email address SIGN UP I would like to be emailed about offers, events and updates from The Independent. The new laws, which received …

Tech companies commit to fighting harmful AI sexual imagery by curbing nudity from datasets
6 months, 2 weeks ago

Tech companies commit to fighting harmful AI sexual imagery by curbing nudity from datasets

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Sign up to our free breaking news emails SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Several leading artificial intelligence companies …

Child abuse images removed from AI image-generator training source, researchers say
6 months, 4 weeks ago

Child abuse images removed from AI image-generator training source, researchers say

The Hindu  

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a dataset used to train popular AI image-generator tools. One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible …

San Francisco goes after websites that make AI deepfake nudes of women and girls
7 months, 1 week ago

San Francisco goes after websites that make AI deepfake nudes of women and girls

The Independent  

For free real time breaking news alerts sent straight to your inbox sign up to our breaking news emails Sign up to our free breaking news emails Please enter a valid email address Please enter a valid email address SIGN UP I would like to be emailed about offers, events and updates from The Independent. “The proliferation of these images …

AI-powered deepfake nude websites are targeted by San Francisco city attorney’s lawsuit
7 months, 2 weeks ago

AI-powered deepfake nude websites are targeted by San Francisco city attorney’s lawsuit

LA Times  

San Francisco City Atty. David Chiu announced Thursday that his office is suing the operators of 16 AI-powered “undressing” websites that help users create and distribute deepfake nude photos of women and girls. Chiu said the lawsuit has two goals: shutting down these websites and sounding the alarm about this form of “sexual abuse.” On these websites, users upload photos …

Young teenage girls 'selling self-made abuse images' on Instagram: Charity lawyers target Meta claiming social media giant is 'complicit in the exploitation of children online' amid AI deep-faked phot
8 months, 1 week ago

Young teenage girls 'selling self-made abuse images' on Instagram: Charity lawyers target Meta claiming social media giant is 'complicit in the exploitation of children online' amid AI deep-faked phot

Daily Mail  

Young teenage girls are using Instagram as a tool to advertise ‘their bodies for sex’, an investigation has revealed. Police have discovered a disturbing new trend on Instagram where schoolgirls as young as 15 are allegedly selling ‘self-generated child sexual abuse material’ to paedophiles. Baroness Beeban Kidron, founder of the 5Rights Foundation has hired law firm Schillings to launch a …

Instagram 'is profiting from AI-generated child abuse images': Charity lawyers target social media giant Meta for 'not tackling' a 'new frontier of horror' that sees paedophiles advertise websites sel
8 months, 1 week ago

Instagram 'is profiting from AI-generated child abuse images': Charity lawyers target social media giant Meta for 'not tackling' a 'new frontier of horror' that sees paedophiles advertise websites sel

Daily Mail  

Instagram is facing a legal challenge over claims it profits by allowing users to advertise AI-generated child sex abuse images. In what campaigners say is a 'new frontier of horror', paedophiles are using artificial intelligence software to generate thousands of sexualised images of children, which they brazenly market on Instagram, telling users to click on their sites to buy even …

AI is creating a new frontier in 'revenge porn', and experts say online misogyny is fuelling the problem
9 months, 2 weeks ago

AI is creating a new frontier in 'revenge porn', and experts say online misogyny is fuelling the problem

ABC  

Libby Payne was in Year 8 when she experienced image-based abuse, which is often referred to as "revenge porn". In the case of the Bacchus Marsh students, their faces were purportedly taken from social media sites before being manipulated using AI to make "obscene photographs", police said. Ms Payne also says young people are responding to a culture of masculinity, …

AI Tools Are Secretly Training on Real Images of Children
9 months, 2 weeks ago

AI Tools Are Secretly Training on Real Images of Children

Wired  

Over 170 images and personal details of children from Brazil have been repurposed by an open-source dataset without their knowledge or consent, and used to train AI, claims a new report from Human Rights Watch released Monday. Human Rights Watch claims that personal details and photos of these children were gathered by data repository Common Crawl and then URLs that …

Prioritise children’s online safety at election to tackle ‘hidden pandemic’ of sexual abuse, experts urge
9 months, 3 weeks ago

Prioritise children’s online safety at election to tackle ‘hidden pandemic’ of sexual abuse, experts urge

The Independent  

Sign up for the View from Westminster email for expert analysis straight to your inbox Get our free View from Westminster email Get our free View from Westminster email SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Experts warning of a “hidden pandemic” of online sexual abuse have …

More than 300 million children a year face sexual abuse online, study suggests
10 months ago

More than 300 million children a year face sexual abuse online, study suggests

The Independent  

Sign up to our free weekly IndyTech newsletter delivered straight to your inbox Sign up to our free IndyTech newsletter Sign up to our free IndyTech newsletter SIGN UP I would like to be emailed about offers, events and updates from The Independent. This is on a staggering scale that in the UK alone equates to forming a line of …

White House pushes tech industry to shut down market for sexually abusive AI deepfakes
10 months ago

White House pushes tech industry to shut down market for sexually abusive AI deepfakes

Associated Press  

President Joe Biden’s administration is pushing the tech industry and financial institutions to shut down a growing market of abusive sexual images made with artificial intelligence technology. “And so that’s an example of something that could be done much more rigorously.” Cloud service providers and mobile app stores could also “curb web services and mobile applications that are marketed for …

Alarm raised over bizarre images circulating on Facebook
11 months ago

Alarm raised over bizarre images circulating on Facebook

The Independent  

Sign up to our free weekly IndyTech newsletter delivered straight to your inbox Sign up to our free IndyTech newsletter Sign up to our free IndyTech newsletter SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy Experts and users have warned about an increasing amount of seemingly AI-generated images, …

Children, three, manipulated into sending predators sexual pictures, report claims
11 months ago

Children, three, manipulated into sending predators sexual pictures, report claims

Daily Mail  

A new report has found that children as young as three are being manipulated into sending predators sexual pictures and videos. A new report has found that children as young as three are being manipulated into sending predators sexual pictures and videos Susie Hargreaves, chief executive of the IWF, said: 'The opportunistic criminals who want to manipulate your children into …

Report urges fixes to online child exploitation CyberTipline before AI makes it worse
11 months, 1 week ago

Report urges fixes to online child exploitation CyberTipline before AI makes it worse

Associated Press  

A tipline set up 26 years ago to combat online child exploitation has not lived up to its potential and needs technological and other improvements to help law enforcement go after abusers and rescue victims, a new report from the Stanford Internet Observatory has found. “Almost certainly in the years to come, the CyberTipline will just be flooded with highly …

Artificial intelligence is being used to create child abuse material, and police are worried about its spread
11 months, 1 week ago

Artificial intelligence is being used to create child abuse material, and police are worried about its spread

ABC  

It takes less than one minute, with the help of a few prompts into an artificial intelligence image generator, to create a photo depicting a child in a sexually explicit way. It was in 2022 that Detective Superintendent Rayner first received reports of child exploitation material circulating online that had been generated by AI tools. Tasmania's Commissioner for Children and …

What is a deepfake and why does the government want to make them illegal?
11 months, 1 week ago

What is a deepfake and why does the government want to make them illegal?

The Independent  

Get the free Morning Headlines email for news from our reporters across the world Sign up to our free Morning Headlines email Sign up to our free Morning Headlines email SIGN UP I would like to be emailed about offers, events and updates from The Independent. Read our privacy policy The creation of sexually explicit “deepfake” images is to be …

WARNING: Creating 'deepfake' to land you in jail; know how UK is cracking down on sexually morphed pics
11 months, 1 week ago

WARNING: Creating 'deepfake' to land you in jail; know how UK is cracking down on sexually morphed pics

Firstpost  

The UK government will penalise people who are found to create such images without consent. Perpetrators will be facing a criminal record against their names and will be slapped with unlimited fines Creating sexually explicit “deepfake” images in the UK can land a person in jail as the country’s Justice Ministry is mulling a new law that will make such …

Creating sexually explicit deepfake images to be criminalised in UK
11 months, 1 week ago

Creating sexually explicit deepfake images to be criminalised in UK

Hindustan Times  

The UK will criminalize the creation of sexually explicit deepfake images as part of plans to tackle violence against women. People convicted of creating such deepfakes without consent, even if they don’t intend to share the images, will face prosecution and an unlimited fine under a new law, the Ministry of Justice said in a statement. “This new offence sends …

Discover Related