British charities and disability advocates have slammed a trend for using AI to generate "fetishised" images of women with disabilities and genetic conditions including Down syndrome, vitiligo and albinism.
The photo-realistic sexualised images, which have gained millions of views on social media, are deceptive as they are often not labelled as AI-generated.
Some account owners use artificial intelligence to manipulate real images of non-disabled women, making them appear to have Down syndrome, a genetic condition caused by an extra chromosome.
One such TikTok video of a young woman dancing in shorts and a cropped top has had 4 million views since last year.
The British Down's Syndrome Association condemned the "alarming trend".Â
"This is a scam and is not only in bad taste but is potentially offensive and hurtful to people who have Down's syndrome," the charity said in comments sent to AFP.
Disabled women and girls already face a higher risk of sexual violence globally.
In Britain, women with disabilities are nearly twice as likely to be sexually assaulted, according to the Office for National Statistics.
The images show "very fetishised bodies" and "very sexual content", said Aisha Sobey, a University of Cambridge researcher studying generative AI.
Kamran Mallick, CEO of Disability Rights UK, said the images are "exploitation" and recall "historical freak shows of people being wheeled out for the amusement of others".
These AI influencers "are mostly young white women," said Emanuel Maiberg of the 404 Media tech news outlet who has covered the trend.
"It certainly seems like content that is more outrageous, novel, or weird, gets more engagement."
Higgsfield, a platform for generating virtual models, gives creators options to add scars, burns, albinism -- a lack of melanin pigmentation -- and vitiligo, which causes white patches on the skin.Â
"The internet doesn't want a perfect face. It wants character. So give them scars, give them style," says a promotional video for Higgsfield, adding "AI influencers with vitiligo have been really popular lately".
- 'Harmful and unacceptable' -
The AI images are often medically unlikely or impossible.
One creator labelled as based in Germany shows an AI model with albinism in a strappy vest top driving a car without glasses -- despite the fact that many with the condition have poor eyesight.
An Instagram account with millions of views shows a woman in swimsuits and gymwear whose body is bisected by vitiligo so she is exactly half white and half brown.
"This form of AI use is harmful and unacceptable," the Vitiligo Society told AFP.
"When AI creates fictional individuals with vitiligo and portrays them as authentic members of the community, this crosses into the territory of misinformation," said the British charity.
Real influencers with albinism told AFP that most AI-generated content fetishises the condition and is inaccurate.
US influencer Kayla Ludlow, who has 857,000 followers on TikTok, said in a video responding to AFP's questions that she could understand people trying filters out of curiosity.
But "especially with the AI model content, that just seems like it's a fetish," she said.
Unlike real influencers, the models "don't have a personality or a life or something for you to be invested with", she said.
"It just feels wrong to fetishise albinism in that way," said British influencer Mio, 22, who posts about makeup and skincare to her more than 47,000 followers on Instagram and TikTok.Â
"I think the main reason is to make money, which is so intensely wrong."
AI images perpetuate "misinformation", for example that people with albinism have red eyes, she said.
Other AI models trivialise and sexualise severe medical conditions.
One Instagram page with 400,000 followers, apparently based in the United States, shows conjoined twins in bikinis on the beach.Â
am/rhb/jkb/sbk/ane
Keep reading
The US Senate moved Friday to end a budget standoff that has forced thousands of airport security staff to work without pay and caused long delays at airports.
Two Bengal tiger cubs born in Indonesia's Bandung Zoo last year have died from a viral infection, a conservation official told AFP on Friday.Â
Bradley Rowen Liu, 11, wonders what he will do with himself once Indonesia's social media ban for under-16s enters into force on Saturday. As things stand, he spends most of his free time on TikTok.
(0) comments
Welcome to the discussion.
Log In
Post a comment as Guest
Keep it Clean. Please avoid obscene, vulgar, lewd, racist or sexually-oriented language.
PLEASE TURN OFF YOUR CAPS LOCK.
Don't Threaten. Threats of harming another person will not be tolerated.
Be Truthful. Don't knowingly lie about anyone or anything.
Be Nice. No racism, sexism or any sort of -ism that is degrading to another person.
Be Proactive. Use the 'Report' link on each comment to let us know of abusive posts.
Share with Us. We'd love to hear eyewitness accounts, the history behind an article.