The Internet’s Latest Horror? AI Deepfakes Targeting The Vulnerable

AI can create incredible things—and horrifying ones too. I've always wondered how we will fight against the horrific. New trends show it’s being used to exploit people with Down syndrome. Can we stop it? Probably not. But that doesn't mean it's not worth the fight.

The rise of hyper-sexualized AI images reveals the urgent need for ethics discussions, and platform accountability. The misuse of artificial intelligence was bound to happen. One of the most alarming recent trends is the rise of hyper-sexualized, AI-generated depictions of people with Down syndrome. These pictures and videos are going viral on social media platforms like Tik Tok and Instagram. It's disturbing.

AI in real life in the physical world is still pretty detectable, but online it is getting so advanced that I am often finding myself second guessing images and their authenticity.

This raises a difficult question: Can we ever really stop disturbing AI content from spreading?

The truth is that we really cannot fully stop the spread or ever eliminate disturbing content, unless we want to live in a police state or have everyone on the internet be an informant with millions of accounts being falsely reported. Even then, harmful content that gets taken down on mainstream platforms can often reappear on lesser-known sites or encrypted channels. Any media, especially when disguised as satire or art, can also slip through moderation filter.

So what are our options to help? We’re not helpless.
We may not be able to stop all disturbing content from surfacing. But we can make it harder to create, more dangerous to share, and less profitable to spread. We have to fight back. Silence or inaction only allows this type of content to run rampant.
Better AI moderation tools, stronger platform policies, and international cooperation on tech laws are all crucial steps. Just as important is educating the public—so that people understand what they're seeing, report it instead of sharing it, and hold platforms accountable.

Get our free mobile app