‘You Know What To Do, Boys’: Sexist App Lets Men Rate AI-Generated Women

tree@lemmy.zip to Feminism@beehaw.org – 61 points –
‘You Know What To Do, Boys’: Sexist App Lets Men Rate AI-Generated Women
vice.com

20 years after Mark Zuckerberg’s infamous ‘hot-or-not’ website, developers have learned absolutely nothing.


Two decades after Mark Zuckerberg created FaceMash, the infamously sexist “hot-or-not” website that served as the precursor to Facebook, a developer has had the bright idea to do the exact same thing—this time with all the women generated by AI.

A new website, smashorpass.ai, feels like a sick parody of Zuckerberg’s shameful beginnings, but is apparently meant as an earnest experiment exploring the capabilities of AI image recommendation. Just like Zuck’s original site, “Smash or Pass” shows images of women and invites users to rate them with a positive or negative response. The only difference is that all the “women” are actually AI generated images, and exhibit many of the telltale signs of the sexist bias common to image-based machine learning systems.

For starters, nearly all of the imaginary women generated by the site have cartoonishly large breasts, and their faces have an unsettling airbrushed quality that is typical of AI generators. Their figures are also often heavily outlined and contrasted with backgrounds, another dead giveaway for AI generated images depicting people. Even more disturbing, some of the images omit faces altogether, depicting headless feminine figures with enormous breasts.

According to the site’s novice developer, Emmet Halm, the site is a “generative AI party game” that requires “no further explanation.”

“You know what to do, boys,” Halm tweeted while introducing the project, inviting men to objectify the female form in a fun and novel way. His tweet debuting the website garnered over 500 retweets and 1,500 likes. In a follow-up tweet, he claimed that the top 3 images on the site all had roughly 16,000 "smashes."

Understandably, AI experts find the project simultaneously horrifying and hilariously tonedeaf. “It's truly disheartening that in the 20 years since FaceMash was launched, technology is still seen as an acceptable way to objectify and gather clicks,” Sasha Luccioni, an AI researcher at HuggingFace, told Motherboard after using the Smash or Pass website.

One developer, Rona Wang, responded by making a nearly identical parody website that rates men—not based on their looks, but how likely they are to be dangerous predators of women.

The sexist and racist biases exhibited by AI systems have been thoroughly documented, but that hasn’t stopped many AI developers from deploying apps that inherit those biases in new and often harmful ways. In some cases, developers espousing “anti-woke” beliefs have treated bias against women and marginalized people as a feature of AI, and not a bug. With virtually no evidence, some conservative outrage jockeys have claimed the opposite—that AI is “woke” because popular tools like ChatGPT won’t say racial slurs.

The developer’s initial claims about the site’s capabilities seem to be exaggerated. In a series of tweets, Halm claimed the project is a “recursively self-improving” image recommendation engine that uses the data collected from your clicks to determine your preference in AI-generated women. But the currently-existing version of the site doesn’t actually self-improve—using the site long enough results in many of the images repeating, and Halm says the recursive capability will be added in a future version.

It's also not gone over well with everyone on social media. One blue-check user responded, "Bro wtf is this. The concept of finetuning your aesthetic GenAI image tool is cool but you definitely could have done it with literally any other category to prove the concept, like food, interior design, landscapes, etc."

Halm could not be reached for comment.

“I’m in the arena trying stuff,” Halm tweeted. “Some ideas just need to exist.”

Luccioni points out that no, they absolutely do not.

“There are huge amounts of nonhuman data that is available and this tool could have been used to generate images of cars, kittens, or plants—and yet we see machine-generated images of women with big breasts,” said Luccioni. “As a woman working in the male-dominated field of AI, this really saddens me.”


67

You are viewing a single comment

But the application does not ask you whether or not you find the woman attractive

It asks you whether you want to "smash" her. The same word could be used for a sex doll recommendation application. That's objectification

The same word could also be used to evaluate if you should kill an insect, so what's the point? It is a short form for: "Do you find given appearance sexually attractive, or not?" That term would be a bit long for a button, wouldn't it?

In that context that word is clearly meant as a synonym to "bang", "fuck" or penetrate. Definitely not to crush an insect

There are several words that would be suited to say "you find her attractive". Like "love" or "like" or just a heart emoticon. No need to have a paragraph on that button