Caymans Post

A world within. A state apart.
Thursday, Mar 28, 2024

TikTok empowered these plus-sized women, then took down some of their posts. They still don't know why

TikTok empowered these plus-sized women, then took down some of their posts. They still don't know why

After losing her marketing job due to the pandemic and then gaining 40 pounds, Remi Bader, 25, began spending more time on TikTok. She built up a following by posting about clothing items not fitting her correctly and her struggle to find larger sizes in New York City stores.

But in early December, Bader, who now has more than 800,000 followers, tried on a too-small pair of brown leather pants from Zara, and viewers caught a glimpse of her partially naked butt. TikTok quickly deleted the video, citing its policy against "adult nudity." It was upsetting to Bader given that her video, which was meant to promote body positivity, was taken down while videos from other TikTok users that appear sexually suggestive remain on the app. "That to me makes no sense," she said.

Julia Kondratink, a 29-year-old biracial blogger who describes herself as "mid-sized," had a similarly unexpected takedown on the platform in December.

TikTok deleted a video featuring her wearing blue lingerie due to "adult nudity." "I was in shock," she told CNN Business. "There wasn't anything graphic or inappropriate about it."

And Maddie Touma says she has watched it happen to her videos multiple times. The 23-year-old TikTok influencer with nearly 200,000 followers has had videos of her wearing lingerie, as well as regular clothing, taken down. It made her rethink the content she posts, which can be a difficult tradeoff since her mission is body positivity.

"I actually started to change my style of content, because I was scared my account was going to either be removed or just have some sort of repercussions for getting flagged so many times as against community guidelines," Touma said.

Scrolling through videos on TikTok, the short-form video app especially popular among teens and 20-somethings, there's no shortage of scantily clad women and sexually suggestive content. So when curvier influencers like Bader and Touma post similar videos that are then removed, they can't help but question what happened: Was it a moderator's error, an algorithm's error or something else? Adding to their confusion is the fact that even after appealing to the company, the videos don't always get reinstated.

Remi Bader has amassed a following of nearly 800,000 on TikTok.


They're not the only ones feeling frustrated and confused. Adore Me, a lingerie company that partners with all three women on sponsored social media posts, recently made headlines with a series of tweets claiming that TikTok's algorithms are discriminating against its posts with plus-sized women, as well as posts with "differently abled" models and women of color. (After its public Twitter thread, TikTok reinstated the videos, Ranjan Roy, Adore Me's VP of strategy, told CNN Business.) The issue isn't new, either: Nearly a year ago, the singer Lizzo, who is known for her vocal support of body positivity, criticized TikTok for removing videos showing her in a bathing suit, but not, she claimed, swimwear videos from other women.

Content-moderation issues aren't limited to TikTok, of course, but it's a relative newcomer compared to Facebook, Twitter, and others that have faced blowback for similar missteps for years. Periodically, groups and individuals raise concerns that the platforms are inappropriately and perhaps deliberately censoring or limiting the reach of their posts when the truth is far less clear. In the case of the plus-sized influencers, it's not evident whether they're being impacted more than anyone else by content takedowns, but their cases nonetheless offer a window to understand the messy and sometimes inconsistent content moderation process.

The murkiness of what actually happened to these influencers highlights both the mystery of how algorithms and content moderation work and also the power that these algorithms and human moderators — often working in concert — have over how we communicate, and even, potentially, over whose bodies have a right to be viewed on the internet. Those in the industry say likely explanations range from artificial intelligence bias to cultural blindspots from moderators. But those outside the industry feel left in the dark. As Bader and Adore Me found, posts can disappear even if you believe you're following the rules. And the results can be confounding and hurtful, even if they're unintentional.

"It's frustrating for me. I have seen thousands of TikTok videos of smaller people in a bathing suit or in the same type of outfit that I would be wearing, and they're not flagged for nudity," Touma said. "Yet me as a plus sized person, I am flagged."

A sense of not knowing is pervasive


For years, tech platforms have relied on algorithms to determine much of what you see online, whether it's the songs Spotify plays for you, the tweets Twitter surfaces on your timeline, or the tools that spot and remove hate speech on Facebook. Yet, while many of the big social media companies use AI to complement the experience their users have, it's even more central to how you use TikTok.

TikTok's "For You" page, which relies on AI systems to serve up content it thinks individual users will like, is the default and predominant way people use the app. The prominence of the "For You" page has created a pathway to viral fame for many TikTok users, and is one of the app's defining features: Because it uses AI to highlight certain videos, it occasionally enables someone with no followers to garner millions of views overnight.

But TikTok's choice to double down on algorithms comes at a time of widespread concerns about filter bubbles and algorithmic bias. And like many other social networks, TikTok also uses AI to help humans sift through large numbers of posts and remove objectionable content. As a result, people like Bader, Kondratink and Touma who have had their content removed can be left trying to parse the black box that is AI.

TikTok told CNN Business that it doesn't take action on content based on body shape or other characteristics, as Adore Me alleges, and the company said it has made a point of working on recommendation technology that reflects more diversity and inclusion. Furthermore, the company said US-based posts may be flagged by an algorithmic system but a human ultimately decides whether to take them down; outside the United States, content may be removed automatically.

"Let us be clear: TikTok does not moderate content on the basis of shape, size, or ability, and we continually take steps to strengthen our policies and promote body acceptance," a TikTok spokesperson told CNN Business. However, TikTok has limited the reach of certain videos in the past: In 2019, the company confirmed it had done so in an attempt to prevent bullying. The company statement followed a report alleging the platform took action on posts from users who were overweight, among others.

While tech companies are eager to talk to the media and lawmakers about their reliance on AI to help with content moderation — claiming it's how they can manage such a task at mass scale — they can be more tight lipped when something goes wrong. Like other platforms, TikTok has blamed "bugs" in its systems and human reviewers for controversial content removals in the past, including those connected to the Black Lives Matter movement. Beyond that, details about what may have happened can be thin.

AI experts acknowledge that the processes can seem opaque in part because the technology itself isn't always well understood, even by those who are building and using it. Content moderation systems at social networks typically use machine learning, which is an AI technique where a computer teaches itself to do one thing — flag nudity in photographs, for instance — by poring over a mountain of data and learning to spot patterns. Yet while it may work well for certain tasks, it's not always clear exactly how it works.

"We don't have a ton of insight a lot of times into these machine learning algorithms and the insights they're deriving and how they're making their decisions," said Haroon Choudery, cofounder of AI for Anyone, a nonprofit aimed at improving AI literacy.

But TikTok wants to be the poster child for changing that.

A look inside the black box of content moderation


In the midst of international scrutiny over security and privacy concerns related to the app, TikTok's former CEO, Kevin Mayer, said last July that the company would open up its algorithm to experts. These people, he said, would be able to watch its moderation policies in real time "as well as examine the actual code that drives our algorithms." Almost two dozen experts and congressional offices have participated in it — virtually, due to Covid — thus far, according to a company announcement in September. It included showing how TikTok's AI models search for harmful videos, and software that ranks it in order of urgency for human moderators' review.

Eventually, the company said, guests at actual offices in Los Angeles and Washington, D.C. "will be able to sit in the seat of a content moderator, use our moderation platform, review and label sample content, and experiment with various detection models."

"TikTok's brand is to be transparent," said Mutale Nkonde, a member of the TikTok advisory council and fellow at the Digital Civil Society Lab at Stanford.

Even so, it's impossible to know precisely what goes into each decision to remove a video from TikTok. The AI systems that large social media companies rely on to help moderate what you can and can't post do have one major thing in common: They're using technology that's still best suited to fixing narrow problems to address a problem that is widespread, ever changing, and so nuanced it can even be tricky for a human to understand.

Because of that, Miriam Vogel, president and CEO of nonprofit EqualAI, which helps companies decrease bias in their AI systems, thinks platforms are trying to get AI to do too much when it comes to moderating content. The technology is also prone to bias: As Vogel points out, machine learning is based on pattern recognition, which means making snap decisions based on past experience. That alone is implicit bias; the data that a system is trained on and a number of other factors can present more biases related to gender, race, or many other factors, as well.

"AI is certainly a useful tool. It can create tremendous efficiencies and benefits," Vogel said. "But only if we're conscious of its limitations."

For instance, as Nkonde pointed out, an AI system that looks at text that users post may have been trained to spot certain words as insults — "big", "fat", or "thick", perhaps. Such terms have been reclaimed as positive among those in the body positivity community, but AI doesn't know social context; it just knows to spot patterns in data.

Furthermore, TikTok employs thousands of moderators, including full-time employees and contractors. The majority are located in the United States, but it also employs moderators in Southeast Asia. That could result in a situation where a moderator in the Philippines, for instance, may not know what body positivity is, she said. So if that sort of video is flagged by AI, and is not part of the moderator's cultural context, they may take it down.

Moderators work in the shadows


It remains unclear exactly how TikTok's systems misfired for Bader, Touma and others, but AI experts said there are ways to improve how the company and others moderate content. Rather than focusing on better algorithms, however, they say it's important to pay attention to the work that must be done by humans.

Liz O'Sullivan, vice president of responsible AI at algorithm auditing company Arthur, thinks part of the solution to improving content-moderation generally lies in elevating the work done by these workers. Often, she noted, moderators work in the shadows of the tech industry: the work is outsourced to call centers around the world as low-paid contract work, despite the often unsavory (or worse) images, text, and videos they're tasked with sorting through.

To fight unwanted biases, O'Sullivan said a company also has to look at every step of building their AI system, including curating the data that's used to train the AI. For TikTok, which already has a system in place, this may also mean keeping a closer watch on how the software does its job.

Vogel agreed, saying companies need to have a clear process not just for checking AI systems for biases, but also for determining what biases they're looking for, who's responsible for looking for them, and what kinds of outcomes are okay and not okay.

"You can't take humans outside of the system," she said.

If changes aren't made, the consequences may not just be felt by social media users, but also by the tech companies themselves.

"It lessened my enthusiasm for the platform," Kondratink said. "I've contemplated just deleting my TikTok altogether."

Newsletter

Related Articles

Caymans Post
0:00
0:00
Close
Paper straws found to contain long-lasting and potentially toxic chemicals - study
FTX's Bankman-Fried headed for jail after judge revokes bail
Blackrock gets half a trillion dollar deal to rebuild Ukraine
Israel: Unprecedented Civil Disobedience Looms as IDF Reservists Protest Judiciary Reform
America's First New Nuclear Reactor in Nearly Seven Years Begins Operations
Southeast Asia moves closer to economic unity with new regional payments system
Today Hunter Biden’s best friend and business associate, Devon Archer, testified that Joe Biden met in Georgetown with Russian Moscow Mayor's Wife Yelena Baturina who later paid Hunter Biden $3.5 million in so called “consulting fees”
Singapore Carries Out First Execution of a Woman in Two Decades Amid Capital Punishment Debate
Google testing journalism AI. We are doing it already 2 years, and without Google biased propoganda and manipulated censorship
Unlike illegal imigrants coming by boats - US Citizens Will Need Visa To Travel To Europe in 2024
Musk announces Twitter name and logo change to X.com
The politician and the journalist lost control and started fighting on live broadcast.
The future of sports
Unveiling the Black Hole: The Mysterious Fate of EU's Aid to Ukraine
Farewell to a Music Titan: Tony Bennett, Renowned Jazz and Pop Vocalist, Passes Away at 96
Alarming Behavior Among Florida's Sharks Raises Concerns Over Possible Cocaine Exposure
Transgender Exclusion in Miss Italy Stirs Controversy Amidst Changing Global Beauty Pageant Landscape
Joe Biden admitted, in his own words, that he delivered what he promised in exchange for the $10 million bribe he received from the Ukraine Oil Company.
TikTok Takes On Spotify And Apple, Launches Own Music Service
Global Trend: Using Anti-Fake News Laws as Censorship Tools - A Deep Dive into Tunisia's Scenario
Arresting Putin During South African Visit Would Equate to War Declaration, Asserts President Ramaphosa
Hacktivist Collective Anonymous Launches 'Project Disclosure' to Unearth Information on UFOs and ETIs
Typo sends millions of US military emails to Russian ally Mali
Server Arrested For Theft After Refusing To Pay A Table's $100 Restaurant Bill When They Dined & Dashed
The Changing Face of Europe: How Mass Migration is Reshaping the Political Landscape
China Urges EU to Clarify Strategic Partnership Amid Trade Tensions
Europe is boiling: Extreme Weather Conditions Prevail Across the Continent
The Last Pour: Anchor Brewing, America's Pioneer Craft Brewer, Closes After 127 Years
Democracy not: EU's Digital Commissioner Considers Shutting Down Social Media Platforms Amid Social Unrest
Sarah Silverman and Renowned Authors Lodge Copyright Infringement Case Against OpenAI and Meta
Italian Court's Controversial Ruling on Sexual Harassment Ignites Uproar
Why Do Tech Executives Support Kennedy Jr.?
The New York Times Announces Closure of its Sports Section in Favor of The Athletic
BBC Anchor Huw Edwards Hospitalized Amid Child Sex Abuse Allegations, Family Confirms
Florida Attorney General requests Meta CEO's testimony on company's platforms' alleged facilitation of illicit activities
The Distorted Mirror of actual approval ratings: Examining the True Threat to Democracy Beyond the Persona of Putin
40,000 child slaves in Congo are forced to work in cobalt mines so we can drive electric cars.
BBC Personalities Rebuke Accusations Amidst Scandal Involving Teen Exploitation
A Swift Disappointment: Why Is Taylor Swift Bypassing Canada on Her Global Tour?
Historic Moment: Edgars Rinkevics, EU's First Openly Gay Head of State, Takes Office as Latvia's President
Bye bye democracy, human rights, freedom: French Cops Can Now Secretly Activate Phone Cameras, Microphones And GPS To Spy On Citizens
The Poor Man With Money, Mark Zuckerberg, Unveils Twitter Replica with Heavy-Handed Censorship: A New Low in Innovation?
Unilever Plummets in a $2.5 Billion Free Fall, to begin with: A Reckoning for Misuse of Corporate Power Against National Interest
Beyond the Blame Game: The Need for Nuanced Perspectives on America's Complex Reality
Twitter Targets Meta: A Tangle of Trade Secrets and Copycat Culture
The Double-Edged Sword of AI: AI is linked to layoffs in industry that created it
US Sanctions on China's Chip Industry Backfire, Prompting Self-Inflicted Blowback
Meta Copy Twitter with New App, Threads
The New French Revolution
BlackRock Bitcoin ETF Application Refiled, Naming Coinbase as ‘Surveillance-Sharing’ Partner
×