Incident 190: ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms

Description: ByteDance allegedly scraped short-form videos, usernames, profile pictures, and descriptions of accounts on Instagram, Snapchat, and other sources, and uploaded them without consent on Flipagram, TikTok’s predecessor, in order to improve its “For You” algorithm's performance on American users.
Alleged: ByteDance developed and deployed an AI system, which harmed Instagram users , Snapchat users and American social media users.

Suggested citation format

AIAAIC. (2017-01-15) Incident Number 190. in McGregor, S. (ed.) Artificial Intelligence Incident Database. Responsible AI Collaborative.

Incident Stats

Incident ID
190
Report Count
4
Incident Date
2017-01-15
Editors
Sean McGregor, Khoa Lam

Tools

New ReportNew ReportDiscoverDiscover

Incidents Reports

The China-based company scraped public accounts and then duplicated them on Flipagram, a predecessor to TikTok, according to four former employees and documents viewed by BuzzFeed News.

In 2017, TikTok’s parent company, ByteDance, scraped short-form videos, usernames, profile pictures, and profile descriptions from Instagram, Snapchat, and other sources and then uploaded them — without users’ knowledge or consent — to Flipagram, a TikTok predecessor, according to four former employees of the company.

BuzzFeed News spoke with the four former ByteDance employees, all of whom worked on Flipagram (later renamed Vigo Video), and viewed internal documents that indicate the scraping was run by an engineering team in China and began soon after ByteDance acquired Flipagram in January 2017. The former employees described the project as one of several “growth hacks” — including the manipulation of like and video view statistics — employed by the company. One of the former employees said the scraping affected hundreds of thousands of accounts, and a document viewed by BuzzFeed News detailed plans to “crawl video > 10k/day in P0 countries” — according to the former employee, this meant the team’s goal was to scrape more than 10,000 videos a day in the highest priority countries. The former employees spoke to BuzzFeed News under the condition of anonymity because they feared retribution from ByteDance.

The former employees do not know when the scraping they say they were aware of stopped. Two of them say that the scraped content was used to train ByteDance’s powerful “For You” personalization algorithm on US-based content so that it would better reflect the preferences of US users. Today, the “For You” algorithm powers both TikTok and its Chinese equivalent, Douyin. (Disclosure: In a previous life, I held policy positions at Facebook and Spotify.)

BuzzFeed News sent ByteDance a comprehensive list of the allegations we intended to print in this article as well as a detailed set of questions, including if data sets from Flipagram were ever used to train the “For You” algorithm that powers TikTok today or to train any other algorithms currently in use by ByteDance.

In response, ByteDance spokesperson Jennifer Banks wrote back two sentences: “ByteDance acquired Flipagram in 2017 and operated it, and subsequently Vigo, for a short time. Flipagram and Vigo ceased operations years ago and aren't connected to any current ByteDance products.”

Flipagram founder and former CEO Farhad Mohit did not respond to requests for comment, nor did his cofounders Raffi Baghoomian and Joshua Feldman. BuzzFeed News did reach Brian Dilley, who was Flipagram’s chief technology officer until October 2017, at his home. When asked whether the company had been scraping and reuploading content in 2017, he replied, “No, in fact I’m positive we were not.” He then ended the interview. BuzzFeed News sent Dilley a follow-up email asking for him to elaborate on his answer and explain his understanding of what was happening at the time. Dilley reiterated that the company had not scraped other platforms during his time there.

The documents reviewed by BuzzFeed News include explicit references to scraped content and the use of fake accounts. In one document, an employee lays out the reasons that the company used “fake accounts” and scraped content; among them were that the accounts could be used to test which content performed best on the platform, and that current users could mimic the scraped content to improve their own popularity. In another document, a different employee explains that a certain account had been scraped and copied onto Flipagram from Instagram. A third document lists account scraping as an “OKR” (‘objective and key result’) for an engineering team in China.

According to the documents, ByteDance began copying content from some of its China-focused short-form video apps and uploading it to Flipagram through fake accounts in early 2017. One document details how the company tried to curate content that was “not too Chinese” and would resonate with US users, but three of the former employees say the content still didn’t perform well with Flipagram’s user base.

In mid-2017, according to the four former employees, ByteDance began scraping and reuploading content from the US. Three of the former employees, and one of the documents, identify Instagram as a source of the scraped content. Two of the former employees remember the company scraping and uploading content from Snapchat and Musical.ly — an app popular with tweens and teens that ByteDance acquired in late 2017, and that would eventually become TikTok.

One of the former employees who identified Snapchat and Musical.ly as sources of the scraping did not identify Instagram as one. This person expressed doubt that the platform was scraped because at least some Instagram videos at the time were square in shape, and videos in the Flipagram app were not. However, another former employee told BuzzFeed News that they recalled conversations about resizing videos and removing watermarks placed on content by other platforms, so that users could not tell that the scraped content originated elsewhere.

Instagram’s and Snap’s terms of service forbade scraping in 2017, as they do today. At the time, Musical.ly’s terms of service prohibited users from “mak[ing] unauthorized copies of any content made available on or through” the platform.

Jason Grosse, a representative for Instagram’s parent company Meta, said the company would not comment at this time. Russ Caditz-Peck, a spokesperson for Snap, said, “Our Terms of Service prohibit scraping and reposting public content from our services, and we implement defenses to limit such attempts.”

In other circumstances, allegations that companies have scraped and reused content without permission have spurred litigation, both by companies and individuals who made the content in question. (Scraping, or crawling, which simply means using a computer to copy information at scale, can also be an invaluable research tool for researchers and journalists seeking to better study and analyze public content.) Companies that have used fake accounts to lure users to their platforms have also been sued by state and federal regulators for deceptive business practices.

Some people noticed that their content had been uploaded to Flipagram without their knowledge or consent, according to the four former employees and complaints made on Twitter. The four former employees told BuzzFeed News that the company received emails from creators who said they were being impersonated on the app. Two of those people recall inquiries from parents asking why their children’s content was on a platform that neither they nor their children had ever heard of. The four sources said employees were instructed to delete the offending accounts or give the person complaining control over them, and tell the complaining creators that Flipagram cannot prevent a user (or fan) from uploading someone else’s content.

The former employees also described other “growth hacks” that ByteDance used to try to make Flipagram popular in 2017. According to three of the former employees, the company manipulated like and video view counts displayed in the app to make creators believe they were more popular than they were. “One like was not one like,” said a former employee who witnessed the manipulation. (Facebook has faced similar allegations that it knowingly inflated video view metrics to increase advertising revenue, which it has disputed.)

According to an internal document, ByteDance also capped video views from scraped content at a certain level; one of the former employees explained this was so that scraped content views would not overwhelm content posted by real Flipagram users. Additionally, according to two sources, Flipagram limited how frequently it would recommend “cross-posts” — content posted first to other platforms, and then reposted to Flipagram — to incentivize creators to post content first to Flipagram and only later to other platforms.

ByteDance did not respond to questions about manipulation of metrics and recommendations practices for Flipagram.

One former employee portrayed ByteDance’s growth tactics as a symptom of a larger, industry-wide obsession with growth at any cost. "The US public and US media often attribute unethical growth strategies practiced by Chinese tech companies to ‘Chinese tech culture,’ when very often those tactics are directly copied from FAANG companies," they said, using an acronym for the American tech giants Facebook, Amazon, Apple, Netflix, and Google. Invoking Steve Jobs’ famous quote that “great artists steal,” and Mark Zuckerberg’s controversial axiom “move fast and break things,” this person continued: “Chinese tech culture is not the enemy. Chinese tech culture is an honest mirror.”

Flipagram was founded in Los Angeles by Farhad Mohit in 2013 as a photo collage and short-form video app. It attracted a young audience — largely teens and tweens — and was once viewed as a threat to Instagram. In January 2017, it was acquired by ByteDance’s news aggregator app, Toutiao, which later rebranded it as Vigo Video. Later that year, ByteDance also acquired the lip-synching app Musical.ly, one of Flipagram’s key rivals.

For a while, staff for the two apps worked alongside one another in Flipagram’s open-plan office building in Los Angeles. The former employees described the period as awkward; as one former employee put it, the teams’ history of competition “led to an uncomfortable and very uncollaborative energy in the workplace.” The products, the source said, “were so similar I don’t think anyone felt like ByteDance was going to put their funding fully behind both.” In February 2018, ByteDance laid off members of the LA-based Flipagram team. Months later, it rebranded Musical.ly as TikTok.

The relationship between Flipagram and TikTok is described differently by different people. On his website and LinkedIn profile, Flipagram founder Mohit describes Flipagram as “now TikTok.” Flipagram’s company profile on LinkedIn describes it the same way. But when ByteDance rolled out TikTok in the US, it was Musical.ly users, not Flipagram users, who opened their apps to a new name, logo, and experience.

ByteDance also did not answer questions from BuzzFeed News about where and how it stored any data it allegedly scraped from Instagram and other platforms. TikTok has undergone a massive initiative in the past year to isolate data from users inside the US in an effort to quell regulators’ fears that the data could be accessed by the Chinese government. But it is unclear whether data from Flipagram — including the allegedly scraped data — was ever kept in data centers in China, or whether it remains there today.

When reached for comment by BuzzFeed News about the alleged scraping, Sen. Richard Blumenthal called on regulators to investigate: “The FTC must swiftly investigate ByteDance’s alleged theft of data from Instagram and Snapchat users — including kids and teens — to deceive the public and boost their algorithm. This type of wrongful and greedy corporate conduct only underscores the urgent need for Congress to pass stronger kids’ privacy and safety legislation.”

This is not the first time ByteDance has been accused of controversial intellectual property practices. Last year, competing Chinese tech giant Tencent filed numerous claims against ByteDance for alleged copyright infringement on its Douyin app. Audiovisual software company Beijing Meishe Network Technology Co. also filed a suit alleging that the company stole, and removed copyright restrictive language from, proprietary code. (ByteDance did not respond to a request for comment on either of the suits.) The company has also faced privacy lawsuits in the past: ByteDance agreed to pay $92 million last year to settle a lawsuit alleging that the company harvested biometric information from TikTok users without permission. When asked for comment by the Associated Press at the time, TikTok provided the following statement: “While we disagree with the assertions, rather than go through lengthy litigation, we’d like to focus our efforts on building a safe and joyful experience for the TikTok community.”

Flipagram had a fraught history with intellectual property too, even before ByteDance acquired it. In 2016, CEO Farhad Mohit admitted that the company had initially allowed users to create content using music that the platform did not have the right to play. In an interview with Recode at the time, Mohit revealed his thinking on bending rules in search of growth.

“We did it kind of like entrepreneurs do sometimes, we kind of just did it and [decided] we’d ask for permission after.”

ByteDance Made Fake Accounts With Content Scraped From Instagram and Snapchat, Former Employees Say

The company repurposed content from other platforms as a growth hack for Flipagram.

To fuel the rise of its app Flipagram, TikTok parent company Bytedance scraped profiles, videos, usernames and other content from Instagram and other social media platforms. Buzzfeed reported that the Chinese company scraped “hundreds of thousands” of accounts for content without users’ consent. Flipagram, which ByteDance acquired back in 2017, allowed users to create short slideshow videos set to music — sort of a simplified version of TikTok and other short-form video apps. The app has since been rebranded as Vigo Video.

The scraping strategy was meant to be a “growth hack” for Flipagram, allowing it to expand its user base, according to former ByteDance employees interviewed by Buzzfeed. Flipagram was scraping up to 10,000 videos per day from high-priority countries, according to one former employee. The three platforms that Flipagram allegedly scraped content from are Instagram, Snapchat and Musical.ly (which is owned by ByteDance and was later absorbed by TikTok). One former Bytedance employee disputes that Instagram was involved in the scrape due to the incompatible sizing of their videos at the time.

The employees also allege that the scraped content from major US social media platforms was then used to build Bytedance’s “For You” algorithm. TikTok has yet to comment on whether Flipagram’s stolen data was used to build TikTok’s “For You” algorithm.

Scraping publicly available data isn’t illegal by itself. Many social platforms find "creative" ways to boost their audience in their early days, like harvesting external content, creating fake profiles or mass-emailing potential users. But companies can also ban unauthorized scraping in their terms and conditions for users, which Instagram and Snapchat both do. Violating such contracts can often lead to lawsuits.

There's an irony to Bytedance in its early days allegedly scraping data from Instagram, since Reels was Instagram's attempt to capture TikTok's audience and instead became a receptacle for old TikToks. In order to keep Reels from driving more traffic to its rival app, Instagram recently announced it would no longer promote TikToks.

TikTok owner ByteDance scraped content from Instagram and others to push predecessor app

Chinese short-video-making app TikTok's parent company ByteDance allegedly made fake accounts with content taken from Instagram, Snapchat and other social media platforms, a new report has claimed.

According to BuzzFeed News, the company then posted those fake accounts on popular mobile app Flipagram to grow further.

"The China-based company scraped public accounts and then duplicated them on Flipagram, a predecessor to TikTok, according to four former employees and documents viewed by BuzzFeed News," the report said late on Monday.

Founded in 2013, Flipagram allowed users to create and share short videos as something of a TikTok precursor.

ByteDance allegedly took videos, usernames, pictures and more from the social media platforms and uploaded them to the app without users' consent or knowledge.

Internal documents reviewed by BuzzFeed News indicate that the scraping was seen as a "growth hack" for the company.

According to the former employee, the team's goal was to "scrape more than 10,000 videos a day in the highest priority countries".

The scraped content was used to train ByteDance's powerful "For You" personalisation algorithm on the US-based content.

"Today, the 'For You' algorithm powers both TikTok and its Chinese equivalent, Douyin," the report noted.

The report also said that ByteDance was scraping and uploading content from Musical.ly, which would later become TikTok as ByteDance acquired the company in 2017.

In a statement, a ByteDance spokesperson said: "ByteDance acquired Flipagram in 2017 and operated it, and subsequently Vigo, for a short time. Flipagram and Vigo ceased operations years ago and aren't connected to any current ByteDance products."

Short video-making platform TikTok has crossed one billion monthly active users around the world.

It has overtaken Facebook as the most downloaded social media app in the world.

TikTok's parent ByteDance made fake accounts scraping content from Instagram, Snapchat and other platforms, claims report

TikTok’s parent company ByteDance made fake accounts with content taken from Instagram, Snapchat and other social media platforms and posted them on Flipagram in 2017, according to a new report today from BuzzFeed News. The report says the company took videos, usernames, pictures and more from the social media platforms and uploaded them to the app without users’ consent or knowledge.

BuzzFeed News spoke with four former ByteDance employees who say the scraping began shortly after the company acquired Flipagram in January 2017. Internal documents reviewed by BuzzFeed News indicate that the scraping was seen as a “growth hack” for the company. One employee said that ByteDance’s goal was to scrape more than 10,000 videos a day.

Two of the employees said that the scraping was used to train and inform ByteDance’s “For You” algorithm, which is currently used today by TikTok and its Chinese equivalent, Douyin. The employees say ByteDance was looking to train the algorithm on U.S.-based content. The report also indicates that ByteDance was scraping and uploading content from Musical.ly, which would later become TikTok once ByteDance acquired the company in 2017.

BuzzFeed News sent ByteDance a list of the allegations along with questions, to which ByteDance responded: “ByteDance acquired Flipagram in 2017 and operated it, and subsequently Vigo, for a short time. Flipagram and Vigo ceased operations years ago and aren’t connected to any current ByteDance products.”

The internal documents include references to the scraped data and reasons explaining why the company was doing so. In one document, an employee explained that the scraped content could be used to test which types of videos performed the best on the platform. The employee had also noted that current users could mimic the content to enhance their own videos and gain popularity.

The former employees said that some people had noticed their social media content was being posted on Flipagram and had reached out to the company. Employees were told to either delete the fake accounts or give control of the account to the person who filed the complaint, the report claims.

Flipagram was founded in 2013 and allowed users to create and share short videos as something of a TikTok pre-cursor.

The practice of scraping content as a growth hack, as this report claims took place, was not unusual for services operating at the time. But it does lead to questions as to whether TikTok’s algorithms were trained using video content from competitor apps. (BuzzFeed was able to get a comment from former Flipagram CTO Brian Dilley, who denied any scraping took place.)

Flipagram’s app garnered popularity among young users and at one point was considered a major threat to Instagram. But while ByteDance took many learnings from Flipagram, it ultimately chose to merge Musical.ly with TikTok and laid off the Flipagram team in February 2018.

TikTok owner ByteDance accused of scraping content from Instagram and Snapchat for its older app Flipagram