SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT • SAM ALTMAN SAYS AGENTS ARE COMING • CHATGPT GAINED SENTIENCE FOR 4 SECONDS • GOOGLE RELEASES 40th LLM THIS WEEK • NVIDIA MARKET CAP EXCEEDS REALITY • ANTHROPIC ENGINEER DISCOVERS NEW FORM OF GRIEF • MISTRAL RAISES AT VALUATION OF GROSS DOMESTIC PRODUCT •
toolsWTF 8.6via r/MachineLearning

I scraped 5.94 billion TikTok videos and 3.23 billion profiles in 3 weeks. Uploaded full dataset to Hugging Face for free. Step by step tutorial and code below. [P]

"Someone just handed the internet 6 billion TikToks on a silver platter. ByteDance is not amused."

Explain Like I'm Normal

A developer reverse-engineered TikTok's mobile API to scrape nearly 6 billion videos and 3.2 billion profiles, making the massive dataset public on Hugging Face. While the data itself is public, the scale of the scrape likely violates terms of service, providing a massive goldmine for training multimodal AI and recommendation algorithms. The user is charging for the specific scraping tool but gave the raw data away for free.

Read original ↗
#dataset#scraping#tiktok#multimodal#open-source

GET THE DAILY CHAOS

The only newsletter for people who read AI news at 3am and feel things. One email a day.