!Image 3: Cloudflare Developers
#### Cloudflare Developers
@CloudflareDev · 12h ago
Introducing the new /crawl endpoint - one API call and an entire site crawled. No scripts. No browser management. Just the content in HTML, Markdown, or JSON.
344
564
8,224
2.3M
6 Replies
5 Retweets
66 Likes
14.8K Views 
One Sentence Summary
Cloudflare has released the /crawl API endpoint, supporting HTML, Markdown, and JSON outputs to streamline large-scale web crawling.
Summary
The Cloudflare developer platform has introduced the new /crawl endpoint, enabling users to scrape entire websites via a single API call. This eliminates the need for complex scripting or browser management while offering outputs in HTML, Markdown, or JSON. The tweet author suggests this could disrupt the web scraping market and highlights the pricing: a free tier with 10 minutes daily and a paid tier with 10 hours monthly. This is a key infrastructure update for developers focusing on AI training or content aggregation.
AI Score
82
Influence Score 26
Published At Today
Language
Chinese
Tags
Cloudflare
Web Scraping
API
Developer Tools