Development — entry 069 of 100
Crawlbase
Crawlbase, the product formerly branded ProxyCrawl (proxycrawl.com now 301-redirects here), returns HTML, Markdown, or structured JSON from any URL through a single Crawling API, alongside a rotating Smart AI Proxy across 30 regions and an asynchronous Enterprise Crawler for bulk jobs. It bills per successful request at complexity-based rates (roughly $4-4.90 per 1,000) with 10,000 free requests a month and no card required.
AuthenticationAPI KeySign up with the provider to obtain credentials.
HTTPSSupportedTraffic is encrypted in transit.
CORSDisabledBrowser calls need a server-side proxy.
PricingFreemiumA usable free tier exists, with paid plans for more volume.
FormatsHTML, Markdown, JSONResponses can be requested as HTML or Markdown or JSON.
GreatAPIs Score
Score81
Authentication15/25API key required
Pricing17/20Freemium tier available
Docs14/20Documentation URL provided
Formats15/15Supports 3 response formats
Freshness20/20Verified within 6 months
Embed this badge
<a href="https://greatapis.com/api/proxycrawl/"><img src="https://greatapis.com/badge/proxycrawl.svg" alt="Scored 81 on greatapis.com"></a>Auth quickstart
- Sign up with the provider to get an API key.
- Send it on every request as a header
Authorization: <key> - The exact header isn't documented — Authorization is a common default; confirm in the provider's docs.
Stored keyNo key stored
Your key is stored only in this browser (localStorage) and sent directly to the API — never to greatapis.