Crawlbase Scraper API
Crawlbase Scraper API fetches a target URL through managed infrastructure with optional JavaScript rendering, automatic parsing, country routing, and HTML or JSON output.
Connect this API to an AI agent Browse all specs
What you can do with Crawlbase Scraper API via MCP
Every endpoint below becomes a governed tool your AI agent (Claude, ChatGPT, or a customer-facing VX agent) can call — with scoped permissions, sandbox testing, and audit logs.
| Method | Path | Operation | Description |
|---|---|---|---|
| GET | / |
get | Fetch a URL Method: GET Path: / IMPORTANT: This function has 2 REQUIRED parameter(s) and 5 OPTIONAL parameter(s) REQUIRED parameters MUST be provided OPTIONAL parameters can be omitted if not needed Parameters: Query Parameters: REQUIRED: - token: Crawlbase API token. - url: Absolute URL to crawl or fetch. OPTIONAL: - format: Response format. - autoparse: Enable supported automatic parsing. - javascript: Enable JavaScript rendering. - country: Proxy country code. - device: Device profile. |
Usage guide
## Authentication Create a Crawlbase token in the Crawlbase dashboard. Send it as the required `token` query parameter. Crawlbase may provide separate tokens for the normal and JavaScript endpoints; use the token appropriate for the endpoint/features in your account. Keep tokens server-side. ## Operation `GET /` requires the target `url`. Use `javascript=true` for dynamic pages, `autoparse=true` when Crawlbase supports automatic parsing for the target, and `format=json` when JSON output is available. The default response is the fetched page content. ## Example ```bash curl -G "https://api.crawlbase.com/" \ --data-urlencode "token=$CRAWLBASE_TOKEN" \ --data-urlencode "url=https://example.com" \ --data-urlencode "javascript=true" ``` Official documentation: https://crawlbase.com/docs
How to use this spec
- Create a free VX Agents account (sandbox tools included).
- Open the marketplace and connect “Crawlbase Scraper API” to an agent.
- Expose it as an MCP server for Claude/ChatGPT, or chat with it directly.