AI & ML8 toolsPaste one API key
Crawlbase integration for AI agents
Crawlbase provides APIs for crawling web pages, managing crawler queues, storing crawl results, and monitoring account usage.
Use it from your agent
One ClawLink account serves every agent you run. Pick the guide for yours, or connect Crawlbase once and call the same tools from all of them.
Crawlbase for OpenClawInstall, pair, connect, first prompt
Crawlbase for Hermes AgentInstall, pair, connect, first promptMCPClaude Code, Cursor, any MCP clientCLI login or the remote MCP serverSetup
Connect Crawlbase through ClawLink's hosted setup.
- Auth: Paste one API key. The credential stays on the ClawLink server; your agent holds only a ClawLink key you can revoke.
- Where: the ClawLink dashboard, or ask your agent to connect it.
What your agent can do
Crawlbase exposes 8 tools through ClawLink. The 7 most used are listed here; your agent sees all of them.
| Tool | What it does | Kind |
|---|---|---|
crawlbase_generate_user_agents | Generate one to ten realistic randomized User-Agent strings for a selected device class | Read |
crawlbase_get_crawling_usage | Return current Crawling API usage and optionally previous-month statistics for the connected | Read |
crawlbase_get_storage_count | Return the number of pages currently held in Crawlbase Cloud Storage | Read |
crawlbase_get_stored_page | Retrieve the latest Crawlbase Cloud Storage page by exactly one request ID or original URL | Read |
crawlbase_get_stored_pages | Retrieve up to 100 Crawlbase Cloud Storage pages by request ID without deleting them | Read |
crawlbase_list_stored_page_ids | Return one page of Crawlbase Cloud Storage request IDs and a short-lived continuation cursor | Read |
crawlbase_crawl_url | Fetch a public HTTP or HTTPS URL through Crawlbase using the connected Normal token and return | Read |
