How to connect Scrapfly to Hermes Agent
Connect Scrapfly to Hermes with ClawLink: paste your Scrapfly key once and 12 tools work from chat. No MCP server to run, nothing stored on your machine.
ScrapflyAPI KEYMCPScrapfly is a web scraping API that enables developers to extract data from websites efficiently, offering features like JavaScript rendering, anti-bot protection bypass, and proxy rotation.. Once connected, Hermes Agent can read and act on Scrapfly from chat — pairing, token refresh, and tool wiring handled for you.
Most guides for giving Hermes Agent Scrapfly access start with registering your own OAuth app or pasting API keys into env files, then leave the token refresh and tool wiring to you. ClawLink gives Hermes a more practical Scrapfly setup: pair once in the browser and your always-on Hermes agent can act on Scrapfly for you, reading and doing real work on your behalf with no auth, token refresh, or tool wiring to build yourself.
Setup
It takes three steps to connect Hermes to Scrapfly.
1Install and pair
Install the ClawLink plugin, then pair Hermes with a one-time browser approval:
hermes plugins install ClawLink-HQ/hermes-plugin --enable- 2
Connect Scrapfly
Paste your API key in the dashboard.
- 3
Use it from chat
Ask Hermes Agent: "What can you do with Scrapfly?"
Install by command
The prompt above walks Hermes through this. By hand, it is four commands and a browser approval:
hermes plugins install ClawLink-HQ/hermes-plugin --enable
hermes clawlink begin # prints an approval link — open it and approve
hermes clawlink finish # after approving in the browser
hermes clawlink testThen connect Scrapfly in the ClawLink dashboard — paste your Scrapfly API key once.
Verify the connection by asking Hermes:
Use Scrapfly to capture screenshot and walk me through the result in plain English.
Using a different agent?
The Hermes plugin is one client of ClawLink's MCP server. Claude Code, Cursor, Codex, or any agent that can run a shell command pairs with the same ClawLink account through the CLI:
npx -y @useclawlink/cli loginlogin opens the same browser approval and stores a credential locally. Once Scrapfly is connected in the dashboard, that agent calls the same 12 Scrapfly tools over MCP. Full setup for MCP clients and shell agents: connect apps to any AI agent.
Scrapfly MCP for Hermes
Looking for a Scrapfly MCP server for Hermes Agent? ClawLink connects Scrapfly to Hermes Agent and exposes 12 Scrapfly tools your agent can call over MCP, with hosted auth and nothing to run or maintain yourself. Using OpenClaw instead? The OpenClaw Scrapfly integration works the same way.
What the Hermes Agent Scrapfly integration can do
12 Scrapfly tools are ready for Hermes Agent once the account is connected.
All 12 Scrapfly tools for Hermes
| Tool | What it does |
|---|---|
Capture screenshot scrapfly_capture_screenshot | Capture a full-page or viewport screenshot of a website |
Capture screenshot head scrapfly_capture_screenshot_head | Capture screenshot metadata without downloading the image body |
Extract data scrapfly_extract_data | Extract structured data from HTML or other content using AI models, LLM prompts, or custom |
Get account info scrapfly_get_account_info | Retrieve Scrapfly account information |
Get crawler artifact scrapfly_get_crawler_artifact | Download crawler artifact files in WARC or HAR format |
Get crawler contents scrapfly_get_crawler_contents | Retrieve extracted content from crawled pages |
Get crawler status scrapfly_get_crawler_status | Get the current status of a crawler including progress, pages crawled, and completion state |
Get crawler URLS scrapfly_get_crawler_urls | Retrieve the list of discovered and crawled URLs from a crawler |
Scrape scrapfly_scrape | Perform a web scraping request |
Scrape post scrapfly_scrape_post | Scrape web pages using POST method to send data in the request body |
Scrape with put scrapfly_scrape_with_put | Scrape web pages using PUT method with body payload |
Create crawler scrapfly_create_crawler | Create a new web crawler to recursively crawl an entire website |
Try it: find the Scrapfly tool you need
Browse the 12 Scrapfly tools
Click any tool to see exactly what Hermes can do and copy a ready-to-use prompt.
Example prompts
Use Scrapfly to capture screenshot and walk me through the result in plain English.
Use Scrapfly to capture screenshot head and walk me through the result in plain English.
Use Scrapfly to extract data and walk me through the result in plain English.
Pull the relevant data from Scrapfly, summarize it in plain English, and point out anything that needs attention.
ClawLink vs. building it yourself
The alternative to ClawLink is usually manual API key setup plus your own token handling, permission troubleshooting, and tool plumbing for Hermes Agent. That is fine if you want to build and maintain the integration yourself. Most teams just want Scrapfly working from chat.
| Manual | ClawLink | |
|---|---|---|
| Credential handling | Collect, validate, store, and rotate the Scrapfly API key yourself, then make sure every tool call uses the right account. | Users complete the hosted ClawLink setup once and the connected Scrapfly account becomes available to the agent without you building credential management. |
| Ongoing maintenance | You own refresh logic, permission debugging, environment config, and every provider-specific edge case for Scrapfly. | ClawLink handles the repetitive integration plumbing so your team can focus on the workflow instead of the infrastructure. |
| Agent usability | You still need to expose the right Scrapfly actions to the runtime in a format your agent can reliably use. | 12 tools for Scrapfly are already exposed through ClawLink, so the agent can read and act from chat immediately. |
ClawLink vs. Composio
Composio also exposes Scrapfly to AI agents. It is developer infrastructure: Python and TypeScript SDKs, an MCP server, and a catalog past 1,000 apps, aimed at teams shipping agent products. ClawLink is built for Hermes Agent users instead. You install the plugin once, connect Scrapfly in the browser, and the 12 tools above work from chat. There is no SDK and no config file, and the Scrapfly key you paste at setup is stored server-side rather than kept in your environment. Choosing between them? Read the full Composio alternatives comparison.
Troubleshooting
Hermes paired but still can't use Scrapfly
Pairing is a two-step handshake: run hermes clawlink begin, approve the link in your browser, then run hermes clawlink finish. If you ran finish before approving, or the approval link expired, run hermes clawlink begin again to get a fresh link. Confirm the plugin was installed with --enable, then verify with hermes clawlink test.
Connection succeeds but no tools appear
Reconnect Scrapfly from the dashboard, then start a fresh chat if the runtime still has the old tool catalog loaded.
"Tool schema not loaded yet" error when calling Scrapfly tools
Scrapfly tool schemas load on demand the first time a tool runs and are cached after that, so this error usually clears on its own: wait a few seconds and retry the same request. If every Scrapfly call keeps failing with it in a fresh chat, reconnect from the dashboard, and contact support if it still persists — that pattern points to a configuration problem on our side, not something you can fix by reconnecting again.
Scrapfly returns 403 or "permission denied" on one action while others work
Two usual causes. The connected account may not have access to the specific workspace, inbox, store, or project in the request — check that first. If access looks right, the agent may have sent a placeholder value (like "YOUR_ID" or an example id from documentation) instead of a real one: ask it to run a list or search tool first, then retry the action with a real id from those results. Most failures at this stage are one of these two, not ClawLink bugs.
API key setup works but results look incomplete
Double-check that the API key for Scrapfly has the right scopes or account access. A valid key can still be too limited for some reads or writes.
FAQ
Is there a Hermes Agent Scrapfly integration?
Yes. ClawLink is the fastest way to connect Hermes to Scrapfly: link your Scrapfly account once in the browser and Hermes Agent can call the Scrapfly API through 12 ready-made tools — no custom code or token handling.
How do I connect Scrapfly to Hermes with ClawLink?
Install the plugin with hermes plugins install ClawLink-HQ/hermes-plugin --enable, then pair once: run hermes clawlink begin, approve the link in your browser, and run hermes clawlink finish. Connect Scrapfly in the dashboard and Hermes can use it from the next message — no config files, and the Scrapfly key you paste is stored server-side instead of in your environment.
How long does it take to connect Scrapfly to Hermes Agent?
About two minutes. Sign in, click Connect next to Scrapfly in the dashboard, authenticate, and Hermes Agent can use it from the next chat message.
Why use ClawLink instead of wiring Scrapfly up myself?
The alternative to ClawLink is usually manual API key setup plus your own token handling, permission troubleshooting, and tool plumbing for Hermes Agent. That is fine if you want to build and maintain the integration yourself. Most teams just want Scrapfly working from chat.
Hermes paired but still can't use Scrapfly
Pairing is a two-step handshake: run hermes clawlink begin, approve the link in your browser, then run hermes clawlink finish. If you ran finish before approving, or the approval link expired, run hermes clawlink begin again to get a fresh link. Confirm the plugin was installed with --enable, then verify with hermes clawlink test.
Related
DataRobot
DataRobot is a machine learning platform that automates model building, deployment, and monitoring, enabling organizations to derive predictive insights from large datasets.
Connect Chatbotkit
ChatBotKit is a platform that enables developers to build and manage AI-powered chatbots, offering comprehensive APIs and SDKs for seamless integration into applications.
Just One API
Just One API provides unified access to public social media, creator, entertainment, and ecommerce data across hundreds of metered endpoints.