How to connect Braintrust to Hermes Agent (paste one key, 17 tools)

Most guides for giving Hermes Agent Braintrust access start with registering your own OAuth app or pasting API keys into env files, then leave the token refresh and tool wiring to you. ClawLink gives Hermes a more practical Braintrust setup: pair once in the browser and your always-on Hermes agent can act on Braintrust for you, reading and doing real work on your behalf with no auth, token refresh, or tool wiring to build yourself.

Setup

It takes three steps to connect Hermes to Braintrust.

1
Install and pair
Install the ClawLink plugin, then pair Hermes with a one-time browser approval:
hermes plugins install ClawLink-HQ/hermes-plugin --enable
2
Connect Braintrust
Paste your API key in the dashboard.
3
Use it from chat
Ask Hermes Agent: "What can you do with Braintrust?"

Install by command

The prompt above walks Hermes through this. By hand, it is four commands and a browser approval:

hermes plugins install ClawLink-HQ/hermes-plugin --enable
hermes clawlink begin    # prints an approval link — open it and approve
hermes clawlink finish   # after approving in the browser
hermes clawlink test

Then connect Braintrust in the ClawLink dashboard — paste your Braintrust API key once.

Verify the connection by asking Hermes:

Pull the relevant data from Braintrust, summarize it in plain English, and point out anything that needs attention.

Using a different agent?

The Hermes plugin is one client of ClawLink's MCP server. Claude Code, Cursor, Codex, or any agent that can run a shell command pairs with the same ClawLink account through the CLI:

npx -y @useclawlink/cli login

login opens the same browser approval and stores a credential locally. Once Braintrust is connected in the dashboard, that agent calls the same 17 Braintrust tools over MCP. Full setup for MCP clients and shell agents: connect apps to any AI agent.

Braintrust MCP for Hermes

Looking for a Braintrust MCP server for Hermes Agent? ClawLink connects Braintrust to Hermes Agent and exposes 17 Braintrust tools your agent can call over MCP, with hosted auth and nothing to run or maintain yourself. Using OpenClaw instead? The OpenClaw Braintrust integration works the same way.

What the Hermes Agent Braintrust integration can do

17 Braintrust tools are ready for Hermes Agent once the account is connected. The 15 below are the ones people reach for most; your agent can call all 17.

15 of 17 Braintrust tools for Hermes

Tool	What it does
Fetch events `braintrust_fetch_events`	Fetch one newest-to-oldest page of project log, experiment, or dataset events
Get resource `braintrust_get_resource`	Get one project, experiment, dataset, prompt, or function by UUID
List resources `braintrust_list_resources`	List and filter one page of projects, experiments, datasets, prompts, or functions visible to
Query data `braintrust_query_data`	Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment
Summarize resource `braintrust_summarize_resource`	Return metadata and optional aggregate summaries for one Braintrust experiment or dataset
Create dataset `braintrust_create_dataset`	Create a named dataset under a Braintrust project, or return the existing dataset unchanged
Create experiment `braintrust_create_experiment`	Create an experiment under a Braintrust project
Create project `braintrust_create_project`	Create a Braintrust project, or return the existing project unchanged when its name already
Create prompt `braintrust_create_prompt`	Upsert a versioned prompt configuration under a Braintrust project without invoking it
Insert dataset events `braintrust_insert_dataset_events`	Upsert a batch of examples into an existing Braintrust dataset
Insert experiment events `braintrust_insert_experiment_events`	Upsert a batch of result events into an existing Braintrust experiment
Update dataset `braintrust_update_dataset`	Update the name, description, tags, or metadata of a Braintrust dataset
Update experiment `braintrust_update_experiment`	Update selected metadata and linkage fields on a Braintrust experiment
Update project `braintrust_update_project`	Update selected fields of a Braintrust project
Update prompt `braintrust_update_prompt`	Update a Braintrust prompt's metadata or configuration without invoking it

Try it: find the Braintrust tool you need

Browse the 15 Braintrust tools

Click any tool to see exactly what Hermes can do and copy a ready-to-use prompt.

Example prompts

Pull the relevant data from Braintrust, summarize it in plain English, and point out anything that needs attention.

List the relevant items in Braintrust, group them by priority, and recommend what Hermes should do next.

Use Braintrust to query data and walk me through the result in plain English.

ClawLink vs. building it yourself

The alternative to ClawLink is usually manual API key setup plus your own token handling, permission troubleshooting, and tool plumbing for Hermes Agent. That is fine if you want to build and maintain the integration yourself. Most teams just want Braintrust working from chat.

	Manual	ClawLink
Credential handling	Collect, validate, store, and rotate the Braintrust API key yourself, then make sure every tool call uses the right account.	Users complete the hosted ClawLink setup once and the connected Braintrust account becomes available to the agent without you building credential management.
Ongoing maintenance	You own refresh logic, permission debugging, environment config, and every provider-specific edge case for Braintrust.	ClawLink handles the repetitive integration plumbing so your team can focus on the workflow instead of the infrastructure.
Agent usability	You still need to expose the right Braintrust actions to the runtime in a format your agent can reliably use.	17 tools for Braintrust are already exposed through ClawLink, so the agent can read and act from chat immediately.

ClawLink vs. Composio

Composio also exposes Braintrust to AI agents. It is developer infrastructure: Python and TypeScript SDKs, an MCP server, and a catalog past 1,000 apps, aimed at teams shipping agent products. ClawLink is built for Hermes Agent users instead. You install the plugin once, connect Braintrust in the browser, and the 17 tools above work from chat. There is no SDK and no config file, and the Braintrust key you paste at setup is stored server-side rather than kept in your environment. Choosing between them? Read the full Composio alternatives comparison.

Troubleshooting

Hermes paired but still can't use Braintrust

Pairing is a two-step handshake: run hermes clawlink begin, approve the link in your browser, then run hermes clawlink finish. If you ran finish before approving, or the approval link expired, run hermes clawlink begin again to get a fresh link. Confirm the plugin was installed with --enable, then verify with hermes clawlink test.

Connection succeeds but no tools appear

Reconnect Braintrust from the dashboard, then start a fresh chat if the runtime still has the old tool catalog loaded.

"Tool schema not loaded yet" error when calling Braintrust tools

Braintrust tool schemas load on demand the first time a tool runs and are cached after that, so this error usually clears on its own: wait a few seconds and retry the same request. If every Braintrust call keeps failing with it in a fresh chat, reconnect from the dashboard, and contact support if it still persists — that pattern points to a configuration problem on our side, not something you can fix by reconnecting again.

Braintrust returns 403 or "permission denied" on one action while others work

Two usual causes. The connected account may not have access to the specific workspace, inbox, store, or project in the request — check that first. If access looks right, the agent may have sent a placeholder value (like "YOUR_ID" or an example id from documentation) instead of a real one: ask it to run a list or search tool first, then retry the action with a real id from those results. Most failures at this stage are one of these two, not ClawLink bugs.

API key setup works but results look incomplete

Double-check that the API key for Braintrust has the right scopes or account access. A valid key can still be too limited for some reads or writes.

FAQ

Is there a Hermes Agent Braintrust integration?

Yes. ClawLink is the fastest way to connect Hermes to Braintrust: link your Braintrust account once in the browser and Hermes Agent can call the Braintrust API through 17 ready-made tools — no custom code or token handling.

How do I connect Braintrust to Hermes with ClawLink?

Install the plugin with hermes plugins install ClawLink-HQ/hermes-plugin --enable, then pair once: run hermes clawlink begin, approve the link in your browser, and run hermes clawlink finish. Connect Braintrust in the dashboard and Hermes can use it from the next message — no config files, and the Braintrust key you paste is stored server-side instead of in your environment.

How long does it take to connect Braintrust to Hermes Agent?

About two minutes. Sign in, click Connect next to Braintrust in the dashboard, authenticate, and Hermes Agent can use it from the next chat message.

Why use ClawLink instead of wiring Braintrust up myself?

Hermes paired but still can't use Braintrust

How to connect Braintrust to Hermes Agent

Setup

Install and pair

Connect Braintrust

Use it from chat