Skip to Content
DocumentationAgentsIntroduction

Introduction

Agents are a central part of Medbot. An agent reads a patient’s record (or a note, or a form), applies the rules an experienced clinician would follow, and returns structured output fields: a classification, a recommendation, a completed form or a summary. Agents can be run on one patient while you work, or on hundreds in the background, and they can be checked against labelled patients before you rely on them.

How an agent is built and improved

  1. Create it with the four-step wizard: basics, where its patient data comes from, the expert knowledge it follows, and the output fields it returns. See Create an Agent.
  2. Turn its expert knowledge into a workflow. Medbot converts your numbered rules into a graph of steps (gather data, reason, decide yes/no, write the output), checks the graph, and saves it as a version. Only a version that passes every check can go live. See Workflows and Versions.
  3. Bring patient data. Import CSV files or an Excel workbook as a dataset, or connect the agent to a FHIR server or a notes store through an MCP connector. See Patient Data and Connectors.
  4. Validate it against a dataset whose patients carry ground-truth labels, and see how often it is right, field by field and version by version. See Validation.
  5. Run it on patients, notes or forms. See Running Agents.
  6. Collect clinician feedback. Clinicians accept, edit or reject each result. Edited and rejected calls can be added to the validation dataset. See Live Calls and Clinician Review.
  7. Measure and refine. The Results tab shows the agent’s performance, and the Refine flow proposes changes to its rules, workflow and instructions from the cases it got wrong, and saves them as a new version.

The Agents page

Open Agents from the sidebar to go to medbot.me/agents . Each agent is shown as a card. The header has Learn about Agents, the notifications bell, View background runs and + New agent.

Use the chips to choose which agents to show:

ChipShows
<your organisation>Agents owned by your organisation (shown when you are working in an organisation).
AllEvery agent you can see.
MineYour own agents.
DefaultAgents managed by Medbot or your administrator. You can run and copy them, but not edit or delete them.
PublicAgents other Medbot users have listed publicly.
Shared with youAgents other users have shared with you.

Search with Search agents, and sort by Last run (the default), Last updated, Date created or Name.

Agent cards

Each card shows the agent’s name and description, badges for its scope (for example Mine, Default, Public, Shared by <name> or your organisation), its model and its workflow status, and three tiles:

TileWhat it shows
ValidationThe share of labelled patients in the agent’s validation dataset it got right, with the number of patients. Shows No dataset or Not run yet until a validation run has finished.
AgreementThe share of live calls reviewed by clinicians in the last 30 days that were accepted as drafted.
Live callsHow many times the agent ran on live data in the last 30 days, and how many of those were flagged (failed, marked as a false positive or negative, or rejected by a clinician).

The footer shows when the agent last ran and its validation dataset, with Open and either Run or Copy to mine. The ⋮ menu has the actions that apply to the agent: Dashboard (its Results tab), Edit, Run, Share, Copy to mine, Claim for <organisation> and Delete agent.

An agent with no workflow shows This agent runs from its prompt alone. Turn its expert knowledge into a workflow. with a Generate workflow link, which opens the workflow editor.

Workflow status

BadgeMeaning
Workflow verified · v<n>Version n is live, and runs follow it.
Workflow draft · v<n>The newest version passes every check but has not been made live.
Workflow needs attentionThe newest draft fails a check. Fix it in the editor.
Workflow savedThe agent has a plan saved before verified workflows existed.
No workflow yetThe agent runs from its prompt and expert knowledge alone.

Notifications

The bell in the Agents header shows your unread notices. Click one to open it; Mark all as read clears them.

NoticeWhen you get itOpens
<agent> · background run finishedEvery patient in a background run you started has finished, for example 42 of 44 patients completed, 2 failed.The agent’s Agent Runs tab.
<agent> · validation finished: 92% (previously 90%)A validation run has finished and been scored.The Validation tab.
<agent> · validation dropped 90% → 85%A validation run scored 3 or more points below the previous one on the same dataset.The Validation tab.
<agent> · 10 reviewed calls are not in a datasetClinicians have edited or rejected 10 or more live calls that are not yet in a dataset (sent to the agent’s owner).The Live calls tab.
<connector> · extraction finishedA notes extraction run has finished.The extracted dataset.

Who can see an agent

KindWho can use it
Your own agentsOnly you, unless you share them or list them publicly.
Organisation agentsEvery member of the organisation can run them. Choose the organisation under Who owns it when you create the agent, or use Claim for <organisation> on a personal or public agent to copy it into the organisation.
Public agentsEvery Medbot user can find and copy them. Tick List it publicly so other Medbot users can copy it in the wizard.
Default agentsManaged by Medbot or your administrator. You can run and copy them, but not edit or delete them.
Shared agentsAgents shared with you by email or name. Share your own from the card menu or the agent page (Share). An agent that is already public cannot be shared, since everyone can reach it.

Copy to mine makes your own editable copy of any agent you can see.

Tools

Agents can call tools while they run: Medbot’s built-in actions (such as Send Email, with an optional subject and body template), and the tools of any connector the agent reads from. Choose built-in tools under Actions the agent may take in step 2 of the wizard. Administrators can add tools; see Tools.

Email tool

ConfigurationResult
Send Email not selectedNo email is sent, even if the agent is instructed to send one.
Send Email selected, no subject or body templateThe agent writes the email itself.
Send Email selected with a subject and body templateThe email follows your template. The body can use placeholders such as {{age}} and {{gender}}.
Last updated on