- tags
- #help #agents #side-panel #wip
- order
- 61.3
- description
- Your assistant in your browser's side panel, beside any website: ask about the page you're on, let it point at what to click, or let it click for you; and teach it a chore it can do again.
- brief
- AIPutty Assistant beside any page: your d2 chat next to whatever site you are on. Ask about the page, or let your assistant point, click and type, only as you allow.
Your assistant on any page
AIPutty Assistant beside any page puts your d2 chat in your browser's side panel, next to whatever website you are on. Ask about the page you're looking at, let your assistant show you where to click, or let it do the clicking, always only as far as you allow. It's the same chat as on d2: your assistant, your history, your pad.
┌──────────────────────────────┬──────────────────────┐
│ any website │ Point ☑ Do ☐ Ask ☑ ⏺ │ ← yours: what d2 may do
│ ├──────────────────────┤
│ ┌──────────────┐ │ 📄 Ask about this page│
│ │ Past bills ▸ │ ◀── 👉 │ │
│ └──────────────┘ "click │ your chat with your │
│ here" │ assistant │
│ │ │
└──────────────────────────────┴──────────────────────┘
Install it
It works in Chrome and Edge on a computer.
- Signed in on d2, open Download d2 beside any page and press Download for Chrome or Edge. Unzip it: you get a folder
d2-browser. Keep it where it is. - Open
chrome://extensions(in Edge,edge://extensions) and turn on Developer mode. - Press Load unpacked and choose the
d2-browserfolder. - Pin it: the puzzle piece in the toolbar, then the pin beside d2 beside any page.
- Click the d2 button on any page: the side panel opens.
Signing in
The panel uses your d2 login in this browser: if you're signed in on aiputty.com, you're signed in in the panel. If not, the panel shows d2's own Sign in, and brings you back to the panel after. New to d2? Sign up sets up your assistant and comes back. With several live chats, the panel asks which one goes in it; it remembers your pick.
Ask about this page
Press 📄 Ask about this page at the top of the panel. Your chat gets the page's address and title, and whatever text you selected on it, as your own message, and your assistant answers. You can also right-click the page and choose Ask d2 about this page (or, on a selection, Ask d2 about "…"), or press Alt+Shift+D.
Your assistant sees only what you send: the address, the title and your selection. It can't open pages behind your login itself; turn on Point if you want it to see the page.
Point, Do and Ask
Three switches at the top of the panel decide what your assistant may do on the page beside it. They're yours: the browser remembers them for every site until you change them.
| Switch | Starts | With it on, your assistant may |
|---|---|---|
| Point | off | read the page (its headings, short text, buttons, links and fields, never what's typed in a field) and highlight the thing to click next, with a note |
| Do | off | click buttons and links, and type into fields (never into a password field) |
| Ask | on | nothing more: it makes every click or typing wait for your Allow in the panel. Turn it off and your assistant clicks without asking, but each action still shows in the panel as it runs, with Stop |
The first time you turn on Point or Do, the browser asks once whether d2 may read the sites you visit; say no and the switch stays off. The line beside the switches always says what d2 can see: d2 sees nothing here, d2 can read this page, d2 can read; acts on your OK, d2 can read and act.
Your assistant knows the panel is open: your chat shows Side panel: on the page, and which switches are on, whenever they change.
Privacy
- Nothing is read until you say so. With Point and Do off, your assistant gets only what you send with Ask about this page.
- Never a password. A read never includes what's typed in a field; your assistant never types into a password field. A saved login (below) is typed by the panel itself, only on its own site, only after you tap Allow, and your assistant never sees it.
- Only your own assistant. Only the agent in the chat your panel shows can use it, with your permission each time the switches require it.
- Closing the panel stops it. A closed panel reads nothing and does nothing.
Example: last month's bill
Say your electricity provider, Bright Power, keeps your bills on its website, and you want last month's.
- Point. On brightpower.example, signed in, open the panel and say "get me last month's bill". Turn on Point: your assistant reads the page and highlights Billing, "your bills are under here". You click it; it highlights Past bills, then October's row.
- Do. Turn on Do, with Ask still on. Your assistant asks "d2 wants to click “Download PDF” on brightpower.example". You tap Allow; the PDF downloads.
- Ask off. Next time, with Ask off, it clicks through by itself, each step showing in the panel with Stop in case you want it to stop.
- Then file it. If you said "…then put it in my files under bills/power and record it as a bill for my company", your assistant does those steps in d2 after the download, and asks you if any of it isn't clear.
- Save it as a recipe. At the end your assistant offers "Save this as a recipe?" with the steps it took, your words as its instructions, and the month as something it asks for next time. Name it, say yes, and next month "get the power bill" is enough; it can also run on a schedule.
Recipes
A recipe is what your assistant keeps so it can do a chore again: your instructions, the steps it took (as a guide, not a script), its own notes (the bills are under Billing → Past bills), what each run asks for (a month), and your login's name in your vault. Each run, your assistant walks the site again with you watching in the panel; if the site changed, it stops and asks, then updates its notes.
- Your assistant records it as you go (above), or you record it: press ⏺ Record in the panel, do the chore yourself, press Stop. Each page you visit, each click and each field you filled (its name, never what you typed) becomes a step, sent to your chat, and your assistant saves it with you.
- Your login, in your vault: when you sign in on the site while recording, the panel asks "Save this login to your vault as brightpower-example-login?". Say yes and it goes to your vault; your assistant only ever gets its name. Later runs fill it in for you after your Allow, without sending the form.
- See your recipes and their runs on your Recipes page.
Refreshing the panel
The panel is d2's own page, so it updates with d2. Press ↻ at the top of the panel to reload it; when d2 has a new version while the panel is open, the panel says New version, tap to refresh. Closing and opening the panel loads it fresh too. A new version of the extension itself is rare: download it again, unzip it over the same folder, and press ↻ on the extension's card in chrome://extensions.