Haruno Knowledge base

The agent browser

Haruno can open a web page in a browser you can watch, read it, fill in forms and download files. You do the signing in. This page shows what it can do and what it asks about first.

  • Mac appNot availableThe Mac app has no browser panel and no list of sites Haruno may open and sign in to.
  • Windows appAvailable

Some websites have no connector. A supplier portal behind a login is a good example. The agent browser lets Haruno use such a site for you: it opens the page in a browser of its own, reads it, clicks, types and downloads. You watch it happen in the Browser tab of the side panel, and you sign in yourself.

It is on by default. See Agent browser settings to change what it may open.

The Browser tab. The page itself fills the area under the address.
The Browser tab of the side panel. At the top is the page address, https://example.com/account/orders?ref=agent, with buttons to go back, reload, turn sound on and close the browser. The page area below is empty in this picture.The Browser tab of the side panel. At the top is the page address, https://example.com/account/orders?ref=agent, with buttons to go back, reload, turn sound on and close the browser. The page area below is empty in this picture.

What Haruno can do

Haruno can:

  • open a site you have allowed, and read the page
  • click something, type into a field, choose from a list, scroll and press a key
  • wait for text to appear, go back a page and reload the page
  • take a screenshot
  • hand the window over to you so you can sign in
  • close the browser

Four things always ask you first, in a card in the chat, unless you change that in the advanced view:

  • Submit a form
  • Download a file
  • Attach a file from this chat, which hands a file of yours to a website
  • Add a site to the allowed list

A download lands in the attachments of that chat. A screenshot is saved there too.

Watching it

Open View ▸ Show Browser panel. At the top of the tab you see the address of the page Haruno is on. The buttons are Go back, Reload the page, Turn sound on and Close the browser. When nothing is open, the tab says Nothing open, and When the agent opens a page, it appears here.

Signing in

Haruno never types your password. When a site needs you to sign in, Haruno hands the window to you.

While you sign in, the page is yours.
The Browser tab during a sign-in. A band says: Sign in below, then choose Done signing in. The buttons Done signing in and Cancel sign-in are beside the address.The Browser tab during a sign-in. A band says: Sign in below, then choose Done signing in. The buttons Done signing in and Cancel sign-in are beside the address.
  1. Sign in in the panel

    The band says Sign in below, then choose Done signing in. Type your details into the page, including any code the site sends you.

  2. Press Done signing in

    Haruno carries on. Cancel sign-in gives up instead.

While you sign in, Haruno cannot read or touch the page. When you press Done signing in, it does not see the page you ended on until it opens a site again. The sites you sign in to stay signed in on this computer. Nothing you passed through is added to the allowed list.

Sound

The browser is silent. Haruno cannot hear sound or watch a video, so it reads the text on the page instead. Only you can turn sound on, with Turn sound on in the panel. If a page is making sound, the Browser tab shows a dot and the status bar shows The agent's browser is playing sound with a button to turn it off. Pressing Stop in the chat mutes it too.

Things that can surprise a customer
  • While you drag the divider, resize the window, or open or close the panel, the page area goes blank. It comes back a moment after you stop.
  • There is one browser for all chats. A second chat sees the page the first one opened. A sign-in started in one chat pauses the browser tools in every chat until you are done.
  • A program file, such as an .exe, cannot be downloaded this way.
A connector comes first

For a service that has a connector, Haruno uses the connector. The browser is slower, so it is for sites that have no other way in.

Last updated · PR #2944 · View this version on GitHub

History (1 version)
  1. Internal knowledge base for staff: site, reader keys, assistant, 197 pages and the PR rule (#2944)
    What changed
    @@ -0,0 +1,72 @@
    +---
    +title: The agent browser
    +summary: Haruno can open a web page in a browser you can watch, read it, fill in forms and download files. You do the signing in. This page shows what it can do and what it asks about first.
    +feature: chat-agent-browser
    +covers:
    +  - windows-client/haruno-webview/web/src/components/BrowserPanel.tsx
    +  - windows-client/haruno-webview/Host/Browser/**
    +  - windows-client/Haruno.Desktop.Services/Chat/Browser/**
    +  - windows-client/Haruno.Desktop.Core/Browser/**
    +  - windows-client/docs/agent-browser.md
    +---
    +
    +Some websites have no connector. A supplier portal behind a login is a good example. The **agent browser** lets Haruno use such a site for you: it opens the page in a browser of its own, reads it, clicks, types and downloads. You watch it happen in the **Browser** tab of the [side panel](/windows/chat/side-panel/), and you sign in yourself.
    +
    +It is on by default. See [Agent browser settings](/windows/chat/browser-settings/) to change what it may open.
    +
    +<Shot src="/m/dfe398097495-windows-chat-panel-browser-light.png" dark="/m/ce45ac1b5364-windows-chat-panel-browser-dark.png" alt="The Browser tab of the side panel. At the top is the page address, https://example.com/account/orders?ref=agent, with buttons to go back, reload, turn sound on and close the browser. The page area below is empty in this picture." caption="The Browser tab. The page itself fills the area under the address." />
    +
    +## What Haruno can do
    +
    +Haruno can:
    +
    +- open a site you have allowed, and read the page
    +- click something, type into a field, choose from a list, scroll and press a key
    +- wait for text to appear, go back a page and reload the page
    +- take a screenshot
    +- hand the window over to you so you can sign in
    +- close the browser
    +
    +Four things always ask you first, in a card in the chat, unless you change that in the advanced view:
    +
    +- **Submit a form**
    +- **Download a file**
    +- **Attach a file from this chat**, which hands a file of yours to a website
    +- **Add a site to the allowed list**
    +
    +A download lands in the attachments of that chat. A screenshot is saved there too.
    +
    +## Watching it
    +
    +Open **View ▸ Show Browser panel**. At the top of the tab you see the address of the page Haruno is on. The buttons are **Go back**, **Reload the page**, **Turn sound on** and **Close the browser**. When nothing is open, the tab says **Nothing open**, and *When the agent opens a page, it appears here.*
    +
    +## Signing in
    +
    +Haruno never types your password. When a site needs you to sign in, Haruno hands the window to you.
    +
    +<Shot src="/m/754900e43248-windows-chat-panel-browser-signin-light.png" dark="/m/bb2f6a5c72e6-windows-chat-panel-browser-signin-dark.png" alt="The Browser tab during a sign-in. A band says: Sign in below, then choose Done signing in. The buttons Done signing in and Cancel sign-in are beside the address." caption="While you sign in, the page is yours." />
    +
    +<Steps>
    +<Step title="Sign in in the panel">
    +The band says **Sign in below, then choose Done signing in.** Type your details into the page, including any code the site sends you.
    +</Step>
    +<Step title="Press Done signing in">
    +Haruno carries on. **Cancel sign-in** gives up instead.
    +</Step>
    +</Steps>
    +
    +While you sign in, Haruno cannot read or touch the page. When you press **Done signing in**, it does not see the page you ended on until it opens a site again. The sites you sign in to stay signed in on this computer. Nothing you passed through is added to the allowed list.
    +
    +## Sound
    +
    +The browser is silent. Haruno cannot hear sound or watch a video, so it reads the text on the page instead. Only you can turn sound on, with **Turn sound on** in the panel. If a page is making sound, the Browser tab shows a dot and the status bar shows *The agent's browser is playing sound* with a button to turn it off. Pressing **Stop** in the chat mutes it too.
    +
    +<Callout variant="warning" title="Things that can surprise a customer">
    +- While you drag the divider, resize the window, or open or close the panel, the page area goes blank. It comes back a moment after you stop.
    +- There is one browser for all chats. A second chat sees the page the first one opened. A sign-in started in one chat pauses the browser tools in every chat until you are done.
    +- A program file, such as an `.exe`, cannot be downloaded this way.
    +</Callout>
    +
    +<Callout variant="info" title="A connector comes first">
    +For a service that has a connector, Haruno uses the connector. The browser is slower, so it is for sites that have no other way in.
    +</Callout>