For older adults and the family members who help them: a Chrome extension that points at the next click and says what to do.

A family member records a task on a website once. When the older adult opens it later, a character on the page points at each button while a voice explains the step, and the older adult does the clicking.

Where it is now This is a HackCamp 2026 prototype. It is not on the Chrome Web Store yet. What works today is the extension loading in Chrome, a side panel that opens from the toolbar, and three setup checks: whether it can talk to the page in front of it, whether it can use the microphone, and whether it can hold a spoken conversation with the Gemini Live API.

How it works

Planned, not built yet. Recording, guided replay, spoken questions, and the message to the family member are what we are building at HackCamp. The three steps below describe the flow we are aiming for.

  1. A family member records the task once

    Your family member presses Record, does the task on the website, and presses Stop. Each click, choice, and page change becomes a step with a short description, such as "Click Refill next to Metformin". Typed values are not saved, and password, card, and one-time-code fields are marked "type this yourself".

  2. The older adult replays it with a guide

    A character on the page moves to the next button, draws an outline around it, and a voice reads the step aloud. The older adult does the clicking, and the guide moves on when the step is done. They can ask a question out loud, such as "where do I click next?", and the guide answers from what is on the page.

  3. The family member gets a message if their parent is stuck

    If the older adult presses "I'm stuck", or gets the same step wrong three times, their family member gets a text or an email that names the step. A short hint from the family member can appear in the side panel while the older adult is on the page.

Why it matters

Websites assume you already know where things are. In Nielsen Norman Group's tests, older adults finished a little over half of the tasks they were given. Most adults 65 and older say they need someone to walk them through a new device, and the person they ask is usually a family member. The extension is meant to answer that ask while the older adult is on the page.

55.3%

Success rate on website tasks for adults 65 and older in Nielsen Norman Group's 2013 tests of 29 sites, against 74.5% for a control group of users aged 21 to 55. Nielsen, Usability for Senior Citizens, Nielsen Norman Group, 2013.

77%

Of adults 65 and older, the share who need someone to walk them through a new device. Pew Research Center, Older Adults and Technology Use, 2014.

The design keeps the clicking with the older adult. The guide shows where to click and explains the step, and does not click, type, or submit for them, so the person stays in control on a pharmacy or banking page.

Get the extension

Nori is a prototype built at HackCamp 2026, on November 7 and 8, 2026. It is not on the Chrome Web Store yet, so there is no install button on this page.

For the demo, we load it unpacked in Chrome from this repository:

  1. Run pnpm install, then pnpm build, at the repository root.
  2. Open chrome://extensions and turn on Developer mode.
  3. Choose "Load unpacked" and select apps/extension/.output/chrome-mv3.

It runs in Chrome on a desktop or laptop. Asking questions needs our Gemini relay running and a sign-in with Auth0 (see the README). The demo task runs on a mock pharmacy website with sample data.