Back to directory

open-record-replay

Maintenance: Active

humblebanana/open-record-replay

Open-source macOS record-and-replay workflow recorder for computer use agents. Captures mouse, keyboard, and UI events as structured traces so agents can learn, replay, and automate real desktop tasks.

View on GitHub
$ git clone https://github.com/humblebanana/open-record-replay.git && cd open-record-replay

145

stars

4

forks

Swift

Language

MIT

License

2026-06-21

Created

2026-06-22

Last push

A macOS-only CLI recorder that turns a demonstrated desktop workflow into evidence (session.json/events.jsonl) an agent can turn into a reusable skill. Not a dsh plugin (no `dsh plugin` install); works with DeepSeek Harness via the included host-agent SKILL.md. Requires macOS + Node.js 18+.

DSH integration

Ecosystem-related

Author-claimed

Safety audit

Unaudited

Last verified

2026-08-23

License

MIT

01What can it help you accomplish?

  • Record a macOS desktop workflow once and hand the evidence to an agent to build a reusable skill

    Structured artifacts (session.json, events.jsonl) plus a validated skill-input package (README.md, events.jsonl, session.json) the agent's own skill-creation flow consumes

    Developers/agents who want to teach a Computer Use agent a UI workflow (file pickers, drag-drop, multi-app) that has no clean API, by demonstrating it once

02How to install into DeepSeek Harness

Prerequisites

  • macOS
  • Node.js 18+, Swift toolchain / Xcode Command Line Tools, Accessibility and Input Monitoring permissions

Installation steps

  1. 01

    Clone the repo: `git clone https://github.com/humblebanana/open-record-replay.git && cd open-record-replay`

    $ git clone https://github.com/humblebanana/open-record-replay.git && cd open-record-replay

  2. 02

    Run `npm install` then `npm run check`; grant macOS permissions with `node bin/orr.js permissions request`

    $ npm install

Verify the integration

Not specified by the author

Rollback

  • The README documents install/check and a host-agent skill handoff, but no explicit uninstall command beyond removing the cloned directory.

03DSH integration and capability boundaries

DSH integrationEcosystem-related

Not a dsh plugin: a macOS CLI recorder that captures desktop workflows into session.json/events.jsonl so a coding agent (incl. DeepSeek Harness) can turn a demonstration into a reusable Computer Use skill.

  • macOS workflow recorder

    A demonstrated desktop workflowsession.json + events.jsonl capturing window.changed, mouse.click/drag, keyboard.text_input/submit, selection.changed, app/window attribution, UI targets, accessibility tree

    The core recorder does not require Screen Recording; recordings are local by default
  • Validation & skill packaging

    A recorded session`session validate-recording` checks quality; `skill prepare` writes a skill-input package (README.md, events.jsonl, session.json) for the agent

    The final skill is created by the agent's own skill system, not by this tool
  • Host-agent skill

    Agent instructionsAn included SKILL.md tells the agent when to start/stop recording, how to inspect events.jsonl, and how to hand off the evidence package

    The agent should stop its turn while the user demonstrates, then resume after

04Who is it for? When not to use it?

Good for

  • Developers/agents who want to teach a Computer Use agent a UI workflow (file pickers, drag-drop, multi-app) that has no clean API, by demonstrating it once

Not for

  • Open Record/Replay is a macOS-only, alpha-stage CLI; it requires Node.js 18+, the Swift toolchain / Xcode Command Line Tools, and Accessibility + Input Monitoring permissions. The core recorder does not need Screen Recording.
  • events.jsonl can contain sensitive data (window titles, URLs, typed/selected text, file names, local paths, accessibility-tree text). Review recordings before sharing; do not publish raw recordings with secrets or private data.

05Compatibility, maintenance and safety notes

  • Open Record/Replay is a macOS-only, alpha-stage CLI; it requires Node.js 18+, the Swift toolchain / Xcode Command Line Tools, and Accessibility + Input Monitoring permissions. The core recorder does not need Screen Recording.
  • events.jsonl can contain sensitive data (window titles, URLs, typed/selected text, file names, local paths, accessibility-tree text). Review recordings before sharing; do not publish raw recordings with secrets or private data.
  • This is a generic agent tool, not a DeepSeek Harness plugin — there is no `dsh plugin` install path. It works with any coding agent's skill-creation flow, including DeepSeek Harness, via the included host-agent SKILL.md.
2026-06-212026-06-22Not specified by the author

MIT · 由 facts pack 抓取(README 分支 main)

06Frequently asked questions

Is Open Record/Replay a DeepSeek Harness plugin?

No. It is a standalone macOS CLI tool with no `dsh plugin` install path. It works with any coding agent's skill-creation flow — including DeepSeek Harness — through the included host-agent SKILL.md that tells the agent when to record and how to hand off the evidence.

How do I install it?

Clone the repo, run `npm install`, then `npm run check`. Grant macOS Accessibility and Input Monitoring permissions with `node bin/orr.js permissions request`. It needs macOS, Node.js 18+ and the Swift toolchain / Xcode Command Line Tools.

What does a recording produce?

A session.json plus events.jsonl capturing window changes, mouse clicks/drags, keyboard input, selections and accessibility-tree context. `session validate-recording` checks quality and `skill prepare` writes a skill-input package for the agent.

Is my data safe?

Recordings are local by default, but events.jsonl can hold sensitive data (window titles, URLs, typed text, file paths, accessibility-tree text). Review recordings before sharing and never publish raw recordings with secrets or private information.

08Data and sources

  • Author-claimedgithub.com8eff3fa62178…

    Teach Computer Use agents by demonstration.

  • Author-claimedgithub.com8eff3fa62178…

    git clone https://github.com/humblebanana/open-record-replay.git

This page is generated from the project’s public documentation, repository metadata and a structured parse of DSH Plugins; last verified on 2026-08-23. Found an error? Submit a correction.

🏆

Best DeepSeek Harness Plugins

Twelve plugins worth installing first — picked from the whole catalog, across every category.

DSH Plugins is an independent community directory of DeepSeek Harness plugins. Not affiliated with or endorsed by DeepSeek. Third-party plugins are not security-audited — review the source before installing.

New DeepSeek Harness plugins, weekly. No spam.