Back to directory

dsh-computer-use

Curated pickMaintenance: Active

zrui-c/dsh-computer-use

DSH 文本优先电脑控制:CDP/Playwright 驱动 Chromium(标签页/DOM/OCR)+ macOS 后台窗口控制(AX 语义树/点击透传 HID),computer_observe/computer_action 注册为全局工具,不抢鼠标

View on GitHubHomepage
$ brew tap zrui-c/tap

31

stars

2

forks

Swift

Language

Apache-2.0

License

2026-08-14

Created

2026-08-14

Last push

Native DSH bundle for browser automation and background macOS control without moving the user's physical pointer.

DSH integration

Native runtime

Author-claimed

Safety audit

Unaudited

Last verified

2026-09-13

License

Apache-2.0

01What can it help you accomplish?

  • Control Chromium and macOS windows from a DSH agent without taking over the user's pointer

    Bounded text observations plus browser or desktop actions using semantic refs, roles, names, values, state, and geometry

    DSH users on macOS who need targeted browser automation or background desktop control

  • Drive browser forms, navigation, keyboard, pointer, scroll, drag, and uploads through DSH

    Ref-pinned Chromium actions across Playwright, CDP accessibility/DOM, frames, tabs, and optional OCR surfaces

    Developers building DSH workflows that need browser interaction beyond screenshot-only control

  • Interact with a background macOS application while another app remains active

    Targeted AX, SkyLight, and CoreGraphics actions with post-action observation pinned to the previous target

    Mac automation users who need window-specific control without moving the physical pointer

02How to install into DeepSeek Harness

Prerequisites

  • macOS 14 or later
  • DSH and Google Chrome must already be installed
  • Authorize Accessibility and Screen Recording

Installation steps

  1. 01

    Install with Homebrew: `brew tap zrui-c/tap`, `brew trust zrui-c/tap`, and `brew install --cask dsh-computer-use`

    $ brew tap zrui-c/tap

  2. 02

    Or download the latest `DSH-Computer-Use-*-universal.dmg` from Releases, drag DSH Computer Use into Applications, and open it

  3. 03

    Select Install under DSH Plugin, then restart the running DSH Host

Verify the integration

Not specified by the author

03DSH integration and capability boundaries

DSH integrationNative runtime

Native DSH bundle that registers computer_observe and computer_action in DSH's global tool layer

  • Semantic browser observation and actions

    Chromium pages, tabs, frames, DOM/accessibility state, and optional OCR queriesInteractive, full, or changes snapshots; navigation, pointer, keyboard, forms, scroll, drag, and upload actions

    File uploads are fenced to the DSH session workspace
  • Background macOS window control

    macOS accessibility trees, semantic gaps, target processes, and windowsAX actions and targeted SkyLight/CoreGraphics input, with global HID only without a target

    Targeted actions do not move the physical pointer
  • Stale-target and semantic-state safety

    A current observation and one browser or desktop actionExactly one action followed by post-action semantic state; stale refs fail closed

    Ref and coordinate actions require the latest snapshot_id

04Who is it for? When not to use it?

Good for

  • DSH users on macOS who need targeted browser automation or background desktop control
  • Developers building DSH workflows that need browser interaction beyond screenshot-only control
  • Mac automation users who need window-specific control without moving the physical pointer

Not for

  • The packaged application requires macOS 14 or later and the README requires DSH and Google Chrome to already be installed.
  • Using the app requires Accessibility and Screen Recording authorization in macOS.
  • The optional background input path dynamically loads private SkyLight symbols; Apple does not support those private APIs and they may change between macOS releases.
  • UI and OCR strings are treated as untrusted data, and file uploads are limited to the DSH session workspace.

05Compatibility, maintenance and safety notes

  • The packaged application requires macOS 14 or later and the README requires DSH and Google Chrome to already be installed.
  • Using the app requires Accessibility and Screen Recording authorization in macOS.
  • The optional background input path dynamically loads private SkyLight symbols; Apple does not support those private APIs and they may change between macOS releases.
  • UI and OCR strings are treated as untrusted data, and file uploads are limited to the DSH session workspace.
2026-08-142026-08-14v0.3.0

Apache-2.0 · latest release v0.3.0 (2026-08-14)

06Frequently asked questions

How does DSH Computer Use connect to DeepSeek Harness?

The package declares a DSH bundle, and cordis.patch.yml installs the Host runtime while registering computer_observe and computer_action in DSH's global tool layer. Install it from the setup center, then restart the running DSH Host.

Does it move my mouse when controlling another macOS window?

The README says targeted pointer and keyboard events route to the target process or window, while targeted actions do not move the physical pointer. Global HID is used only without a target.

What does computer_observe return?

It returns interactive, full, or changes snapshots for browser and desktop surfaces, with optional query filtering and auto, always, or never OCR. Actions return fresh bounded text observations.

What permissions and software are required?

Use macOS 14 or later, with DSH and Google Chrome installed. Authorize Accessibility and Screen Recording, install the DSH Plugin from the setup center, and restart the DSH Host.

Is the background input path suitable for the Mac App Store?

No. The README says the optional background input path dynamically loads private SkyLight symbols and is intended for Developer ID distribution, not the Mac App Store.

08Data and sources

  • Author-claimedgithub.com0b0a0844018b…

    The embedded package declares a DSH bundle in `package.json`.

  • Author-claimedgithub.com0b0a0844018b…

    `cordis.patch.yml` installs the Host runtime and registers `computer_observe` / `computer_action` in DSH's global tool l…

This page is generated from the project’s public documentation, repository metadata and a structured parse of DSH Plugins; last verified on 2026-09-13. Found an error? Submit a correction.

🏆

Best DeepSeek Harness Plugins

Twelve plugins worth installing first — picked from the whole catalog, across every category.

DSH Plugins is an independent community directory of DeepSeek Harness plugins. Not affiliated with or endorsed by DeepSeek. Third-party plugins are not security-audited — review the source before installing.

New DeepSeek Harness plugins, weekly. No spam.