dsh-webfetch
キュレーションリスト掲載メンテナンス: 活発tyeclipse/dsh-webfetch
任意 URL をクリーン Markdown/テキストとリンク一覧として取得
$ dsh plugin add dsh-webfetch3
スター
0
フォーク
TypeScript
言語
MIT
ライセンス
2026-08-13
作成日
2026-11-16
最終プッシュ
README
dsh-webfetch
为 DeepSeek Harness 智能体装上「阅读器」:给定 URL,抓取网页并提取干净的 Markdown / 纯文本正文,附带链接清单、RSS/Atom 订阅源解析、HTTP 头部探测、网页表格结构化提取与页面元数据(canonical / Open Graph / hreflang / JSON-LD)读取。零运行时依赖,只读,不发送任何凭证。
English | 中文简介
为 DeepSeek Harness 智能体装上「阅读器」:给定 URL,抓取网页并提取干净的 Markdown / 纯文本正文,附带链接清单、RSS/Atom 订阅源解析、HTTP 头部探测、网页表格结构化提取与页面元数据(canonical / Open Graph / hreflang / JSON-LD)读取。零运行时依赖,只读,不发送任何凭证。 English | 中文简介
A web page reader plugin for DeepSeek Harness (dsh).
dsh agents can search, but until now they could not read the page behind a URL.
dsh-webfetch closes that gap with eight read-only tools and zero runtime dependencies (Node built-ins + global fetch only).
Tools
web_fetch
Fetch a web page and extract its readable content.
| Parameter | Type | Default | Description |
|---|---|---|---|
url |
string (required) | — | Full http/https URL of the page to fetch. |
format |
'markdown' | 'text' |
markdown |
Markdown keeps headings, links, lists and code fences; text is plain prose. |
extractLinks |
boolean | false |
Also return every link found on the page (resolved, absolute). |
maxChars |
number | 50000 |
Cap on extracted content length (1000–200000). |
Returns { url, finalUrl, status, title, content, length, truncated, links? }.
user: what does the dsh README say about the architecture?
agent: web_fetch("https://github.com/deepseek-ai/deepseek-harness")
→ HTTP 200 — title: deepseek-harness
## DeepSeek Harness
..."everything is a plugin"...
web_links
Collect every link on a page with its visible label, resolved to absolute
URLs, deduplicated, capped at limit (1–200, default 50). Useful for mapping
what a page points to or crawling site structure.
web_feed
Read an RSS 2.0 or Atom feed and return its entries as a clean,
LLM-friendly listing. Feed URLs are XML documents that web_fetch cannot
extract from — web_feed parses them into structured entries instead.
| Parameter | Type | Default | Description |
|---|---|---|---|
url |
string (required) | — | Full http/https URL of the RSS or Atom feed. |
maxItems |
number | 10 |
Max entries to return (1–50). |
includeContent |
boolean | false |
Also return each entry's full content (else summaries only). |
Returns { url, finalUrl, status, feedTitle, entryCount, truncated, entries },
where each entry is { title, url, published?, author?, summary?, content? }
with CDATA unwrapped, HTML entities decoded, markup stripped and relative
links resolved against the feed URL.
user: what did the example blog post this week?
agent: web_feed("https://blog.example.com/feed.xml", maxItems: 5)
→ feed: Example Blog
5 entries from https://blog.example.com/feed.xml
1. First & foremost post — https://blog.example.com/posts/first
published: Mon, 01 Jan 2024 10:00:00 GMT
author: Alice
Hello world — café & tea.
web_headers
Inspect the HTTP status, response headers and redirect chain of a URL
without downloading the page body — the diagnostic companion to
web_fetch: check status codes, content types, redirects, caching or
security headers before (or instead of) pulling the content. Uses HEAD
by default and falls back to GET automatically when the server answers
405/501; unlike web_fetch, any status is reported (404/500/… included)
rather than thrown.
| Parameter | Type | Default | Description |
|---|---|---|---|
url |
string (required) | — | Full http/https URL to inspect. |
method |
'HEAD' | 'GET' |
HEAD |
HEAD downloads no body; GET always works but transfers the body. |
followRedirects |
boolean | true |
Follow redirects and report every hop of the chain. |
Returns { url, finalUrl, status, statusText, method, headers, redirects }
where headers is the full response-header map (lower-cased keys) and
redirects lists each hop as { url, status, location }.
user: is that download link still alive, and does it redirect?
agent: web_headers("https://example.com/downloads/latest")
→ HTTP 200 OK — HEAD https://example.com/downloads/latest
redirect chain:
1. 301 https://example.com/downloads/latest → https://cdn.example.com/releases/latest.zip
final URL: https://cdn.example.com/releases/latest.zip
12 header(s):
content-type: application/zip
content-length: 4821337
...
web_table
Extract the HTML tables of a page as structured rows — the tables
counterpart of web_fetch: spec sheets, pricing pages, comparison charts
and any data locked in <table> markup come back as arrays of cell
strings instead of mashed-together prose. The first row is reported as the
header when the page marks it (<thead> or an all-<th> first row);
colspan / rowspan are expanded into a rectangular grid with the
spanning text repeated in every covered slot (rows stay self-contained);
nested tables are flattened into the containing cell; cells are
entity-decoded, whitespace-normalized and capped at 200 characters.
Web・ブラウザ の他のプラグイン
anysearch-dsh
by anysearch-team
DeepSeek Harness 向け AnySearch Web 検索プロバイダーと高度検索ツール
dsh-find-plugin
by awesome-dsh-plugin
エージェント内プラグイン発見:GitHub dsh-plugin トピックのライブ検索、star 順、dsh plugin add コマンド付き
fnos-dsh
by fnosp
DeepSeek HarnessアプリケーションとHarnessプラグインをまとめたモノレポです。
modsearch
by liustack
Web/X 検索・取得ブリッジ:テキスト専用 coding agent 向けに構造化 JSON 証拠(search/fetch/citations)を提供
