Edge Kit Browser v3.5.6 - Firefox (WebDriver BiDi) + Chrome, video understanding, gameplay, native web seam
This commit is contained in:
@@ -0,0 +1,4 @@
|
|||||||
|
node_modules/
|
||||||
|
*.log
|
||||||
|
*.tgz
|
||||||
|
.DS_Store
|
||||||
@@ -0,0 +1,56 @@
|
|||||||
|
# Edge Kit Browser
|
||||||
|
|
||||||
|
Human-style browsing for AI agents — a zero-dependency [Cordis](https://github.com/moeru-ai) plugin for DeepSeek Harness that drives **Microsoft Edge, Google Chrome, or Mozilla Firefox** directly, with no extra services and no API keys.
|
||||||
|
|
||||||
|
The kit talks to the browser the way a person does: it *sees* the page (visible text + numbered actionable elements, shadow-DOM aware), *acts* (click, type, press, scroll — real input events), *verifies* (screenshots, wait-for-content), and *organizes* work across tabs. It also powers the harness's native `web_search` / `web_fetch` seam, so agents get clean, JavaScript-rendered content from signed-in or bot-walled pages.
|
||||||
|
|
||||||
|
## What it does
|
||||||
|
|
||||||
|
- **Human-style browsing** — `see`, `click`, `clickAt`, `drag`, `type`, `press` (real key codes + repeats), `scroll`, `waitFor`, `goto`, tabs, screenshots, raw `eval`.
|
||||||
|
- **Video understanding** — the `video` action enumerates players, reports full playback state (`playing`, `currentTime`, `duration`, `readyState`, geometry, source), controls them (`play`/`pause`/`seek`/`rate`), and captures PNG frames straight off the player region.
|
||||||
|
- **Gameplay** — correct key codes (Space is actually Space), coordinate clicks, and drags, plus before/after screenshots: agents can literally play a browser game and see what happened.
|
||||||
|
- **Native web seam** — registers `edge-kit` as a `web_search` / `web_fetch` provider: rendered-page extraction with dual-engine fallback (Google/Bing), no bot walls, no API keys.
|
||||||
|
- **Live-attach first** — if a debuggable browser is already listening, the kit attaches to it (borrowed browsers are never closed). Otherwise it launches: your signed-in profile (default) or an isolated kit profile.
|
||||||
|
|
||||||
|
## Install
|
||||||
|
|
||||||
|
Copy this package into your harness profile (or `pnpm install` it as a workspace link), then add to your composition:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
- insert:
|
||||||
|
- id: edge-kit-easy
|
||||||
|
name: "@local/edge-kit-easy"
|
||||||
|
config: {}
|
||||||
|
```
|
||||||
|
|
||||||
|
Optionally route the built-in web tools through the kit (pin the seam):
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
- id: web
|
||||||
|
config:
|
||||||
|
fetchProvider: edge-kit
|
||||||
|
searchProvider: edge-kit
|
||||||
|
```
|
||||||
|
|
||||||
|
Settings live on the plugin's native page (**Plugins → Edge Kit Browser**); every field is volatile, so changes apply live without restarting the browser session.
|
||||||
|
|
||||||
|
## How it drives each browser
|
||||||
|
|
||||||
|
| Engine | Protocol | Launch flags | Port (default) |
|
||||||
|
|---|---|---|---|
|
||||||
|
| Edge / Chrome | CDP over WebSocket (`/json/version`) | `--remote-debugging-port`, `--user-data-dir`, anti-occlusion | 9444 (Edge) |
|
||||||
|
| Firefox | **WebDriver BiDi** (`/session`) — the kit contains a CDP→BiDi adapter | `-remote-debugging-port`, `-profile`, `-no-remote` | — |
|
||||||
|
|
||||||
|
Firefox (158+) exposes WebDriver BiDi on its debug port rather than CDP; the adapter translates every call transparently, including `session.status`/`session.new` handshaking, `script.evaluate` with `expression`, `browsingContext.captureScreenshot` (`{type:'box'}` clips), and load-event mapping.
|
||||||
|
|
||||||
|
Per-browser profiles: the user's real profile by default (`realProfile`), or isolated kit profiles under `~/.dsh/browser-profiles/edge-kit[-chrome|-firefox]`. If your everyday browser owns the profile, pass `relaunch: true` to restart it debuggable (logins survive) or set `profileDir`.
|
||||||
|
|
||||||
|
## Actions
|
||||||
|
|
||||||
|
`launch` · `attach` · `status` · `tabs` · `newTab` · `switchTab` · `closeTab` · `goto` · `back` · `forward` · `reload` · `see` · `click` · `clickAt` · `drag` · `video` · `type` · `press` · `scroll` · `waitFor` · `eval` · `screenshot` · `wait` · `close`
|
||||||
|
|
||||||
|
## Troubleshooting
|
||||||
|
|
||||||
|
- **`Maximum number of active sessions` (Firefox)** — a zombie Firefox is holding the BiDi session slot; terminate `firefox.exe` and relaunch.
|
||||||
|
- **DevTools port never opens** — your normal browser owns that profile: pass `relaunch: true` or a separate `profileDir`.
|
||||||
|
- **Screenshots black on headless/console sessions** — the kit launches with anti-occlusion flags and `fromSurface:false` to avoid this; on Firefox use the default screenshot path.
|
||||||
@@ -0,0 +1,12 @@
|
|||||||
|
- insert:
|
||||||
|
- id: edge-kit-easy
|
||||||
|
name: '@local/edge-kit-easy'
|
||||||
|
config: {}
|
||||||
|
|
||||||
|
# Pin the native web seam to this plugin so web_search / web_fetch run
|
||||||
|
# through your real Edge (rendered, signed-in, wall-passing). Remove this
|
||||||
|
# entry to return to auto-selection of the built-in providers.
|
||||||
|
- id: web
|
||||||
|
config:
|
||||||
|
fetchProvider: edge-kit
|
||||||
|
searchProvider: edge-kit
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64">
|
||||||
|
<rect x="4" y="4" width="56" height="56" rx="14" fill="#0e1b2c"/>
|
||||||
|
<rect x="12" y="16" width="40" height="32" rx="6" fill="none" stroke="#2dd4bf" stroke-width="3"/>
|
||||||
|
<path d="M12 24 L52 24" stroke="#2dd4bf" stroke-width="3"/>
|
||||||
|
<circle cx="18" cy="20" r="1.6" fill="#f8fafc"/>
|
||||||
|
<circle cx="23.5" cy="20" r="1.6" fill="#f8fafc"/>
|
||||||
|
<path d="M36 28 L29 36 L33 36 L29 43" fill="none" stroke="#f8fafc" stroke-width="2.6" stroke-linecap="round" stroke-linejoin="round"/>
|
||||||
|
</svg>
|
||||||
|
After Width: | Height: | Size: 539 B |
@@ -0,0 +1,6 @@
|
|||||||
|
{
|
||||||
|
"meta": {
|
||||||
|
"title": "Edge Kit Browser",
|
||||||
|
"description": "Human-style browsing for agents: open pages, see what is on screen (across shadow DOM), click by visible text, type into labeled fields, wait for content, screenshot, manage tabs. Attaches to a running debug-enabled Edge first; launches your real or a persistent profile otherwise. Also powers the native web_search and web_fetch tools: agents get clean, JavaScript-rendered content from signed-in, bot-walled pages through your Edge, no API key needed."
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,6 @@
|
|||||||
|
{
|
||||||
|
"meta": {
|
||||||
|
"title": "Edge Kit 浏览器",
|
||||||
|
"description": "像人一样浏览网页的智能体工具:打开页面、查看屏幕内容(穿透 Shadow DOM)、按可见文字点击、向输入框输入、等待内容出现、截图、管理标签页。优先附加到已开启调试端口的 Edge,否则用真实或持久化配置启动。同时为原生 web_search 与 web_fetch 提供内容:无需 API key,通过你的 Edge 获取已登录、可过反爬、JavaScript 渲染后的干净正文。"
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,20 @@
|
|||||||
|
{
|
||||||
|
"name": "@local/edge-kit-easy",
|
||||||
|
"version": "3.5.6",
|
||||||
|
"private": true,
|
||||||
|
"type": "module",
|
||||||
|
"description": "Edge Kit Browser — human-style browsing for agents in Edge, Chrome, or Firefox: see, click, type, video understanding, gameplay; live-attach-first over CDP/BiDi with a native settings page and the native web seam",
|
||||||
|
"repository": {
|
||||||
|
"type": "git",
|
||||||
|
"url": "https://gitty.iw5.ir/8ball/edge-kit.git"
|
||||||
|
},
|
||||||
|
"keywords": ["browser", "cdp", "webdriver-bidi", "firefox", "chrome", "edge", "agent-tooling", "cordis", "deepseek-harness"],
|
||||||
|
"license": "MIT",
|
||||||
|
"exports": {
|
||||||
|
".": "./index.js",
|
||||||
|
"./locale/*.json": "./locale/*.json",
|
||||||
|
"./icon": "./icon.svg"
|
||||||
|
},
|
||||||
|
"files": ["index.js", "cordis.patch.yml", "locale/*.json", "icon.svg"],
|
||||||
|
"dsh": { "bundle": { "patch": "./cordis.patch.yml" } }
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user