Browser Bridge Automation

Overview

The Browser Bridge skill allows AI coding assistants (including Google Antigravity, Gemini CLI, Cursor, and Claude) to interact with and automate the user's real Microsoft Edge or Google Chrome browser.

Browser Bridge connects to the user's daily browser sessions via a lightweight extension and a local Python loopback daemon (127.0.0.1), preserving logins, cookies, and user preferences.

When to Use This Skill

• Use when you need to inspect active browser tabs or open web pages.
• Use when extracting rendered DOM content or taking webpage screenshots.
• Use when navigating, clicking buttons, filling out web forms, or executing interactive workflows in a real browser session.
• Use when executing raw Chrome DevTools Protocol (CDP) commands (Page, Runtime, DOM, Input, Network, Storage).

Key Capabilities

1. Bilingual Adaptive UI: Automatic browser language detection (English & Chinese) with an instant one-click toggle button ([English / 中文]) in the popup.
2. Concurrent Multi-Browser Routing: Simultaneous connection support for both Microsoft Edge and Google Chrome with smart automatic routing to target tabs.
3. Native Tab Grouping: Automatically isolates AI-controlled tabs into a distinct purple [Gemini] tab group for complete visual clarity.
4. Interactive Snapshot & Control: Provides numbered element snapshots (#1, #2) to click or fill inputs without manual coordinate guessing.
5. Self-Healing Background Daemon: Automatically launches the local bridge service in the background if it is not currently active.
6. Privacy-First Architecture: Binds strictly to 127.0.0.1; no telemetry, no cloud relays, browser access that can expose authenticated data; loopback binding is not an access-control or privacy guarantee.

Prerequisites and installed paths

AAS distributes this guide only: server/cli.py, the daemon and extension are not bundled. The commands below run from a separately reviewed upstream checkout at v1.4.0 commit 0eb6a6fcc1cb36bcfa0fa0d5d41f9ae6bf229c69, with Python 3.10+ and its reviewed dependencies. Source inspection is not installation or a live client test.

Review that immutable source and dependencies before an authorized installation. Loading the unpacked extension, starting/reviving the daemon, enabling developer mode or registering silent startup changes the host and needs corresponding authorization. Do not silently install or persist a service to satisfy a page-inspection request. The upstream CLI may start the daemon when absent, including during inspection commands; confirm that startup is allowed first. Prefer the host's existing browser tools when available.

Examples use python3; on Windows use the selected Python launcher (for example py). Choose the exact browser and tab from tabs; 123 below is illustrative, not a discovered tab ID. Take a fresh snapshot of that tab before selecting element indices. Do not act on another tab after navigation or stale indices.

Quick Usage Reference

1. Connection Status & Tab Query

python3 server/cli.py status
python3 server/cli.py tabs

2. Navigation & Page Interaction

# Open URL
python3 server/cli.py open "https://github.com"

# Snapshot interactive elements
tab_id=123  # Replace with the authorized tab ID from tabs
python3 server/cli.py snap --tab "$tab_id"

# Click element (#index, text, or selector)
python3 server/cli.py click "#1" --tab "$tab_id"
python3 server/cli.py click "Sign in" --tab "$tab_id"

# Input text into form field
python3 server/cli.py type "#search" "machine learning" --tab "$tab_id"

3. Page Extraction, Evaluation & Raw CDP

# Extract structured content
python3 server/cli.py text --tab "$tab_id"

# Take page screenshot
python3 server/cli.py screenshot "./new-private-page.png" --tab "$tab_id"

# Execute JavaScript expression
python3 server/cli.py eval "document.title" --tab "$tab_id"

# Execute raw Chrome DevTools Protocol (CDP) method
python3 server/cli.py cdp Page.captureScreenshot '{"format": "png"}' --tab "$tab_id"

Source & Repository

• Repository: https://github.com/AshenJyy/antigravity-browser-bridge

…