Browser Automation

---
name: browser-automation
description: |
  Trigger when the user asks to automate browser tasks, scrape websites,
  fill forms, or interact with web UIs. Phrases: "automate browser",
  "fill this form", "scrape the site", "navigate to", "click on".
allowed-tools:
  - Bash(command *)
  - Read
  - Write
---

# Browser Automation

AI-driven browser automation using Claude computer use: navigate sites,
fill forms, extract data, and complete multi-step workflows.

## Prerequisites

- `anthropic-computer-use` package installed
- Display server available (X11 or virtual framebuffer)
- Chrome/Chromium installed

## Steps

1. **Define the workflow:**
   - List each step the browser needs to perform
   - Identify inputs needed (URLs, form data, credentials)
   - Define expected outputs (screenshots, extracted data, success state)

2. **Navigate to the target:**
   ```python
   # Using Anthropic computer use
   from anthropic import Anthropic

   client = Anthropic()
   response = client.messages.create(
       model="claude-sonnet-4-20250514",
       max_tokens=1024,
       tools=[{
           "type": "computer_20250124",
           "name": "computer",
           "display_width_px": 1280,
           "display_height_px": 720,
       }],
       messages=[{
           "role": "user",
           "content": "Navigate to example.com and fill out the contact form"
       }],
   )
   ```

3. **For simpler automation, use Playwright:**
   ```typescript
   import { chromium } from "playwright";

   const browser = await chromium.launch();
   const page = await browser.newPage();
   await page.goto("https://example.com");
   await page.fill("#email", "user@example.com");
   await page.click("button[type=submit]");
   await browser.close();
   ```

4. **Extract data** after navigation:
   - Take screenshots for visual verification
   - Use selectors to extract text content
   - Save structured data as JSON

## Safety

- Never store credentials in code
- Use environment variables for sensitive data
- Add delays between actions to avoid rate limiting
- Respect robots.txt and terms of service