Connect ScrapingBee to Your AI Agent

Fetch HTML from public URLs, extract JSON using explicit rules, and inspect API usage or concurrency. Ask your connected AI assistant to explain the results or carry out the specified operation.

3 tools API key

Try a ScrapingBee Task

Copy a prompt into your agent with the oo Skill installed. Add your page links and source notes before running it.

oo Skill ScrapingBee

Summarize a Public Page

Read returned HTML with explicit rendering requirements.

/oo ScrapingBee: Fetch HTML for [public URL] with renderJs [true/false], waitFor [selector], then summarize the returned content.

Extract Defined Fields

Use extraction rules to retrieve structured page data.

/oo ScrapingBee: Extract JSON from [public URL] using these ScrapingBee extractRules [rules], and explain missing values without inventing them.

Start Working with ScrapingBee

  1. Install OOMOL

    Set up oo CLI and the oo Skill in your agent.

    Install OOMOL →
  2. Connect ScrapingBee

    Connect with a ScrapingBee API key.

    Connect ScrapingBee →
  3. Give Your Agent a Task

    Use /oo with the pages to read, the changes to make, and where to save the result.

    Connection Guide →

Choose Your Agent

  • A ScrapingBee API key and public target URL.
  • Extraction needs caller-supplied extractRules. Rendering and wait controls should match the target page’s actual behavior.

ScrapingBee Tools

ScrapingBee connects supported service operations to your AI assistant. Fetch HTML from public URLs, extract JSON using explicit rules, and inspect API usage or concurrency.

Page HTML

Fetch public HTML with rendering, waiting, and proxy options.

JSON Extraction and Usage

Extract structured fields with rules and read usage statistics.

3 tools

Fetch Html

Fetch HTML content from one public URL with optional rendering and proxy controls.

scrapingbee.fetch_html

Extract Data

Extract structured JSON data from one public URL with ScrapingBee extract_rules.

scrapingbee.extract_data

Get Usage Stats

Retrieve the current ScrapingBee API usage and concurrency statistics.

scrapingbee.get_usage_stats

Frequently Asked Questions

Who defines extracted fields?

Supply extractRules that describe the fields and selectors to extract.

Can I wait for rendered content?

Yes. Use renderJs with waitMs or waitFor as needed.

Can I check concurrency usage?

get_usage_stats returns API usage and concurrency statistics.

Connect ScrapingBee

About ScrapingBee ↗