Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.1Bright Data is a web data platform; this toolkit enables Arcade agents to scrape, search, and extract structured data from any public site at scale without being blocked.
Capabilities
- Web scraping: Fetch any webpage and return its content as clean Markdown, suitable for downstream parsing or LLM consumption.
- Multi-engine search: Run queries against Google, Bing, or Yandex with control over result count, search type (web/images), and country targeting.
- Structured data extraction: Pull normalized JSON records from a wide range of platforms — Amazon (products, reviews), LinkedIn (people, companies), Instagram (profiles, posts, reels, comments), Facebook (posts, marketplace, reviews), X posts, Zillow listings, Booking.com hotels, YouTube videos, and ZoomInfo company profiles.
Secrets
This toolkit requires no OAuth flow; access is granted entirely through secrets injected at runtime.
-
BRIGHTDATA_API_KEY— Your Bright Data account API key. Obtain it from the Bright Data control panel under Account Settings → API Token. Any paid or trial Bright Data account can generate this token; no specific product zone needs to be active to retrieve it. -
BRIGHTDATA_ZONE— The name of the Bright Data proxy/scraping zone that requests will be routed through. Zones are created and managed in the Bright Data control panel under Proxies & Scraping Infrastructure. The zone name must exactly match a zone in your account (e.g.,residential,datacenter, or a custom name you define). Different zones carry different capabilities (residential IPs, datacenter IPs, SERP API, Web Unlocker, etc.), so choose one appropriate to the tool you intend to use.
See Arcade secret configuration docs for how to register secrets. You can store them at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |