Bright Data

Fetch up to 5 web pages at once. Returns a JSON array in input order, one item per URL: url, format, content, plus title and note when present; or url and error if that page failed. content is the page in one format, markdown by default. Pick another with the format param: - text: plain text, no links or headings - html: raw HTML, for CSS selectors or data hidden in the markup - ld_json: schema.org data (price, rating, author...) If a page has no data in that format, markdown is returned instead, with a note. No JavaScript rendering. Pages that take longer than 35 s time out (45 s when only one URL is sent). The whole result is cut at 40,000 characters, shared between pages. To read the rest of a cut page for free, call scrape_as_markdown with its url and the snapshot_id and start values from that item's next field.

scrape_batch

Fetch one web page. Returns JSON: url, format, content, plus title and note when present. content is the page in one format, markdown by default. Pick another with the format param: - text: plain text, no links or headings - html: raw HTML, for CSS selectors or data hidden in the markup - ld_json: schema.org data (price, rating, author...) If the page has no data in that format, markdown is returned instead, with a note. No JavaScript rendering. Pages that take longer than 45 s time out. Pages over 40,000 characters are cut. To read the rest for free, call again with the snapshot_id and start values from the result's next field.

scrape_as_markdown

Search Bing (default) or Google. Returns JSON: organic results with link, title and description. Searches not done within 55 s return a timeout error.

search_engine

Run up to 5 searches at once, on Bing (default) or Google. Returns a JSON array in input order: query, engine, and result (organic link, title, description) or error. Searches not done within 55 s return a timeout error.

search_engine_batch