Scrapfly

aid: scrapfly
name: Scrapfly
description: >-
  Scrapfly is a web scraping API platform that enables effortless collection of
  web data with battle-tested APIs that scale. It provides capabilities for
  scraping web pages, capturing screenshots, and extracting structured data
  with AI assistance to handle anti-bot measures and JavaScript rendering.
  One API key unlocks five APIs: Web Scraping (anti-bot unblocker), Cloud
  Browser (CDP), Screenshot, Extraction, and Crawler. Scrapfly operates globally
  with proxies across 190+ countries.
type: Index
position: Consumer
access: 3rd-Party
image: https://kinlane-productions.s3.amazonaws.com/apis-json/apis-json-logo.jpg
tags:
  - AI
  - Data Extraction
  - Screenshots
  - Web Scraping
  - Proxies
  - Browser Automation
created: '2025-02-08'
modified: '2026-05-02'
url: >-
  https://raw.githubusercontent.com/api-evangelist/scrapfly/refs/heads/main/apis.yml
specificationVersion: '0.19'
apis:
  - aid: scrapfly:scrape-api
    name: Scrapfly Scrape API
    description: >-
      The core web scraping API that fetches any URL with anti-bot bypass,
      proxy rotation, and JavaScript rendering. Supports GET, POST, PUT,
      PATCH, HEAD, and OPTIONS methods. Returns clean HTML, markdown, JSON,
      or raw content. Features include session management, caching, custom
      headers, DNS customization, SSL info retrieval, webhooks, and
      structured data extraction with LLM assistance.
    humanURL: https://scrapfly.io/docs/scrape-api/getting-started
    tags:
      - Web Scraping
      - Anti-Bot
      - Proxies
      - JavaScript Rendering
    properties:
      - type: Documentation
        url: https://scrapfly.io/docs/scrape-api
      - type: OpenAPI
        url: https://raw.githubusercontent.com/api-evangelist/scrapfly/refs/heads/main/openapi/scrapfly-scrape-openapi.yml
      - type: SpectralRules
        url: https://raw.githubusercontent.com/api-evangelist/scrapfly/refs/heads/main/rules/scrapfly-rules.yml
      - type: JSONSchema
        url: https://raw.githubusercontent.com/api-evangelist/scrapfly/refs/heads/main/json-schema/scrapfly-scrape-response-schema.json
      - type: JSONLDContext
        url: https://raw.githubusercontent.com/api-evangelist/scrapfly/refs/heads/main/json-ld/scrapfly-context.jsonld
  - aid: scrapfly:screenshot-api
    name: Scrapfly Screenshot API
    description: >-
      Capture screenshots of web pages with full-page or element-specific
      capture using CSS selectors. Supports JavaScript rendering, viewport
      configuration, and screenshot of dynamic content. The base URL for
      screenshots is https://api.scrapfly.io/screenshot.
    humanURL: https://scrapfly.io/docs/screenshot-api/getting-started
    tags:
      - Screenshots
      - Web Scraping
      - Browser Automation
    properties:
      - type: Documentation
        url: https://scrapfly.io/docs/screenshot-api/getting-started
  - aid: scrapfly:extraction-api
    name: Scrapfly Extraction API
    description: >-
      AI-powered structured data extraction from HTML content. Supports
      template-based extraction, LLM prompt-driven extraction, and
      auto-extraction using predefined models for common content types.
    humanURL: https://scrapfly.io/docs/scrape-api/extraction
    tags:
      - Data Extraction
      - AI
      - Structured Data
    properties:
      - type: Documentation
        url: https://scrapfly.io/docs/scrape-api/extraction
  - aid: scrapfly:crawler-api
    name: Scrapfly Crawler API
    description: >-
      Web crawling API (currently in early access) that enables crawling
      entire websites with advanced configuration for depth control and
      content filtering. Outputs in WARC format for comprehensive web
      archive support.
    humanURL: https://scrapfly.io/docs
    tags:
      - Web Crawling
      - Data Collection
      - WARC
    properties:
      - type: Documentation
        url: https://scrapfly.io/docs
  - aid: scrapfly:cloud-browser-api
    name: Scrapfly Cloud Browser API
    description: >-
      Headless browser automation API (currently in beta) compatible with
      Playwright, Puppeteer, and Selenium frameworks. Enables complex browser
      interactions, JavaScript execution, and file download capture.
    humanURL: https://scrapfly.io/docs
    tags:
      - Browser Automation
      - Playwright
      - Puppeteer
      - Selenium
    properties:
      - type: Documentation
        url: https://scrapfly.io/docs
  - aid: scrapfly:sdks
    name: Scrapfly SDKs
    description: >-
      Official SDKs for Python, TypeScript, Go, Rust, and Scrapy with full
      feature coverage across every language including scrape, screenshot,
      extract, and crawl capabilities.
    humanURL: https://scrapfly.io/docs/sdk
    tags:
      - SDK
      - Python
      - TypeScript
      - Go
      - Rust
    properties:
      - type: Documentation
        url: https://scrapfly.io/docs/sdk
      - type: PythonSDK
        url: https://scrapfly.io/docs/sdk/python
      - type: GitHubOrg
        url: https://github.com/scrapfly
maintainers:
  - FN: Kin Lane
    email: [email protected]