Apache DolphinScheduler

aid: apache-dolphinscheduler
name: Apache DolphinScheduler
description: >-
  Apache DolphinScheduler is a modern distributed and extensible data orchestration platform governed by the Apache Software Foundation. It provides a DAG-based visual workflow designer, multi-master/multi-worker
  architecture for horizontal scaling, and a comprehensive REST API for programmatic control. It supports dozens of task types (Shell, Spark, Flink, SQL, Python, HTTP, etc.), multi-cloud deployments, multi-tenancy,
  backfill, and a Python SDK (PyDolphinScheduler).
type: Index
position: Consumer
access: 3rd-Party
image: https://kinlane-productions2.s3.amazonaws.com/apis-json/apis-json-logo.jpg
tags:
  - Apache
  - DAG
  - Data Pipeline
  - Open Source
  - Orchestration
  - Python
  - Scheduling
  - Workflow
created: '2026-03-16'
modified: '2026-04-19'
url: >-
  https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/apis.yml
specificationVersion: '0.19'
apis:
  - aid: apache-dolphinscheduler:apache-dolphinscheduler-rest-api
    name: Apache DolphinScheduler REST API
    description: >-
      The DolphinScheduler REST API enables programmatic management of projects, workflow definitions (DAGs), workflow instances, task types, schedules, resources, data sources, alerts, tenants, and users.
      Authentication is via API token. A Swagger UI is available at /dolphinscheduler/swagger-ui/index.html.
    humanURL: https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/open-api.html
    tags:
    - Alerts
    - DAG
    - Data Sources
    - Projects
    - REST
    - Resources
    - Scheduling
    - Tasks
    - Tenants
    - Workflow
    properties:
    - type: Documentation
      url: https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/open-api.html
    - type: GettingStarted
      url: https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/start/quick-start.html
    - type: GitHubRepository
      url: https://github.com/apache/dolphinscheduler
    - type: SDK
      url: https://pypi.org/project/apache-airflow-providers-apache-dolphinscheduler/
      title: Python SDK (PyDolphinScheduler)
    - type: Tools
      url: https://hub.docker.com/r/apache/dolphinscheduler-standalone-server
      title: Docker Image
    - type: Tools
      url: https://github.com/apache/dolphinscheduler-operator
      title: Kubernetes Operator
    - type: JSONSchema
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-schema/apache-dolphinscheduler-schedule-schema.json
      title: Schedule
    - type: JSONSchema
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-schema/apache-dolphinscheduler-task-definition-schema.json
      title: Task Definition
    - type: JSONSchema
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-schema/apache-dolphinscheduler-workflow-definition-schema.json
      title: Workflow Definition
    - type: JSONSchema
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-schema/apache-dolphinscheduler-workflow-instance-schema.json
      title: Workflow Instance
    - type: JSONStructure
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-structure/apache-dolphinscheduler-schedule-structure.json
    - type: JSONStructure
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-structure/apache-dolphinscheduler-task-definition-structure.json
    - type: JSONStructure
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-structure/apache-dolphinscheduler-workflow-definition-structure.json
    - type: JSONStructure
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-structure/apache-dolphinscheduler-workflow-instance-structure.json
    - type: JSONLD
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/json-ld/apache-dolphinscheduler-context.jsonld
    - type: Example
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/examples/apache-dolphinscheduler-schedule-example.json
    - type: Example
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/examples/apache-dolphinscheduler-task-definition-example.json
    - type: Example
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/examples/apache-dolphinscheduler-workflow-definition-example.json
    - type: Example
      url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/examples/apache-dolphinscheduler-workflow-instance-example.json
maintainers:
  - FN: Kin Lane
    email: [email protected]
common:
  - type: LinkedIn
    url: https://www.linkedin.com/company/apache-dolphinscheduler
  - type: Portal
    url: https://dolphinscheduler.apache.org/
  - type: Documentation
    url: https://dolphinscheduler.apache.org/en-us/docs/latest/
  - type: GettingStarted
    url: https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/start/quick-start.html
  - type: GitHubOrganization
    url: https://github.com/apache
  - type: GitHubRepository
    url: https://github.com/apache/dolphinscheduler
  - type: SDK
    url: https://github.com/apache/dolphinscheduler-sdk-python
    title: PyDolphinScheduler Python SDK
  - type: Features
    data:
    - name: DAG Visual Workflow Designer
      description: Web-based drag-and-drop interface for building directed acyclic graph (DAG) workflows with real-time execution visualization.
    - name: REST Open API
      description: Comprehensive REST API for all platform operations including workflow management, scheduling, resource management, and administration.
    - name: Multi-Master/Worker Architecture
      description: Decentralized architecture with horizontal scaling support, capable of processing tens of millions of tasks per day.
    - name: Rich Task Types
      description: Built-in task types including Shell, Spark, Flink, SQL, Python, HTTP, DataX, Seatunnel, Jupyter, and custom task plugins.
    - name: Multi-Tenancy
      description: Supports multiple tenants with isolated resource quotas, permissions, and workflow namespaces.
    - name: Workflow Versioning
      description: Version control for workflow definitions and instances, enabling rollback and auditing of workflow changes.
    - name: Data Source Management
      description: Unified data source management supporting MySQL, PostgreSQL, Hive, Trino, Spark, ClickHouse, and many other databases.
    - name: Python SDK
      description: PyDolphinScheduler allows defining and managing workflows programmatically in Python with code-first workflow authoring.
  - type: UseCases
    data:
    - name: Data Pipeline Orchestration
      description: Orchestrate complex ETL/ELT data pipelines with dependencies, retries, and monitoring across distributed systems.
    - name: Machine Learning Workflows
      description: Schedule and manage ML model training, evaluation, and deployment pipelines with task dependencies.
    - name: Multi-Cloud Data Workflows
      description: Orchestrate workflows spanning multiple cloud providers and data centers with unified scheduling.
    - name: SQL and Analytics Scheduling
      description: Schedule recurring SQL queries, reports, and analytics jobs against multiple data sources.
    - name: DevOps and CI/CD Pipelines
      description: Automate deployment workflows, data quality checks, and operational tasks with DolphinScheduler DAGs.
  - type: Integrations
    data:
    - name: Apache Spark
      description: Native Spark task type for submitting Spark batch and streaming jobs from DolphinScheduler workflows.
    - name: Apache Flink
      description: Native Flink task type for submitting Flink stream processing jobs.
    - name: Apache Hive
      description: Hive data source and task type for SQL-on-Hadoop workloads.
    - name: Kubernetes
      description: Kubernetes deployment mode and K8s task type for container-native workflow execution.
    - name: Docker
      description: Official Docker images and Docker Compose configuration for rapid deployment.
    - name: DataX / SeaTunnel
      description: Native task types for DataX and SeaTunnel data integration frameworks.
    - name: Apache Airflow
      description: An Airflow provider package allows triggering DolphinScheduler workflows from Airflow DAGs.
  - type: Vocabulary
    url: https://raw.githubusercontent.com/api-evangelist/apache-dolphinscheduler/refs/heads/main/vocabulary/apache-dolphinscheduler-vocabulary.yaml