Skip to content

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

License

Notifications You must be signed in to change notification settings

Narcasserun/dolphinscheduler

This branch is 673 commits behind apache/dolphinscheduler:dev.

Folders and files

NameName
Last commit message
Last commit date
Jul 17, 2023
Nov 10, 2022
Feb 27, 2022
Jul 17, 2023
Jul 12, 2023
Jul 18, 2023
Nov 30, 2022
Jul 14, 2023
Jul 19, 2023
Jul 19, 2023
Jul 19, 2023
Jul 19, 2023
Jul 12, 2023
Jul 6, 2023
Jul 11, 2023
Jul 17, 2023
Jul 18, 2023
Jun 1, 2023
Feb 7, 2023
Jun 24, 2023
Jul 17, 2023
Apr 18, 2023
Jul 14, 2023
Jun 28, 2023
Jul 11, 2023
Jun 28, 2023
Jul 19, 2023
Apr 18, 2023
Jul 19, 2023
Jul 18, 2023
Apr 25, 2023
Nov 19, 2021
Jan 12, 2023
Sep 29, 2022
Jul 19, 2023
Jul 13, 2023
Mar 7, 2023
Dec 8, 2022
Mar 29, 2019
Dec 22, 2022
Aug 6, 2022
Dec 22, 2022
Nov 9, 2022
Apr 25, 2023
Feb 27, 2022
Jun 6, 2023
Apr 25, 2023
Jul 7, 2023
Aug 2, 2022
Feb 27, 2022
Feb 27, 2022
Jul 3, 2023

Repository files navigation

Apache Dolphinscheduler

License codecov Quality Gate Status Twitter Follow Slack Status CN doc

About

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code. It is also provided powerful user interface, dedicated to solving complex task dependencies in the data pipeline and providing various types of jobs available out of the box

The key features for DolphinScheduler are as follows:

  • Easy to deploy, provide four ways to deploy which including Standalone, Cluster, Docker and Kubernetes.
  • Easy to use, workflow can be created and managed by four ways, which including Web UI, Python SDK, Yaml file and Open API
  • Highly reliable and high availability, decentralized architecture with multi-master and multi-worker, native supports horizontal scaling.
  • High performance, its performance is N times faster than other orchestration platform and it can support tens of millions of tasks per day
  • Cloud Native, DolphinScheduler supports orchestrating multi-cloud/data center workflow, and supports custom task type
  • Versioning both workflow and workflow instance(including tasks)
  • Various state control of workflow and task, support pause/stop/recover them in any time
  • Multi-tenancy support
  • Others like backfill support(Web UI native), permission control including project, resource and data source

QuickStart

User Interface Screenshots

  • Homepage: Project and workflow overview, including the latest workflow instance and task instance status statistics. home

  • Workflow Definition: Create and manage workflow by drag and drop, easy to build and maintain complex workflow, support bulk of tasks out of box. workflow-definition

  • Workflow Tree View: Abstract tree structure could clearer understanding of the relationship between tasks workflow-tree

  • Data source: Manage support multiple external data sources, provide unified data access capabilities for such as MySQL, PostgreSQL, Hive, Trino, etc. data-source

  • Monitor: View the status of the master, worker and database in real time, including server resource usage and load, do quick health check without logging in to the server. monitor

Suggestions & Bug Reports

Follow this guide to report your suggestions or bugs.

Contributing

The community welcomes everyone to contribute, please refer to this page to find out more: How to contribute, find the good first issue in here if you are new to DolphinScheduler.

Community

Welcome to join the Apache DolphinScheduler community by:

Landscapes



  

DolphinScheduler enriches the CNCF CLOUD NATIVE Landscape.

About

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 81.4%
  • TypeScript 16.6%
  • PLpgSQL 0.5%
  • HCL 0.4%
  • SCSS 0.4%
  • Shell 0.3%
  • Other 0.4%