Apache Airflow
Python-defined workflows with scheduling, dependencies, and execution monitoring
Declarative orchestration for data, infrastructure, and business workflows

Kestra is an open-source orchestration platform for coordinating data pipelines, infrastructure tasks, and business processes. Teams define workflows in YAML, connect services through plugins, and run existing Python, shell, or container-based tasks without rewriting their application code. Executions can start on a schedule or respond to events, webhooks, and messages.
Its interface brings workflow editing, execution history, and troubleshooting into one place. Retries, timeouts, and dependencies help teams handle failures and coordinate work across systems. A data engineer can use it to ingest records, run transformations, check results, and notify colleagues; platform teams can apply the same approach to infrastructure automation. Kestra can be self-hosted, with enterprise capabilities available for organizations that need additional access controls and governance.
Tried it? Share a useful thought or ask a question.
Good conversations start with a hello.
Sign in to comment