Dagster

Meet Dagster

Dagster is a data orchestration platform for building, running, and monitoring data pipelines. Teams define data assets and their dependencies in Python, then use schedules, event triggers, or declarative automation to keep datasets up to date. Its interface brings together lineage, execution logs, and asset health, making it easier to investigate failures and understand which downstream work is affected.

Integrations connect tools such as dbt, Snowflake, and Fivetran, while partitions and backfills help process historical data or rerun selected workloads. Engineers can develop and test pipelines locally before deploying them. The core framework is open source and can be self-hosted; Dagster+ adds a managed service with serverless or hybrid deployment options and team features.