Advertisement · 728 × 90

Posts by

Preview
Declarative Data Pipelines: Moving from Code to Configuration Learn how declarative data pipelines can transform data engineering by separating implementation from business logic, making pipelines more maintainable

I wrote an article exploring how we could make data pipelines easier to build and maintain by moving from code to configuration, drawing lessons from how DevOps evolved:

blog.jonathanb.me/declarative-...

#databs #datasky

1 year ago 1 0 0 0

Thank you Adrian!

1 year ago 1 0 0 0
Preview
GitHub - runodp/dagster-odp: A configuration-driven framework for building Dagster pipelines that enables teams to create and manage data workflows using YAML/JSON instead of code A configuration-driven framework for building Dagster pipelines that enables teams to create and manage data workflows using YAML/JSON instead of code - runodp/dagster-odp

I created a library to build data pipelines with YAML/JSON

Works on dagster

Integrates with dlthub for ingestion and soda for data quality

#dataBS

github.com/runodp/dagst...

1 year ago 7 2 1 0