Posts by colton
dagster.io/blog/dagster...
We just released version 1.13.0 of @dagster.io with lots of great features like official Dagster skills for, virtualized assets for modeling entities like views, partitioned asset checks, and more. Check out the blog post for more details.
Learn how we built a light weight evaluation framework for the official Dagster skills.
With short feedback loops and quantitative measurements, we were able to make quick improvements that improving decision routing and context management.
dagster.io/blog/evaluat...
If you're a Python developer using Claude Code, or something similar, we just published a blog that covers 10 rules we add to our prompt for drastically improved code gen.
And we include the full prompt at the end of the post!
dagster.io/blog/dignifi...
🚀 NEW on We ❤️ Open Source 🚀
How can a small team answer 16,000+ community Qs/month?
Colton Padden (@colton.boo) reveals Dagster’s smart AI-powered doc strategy—built for humans and LLMs.
allthingsopen.org/articles/sca...
#WeLoveOpenSource #OpenSource #AI #TechDocs #Dagster #CommunitySupport
We've been improving how we create educational content at @dagster.io: optimizing feedback loops, generating content for different learning styles, and leveraging LLM-powered workflows. You can find our lessons learned on the @allthingsopen.bsky.social "We Love Open Source" blog!
So excited for this to be available! 🚀
“Flexibility without fragmentation”
In addition to some solid alteration, it’s also a great explanation of how to build a data team and how your system can and should scale.
@colton.boo and Dennis Hume have an awesome new ebook on this topic, check it out!
#dataBS
dagster.io/how-to-scale...
2025.allthingsopen.org/sessions/ena... #AllThingsOpen
Excited to be at All Things Open tomorrow!
Come hang out at the @dagster.io booth, or see my talk “Enabling education with a little help from AI” at 1:45 EST on Tuesday!
@ssp.sh this might be relevant to your interests!
Read this post you work in data analytics.
A similar mindset problem pervades sales engineering as well, especially in the demo / early stages of discovery.
Understand your prospect’s context. Who are they? What do they care about? What value can you provide them? That’s what you show.
MotherDuck is live now!
DuckLake & The Future of Open Table Formats ft. Jordan Tigani & Hannes Mühleisen
www.youtube.com/live/yn07s-_...
Agreed, what a great watch / listen!
Thanks @christiannolan.bsky.social!
New Oxidise Your Command Line just dropped.
Some that stand out to me are: xh, fselect, and presenterm!
www.youtube.com/watch?v=rWMQ...
mpv might just be the best way to watch twitch.tv.
mpv.io
@pycon.us might just be my favorite conference ever. everyone is so nice!
Whoa, that's neat! 📷
Open Table Format Evolution
I'm writing about #opentableformats. With the newest entries of AWS S3 tables and Cloudflare R2, it's interesting to reassess the market and see where the future with managed Iceberg Tables leads us.
What's your take? And anything missing on the evolution below?
It’s surprisingly easy using FastMCP:
github.com/jlowin/fastmcp
We’ll likely refactor this code not to use subprocess, but you can see our initial implementation here!
github.com/dagster-io/d...
Screenshot of the https://github.com/cmpadden/llm.nvim repository README.
Refactored `chatblade.nvim` to use `llm`, and renamed the project to `llm.nvim`. It's archaic compared these agentic MCP workflows, but it's completely replaced Googling programming related questions.
The dream! Best of luck.
I sat down to chat with Chris about "Project Airlift", a way to easily observe Airflow environments directly from Dagster.
With a couple of lines of code, you can get a holistic picture into all of your environments, and then optionally migrate them!
🚨 New Course Alert 🚨
We are pleased to announce that the new "Testing with Dagster" course is now live on Dagster University.
dagster.io/blog/dagster...
Screenshot of the DuckDB's local UI and a code example using dltHub's REST source config.
Tinkering with dltHub's REST API source to ingest data without having to write any bespoke code, and DuckDB's new local web UI, and I feel so spoiled with how good data tooling is getting!