Explaining how Python engines read and write #DeltaTable is not for the faint of heart.
The theory is everything will depends on the delta kernet rust for read and write, but we are not there yet
github.com/djouallah/Fa...
#duckdb #delta_rs #datafusion #chdb #daft #polars #rust #lakesail

Put together a small python package duckrun :) point it at a folder of SQL/Python files, define a pipeline, and it will create Delta tables in #OneLake with #DuckDB and #delta_rs

github.com/djouallah/du...

#MicrosoftFabric #Python notebook is so efficient, I had to manually check, it is really working :) download two new files every 5 minutes, load it to two delta tables in #onelake and incrementally adding data to a summary table for reporting all under a minute.

using #duckdb and #delta_rs