Demo of narwhals.corr
✨ New Narwhals expression: `nw.corr`
👥 Supported in both group-by and window contexts
🌐 Polars, DuckDB, PyArrow, PySpark, pandas...all supported
🗒️ PS. please don't draw conclusions about ice cream sales and drownings from this post
Bwlch Llanberis (Welsh folk tune)
Named after a scenic road in Snowdonia, this is one of my favourite Welsh melodies
😅yup thanks!
Tafliad Carreg (Welsh folk tune)
This one was written by Mike Lease, and it means "A stone's throw"
Here's my attempt at it. First time tuning my guitar to DADGAD, and my initial impression is that standard tuning might be a mistake
Demo of Pyrefly LSP in Marimo notebook
✨ @marimo.io now supports Pyrefly as an LSP, helping you to catch errors before you even execute your code!
⚙️ To enable it:
- Install pyrefly
- Settings -> User settings -> Enable pyrefly
🤸 This was a fun one to contribute to
(🙏 Note that the ty type checker is also supported)
Demo of Polars suggesting the correct time zone
✨ New @pola.rs feature: if you misspell a time zone, it will suggest the correct one to you
🤸♂️This was a fun one to work on, Levenshtein and all!
Demo of pandas `min_by`
Demo of Narwhals min_by
✨ New Polars features: `min_by` and `max_by`
💡 Get the first (or last) value of a column ordered by another expression
🌊🦄 Narwhals will have this feature too, making it available to @arrow.apache.org , pandas, @duckdb.org , and more
pandas 3.0 rc demo
😱🙀 The pandas 3.0 release-candidate is here!
💥 Will it break your code?
💡 Test it with `uv pip install -U --pre pandas` to find out!
🌊🦄 Narwhals users can relax, everything's taken care of for you, no need to do anything ☺️
Demo of Polars lazy pivot
✨ The next @pola.rs release will support lazy pivot!
💡 All you need is to specify the unique values to pivot on
Demo of Narwhals-daft
✨ Narwhals now supports Daft!
🔌Just install the `narwhals-daft` plugin, and then `narwhals.from_native` will accept Daft DataFrame!
💡 No extra dependencies requires, computation will remain native (and distributed, and lazy!) until you call `collect`
Screenshot of Wes mentioning Narwhals on a podcast
😲 Wes McKinney mentioned Narwhals on a podcast
Demo of `list.agg` in Polars 1.35
✨ New @pola.rs feature: `list.agg`
💡 Compute any Expr aggregation on a list column, just use `pl.element()`
🔜 Coming soon, in version 1.35!
Demo of Narwhals running with free-threaded Python
🥧🧵 Narwhals now tests against Python 3.14 (pi-Python!) free-threading build
👉 For more on free-threaded Python, my colleague Nathan's blog post is an excellent read, link in comments
Demo of narwhals.format
✨ Narwhals now supports `format` across all backends
🧵 Create new string columns using placeholders and expressions
🌊🦄 Yet another piece of the @pola.rs API brought to pandas, @duckdb.org , PySpark, PyArrow, and more!
Before vs after of using MaskedArray methods in NumPy
✨ NumPy's MaskedArray class is now type-complete
🏷️ Enjoy improved code completion and typing!
🙏 Thank you to Quansight Labs and Meta for having facilicated and funded the work (blog post in comments)
PR of Astropy using Narwhals
🌝 The next @astropy.org release will support generic dataframe tables (like @pola.rs )
🌊🦄 Powered by Narwhals
oh no!!! 😭
Demo of inlay hints with Narwhals
Enabling inlay hints in vscode
💡 Life-pro-tip: enable inline type hints
🏷️ Your editor will display inferred types for variables you haven't annotated
🕵️ Debugging those red squiggly lines will become much easier
polars Series implement __array__, I'd have thought that a lot of the time you can pass Series as then they'll be converted by any `np.asarray` call. at least passing Polars Series to matplotlib works like that
which stats packages are tied to pandas?
Demo of pd.col
✨🐼 Pandas 3.0 will have `pd.col` syntax
💡 You can use it for clean chaining in `assign` and `loc`
🚀 It's happening, the PR just got merged!
Example of `.name` chaining with Polars
Example of `.name` chaining with Narwhals
✨ New @pola.rs feature - you can now chain `name` expressions!
🌊🦄 As of Narwhals 2.0 (yes, we've released 2.0 🚀), this feature is available there as well! Little example below with our friend @duckdb.org
temporary solution added to pandas 12 years ago
💡 "There's nothing for permanent than a temporary fix"
Case in point, this pandas comment which was added [checks git log] ... 12 years ago 🙈
"If the U.S. can't get its greenhouse emissions under control, they need to face real consequences" said the rest of the world.
Screenshot of 17-year-old commit message in NumPy
💡 Today in open source: a 17-year-old NumPy commit promising that a new feature will be coming soon
Any day now..
gt-extras demo
😍 @posit.co have done it again
🧙 gt-extras offers even more functionality for their table renditions of @pola.rs and pandas dataframes!
🌊🦄 Using Narwhals for some dataframe logic
