🚀 C-Blosc2 3.0.0 RC1 is out!

What's new?

📦 VL-blocks for irregular data (strings, JSON)

🗜️ LZ4/LZ4HC dictionary compression

🛡️ Important safety fixes

Check out the full release notes here: github.com/Blosc/c-blos...

Give it a spin and provide feedback!

#Blosc2 #OpenSource #C

Look at the bump in performance that we will see with the next Python-Blosc2 release.

Matrix multiplication has been speeded up by using blocks and Blosc2 prefilters and its own efficient and multithreaded engine.

Expect between 5x and 6x better speed for matrices with no padding.

We designed DSL kernels in Blosc2 so that they can be used in the main platforms; nowadays this necessarily includes Web Assembly (WASM) in the browser.

We also implemented a new JIT compiler for WASM specially meant for Blosc2 DSL kernels.

Play with it at: cat2.cloud/demo/roots/@...

Have fun!

New DSL kernels in Python-Blosc2, being parallelizable and JIT-compiling capable, can accelerate code quite a bit 🚀

For example, linspace() has been rewritten to use DSL kernels, and performance boost is well beyond expectations.

Blosc2 4.1 Release!

We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!👇️
Notebook - github.com/Blosc/python...)

Super-efficient DSL kernels are coming with forthcoming Python-Blosc 4.1.0.

A DSL kernel is a function that takes ndarray objects as input and returns a ndarray object as output.

Performance with classic Mandelbrot is kind of mind-blowing.

See github.com/Blosc/python... for full notebook.

The new engine in Python-Blosc2 4.0 delivers quite awesome performance results. Processing a 400 MB array can be up to 9.6x faster than NumPy 🤯

The best part is that it fully supports NumPy's array and ufunc interfaces. High performance with zero friction! 🏎️💨

ironarray.io/blog/miniexp...

Enjoy!

Python-Blosc2 just became a compute powerhouse. ⚡️

v4.0 integrates `miniexpr`: computing on cache-friendly blocks instead of RAM-heavy chunks.

🚀 Result? Massive speedups for memory-bound tasks (up to 4.5x in Cat2Cloud).

See benchmarks:
ironarray.io/blog/miniexp...

#Python #HPC #DataEngineering

📢 Blosc2 🤝 OpenZL 🔁

Use the OpenZL compression 🗜️ library from Blosc2: github.com/Blosc/blosc2...!

𝚙̲𝚒̲𝚙̲ ̲𝚒̲𝚗̲𝚜̲𝚝̲𝚊̲𝚕̲𝚕̲ ̲𝚋̲𝚕̲𝚘̲𝚜̲𝚌̲𝟸̲–̲𝚘̲𝚙̲𝚎̲𝚗̲𝚣̲𝚕̲

and just like that, OpenZL compression + Blosc2 compute engine!

Check out the OpenZL project openzl.org.

Inside story on the plugin ⏩️ blosc.org/posts/openzl...

Francesc Alted+Luke Shaw - Hands-on with Blosc2: Accelerating Your Python Data Workflows-PyData 2025 YouTube video by PyData

🚀 Our #PyDataGlobal 2025 tutorial on modern #Blosc2 & #Caterva2 features is out!

Learn how compression boosts array performance & enables cloud computing without downloads. ☁️

Watch here: 👇 www.youtube.com/watch?v=tUvS...

#Python #HPC #DataScience #BigData

🤔 Can a library that computes on compressed data actually outperform performance heavyweights like NumPy and NumExpr?

Find some surprising answers 👉 www.blosc.org/posts/roofli...

During the walk, I'm also introducing a funny anecdote back when NumPy was a 👶

Enjoy!

#Blosc2 #HPC #NumPy #Numexpr

To round off our presentation of the shiny new Cat2Cloud product, we have a final 💊 ironPill 💊on data handling from the web client 🌐 .

See how to move ➡️ , copy ©️ and perform other file management operations easily from the prompt box!

Stop downloading, start doing! 🔨

ironArray is on a roll 🚅!

With Cat2Cloud released this week we continue our 💊ironPill series with another video, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client!

Visualise and manage all kinds of data formats - from arrays to jpgs 🖼️, markdown to PDFs 📄 !

Excited to be part of this data story! ❤️

Tired of downloading large datasets? Cat2Cloud is now live! 🚀

Bring computation directly to your data. Host, run, and share workflows with incredible speed. ⚡

Read the announcement: ironarray.io/blog/cat2clo...

#Cat2Cloud #BigData #DataScience #Python #HPC

Stop downloading. Start computing.

Everything changes on November 18, 2025.

#Cat2Cloud is coming.

18.08.2025 Compress, Compute, and Conquer: Python-Blosc2 for Efficient Data Analysis YouTube video by EuroSciPy

Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.

www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource

📢🚨Blosc2 3.11.0 Released! 🚨 📢

Blosc2 is part of the NumPy array library ecosystem: numpy.org

In v3.11, Blosc2 has become even more flexible; all functions can accept basically any array object:

𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱)

for 𝙰, 𝙱 PyTorch, Jax, Tensorflow, Zarr... arrays!

#Compute
#Tensor
#PyTorch

💊IronPill 2💊
See how Blosc2 powers heavy-duty linear algebra (100GB!) workflows
⚡1.5-2x faster than PyTorch + h5py!
🧱 optimised chunking for your cache hierarchy
🐍 one line syntax 𝚋𝚕𝚘𝚜𝚌𝟸.𝚖𝚊𝚝𝚖𝚞𝚕(𝙰, 𝙱, 𝚞𝚛𝚕𝚙𝚊𝚝𝚑='𝚘𝚞𝚝.𝚋𝟸𝚗𝚍')

See blog here: ironarray.io/blog/la-blosc

#Blosc2
#Data
#LinearAlgebra

🚀 Want to boost performance in your complex calculations? Avoiding temporary arrays is critical!

Check out our new video 🎬 to see how #Blosc2 eliminates these temporaries⚡

Compress Better, Compute Larger

📢Blosc2 3.10.2 Released! 📢

Lazy evaluation for ALL Blosc2 functions in version 3.10!

Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!

#Zarr
#HDF5
#Python

There is no data wider than the one offered by the Milky Way! And with the right tools, you can do it all on your laptop.

This is really exciting news! 😍

It's also worth highlighting that the Blosc2 internal compute engine brings several advanced features to the table:
📡 Broadcasting
🎯 Reductions
🤝 Superior type compatibility with NumPy
✍️ Support for User-Defined Functions (UDFs)

Compress Better, Compute Bigger!

🚀 Boost your Python computations on NumPy arrays with @blosc.jit! Let Blosc2's compute engine accelerate your code without changing containers. ⚡

For ultimate speed, native Blosc2 containers are still king. 🏎️

Code: gist.github.com/FrancescAlte...

#Python #DataScience #NumPy #Performance #Blosc

🗣️ Announcing Python-Blosc2 3.8.0 🚀

A step closer to compliance with the array-api standard: data-apis.org/array-api!
This is an effort across all array-based libraries so that your code works (e.g. for both blosc2 and NumPy) by simply changing the import statement below!

#arrayapi #Blosc2

🗣️ Announcing C-Blosc2 2.21.2

This is a maintenance release, with a few fixes and some optimizations. Thanks to Barak Ugav and Preeyan Parmar.

For more info, see the release notes in:

github.com/Blosc/c-blos...

Compress Better, Compute Bigger
Enjoy!

Struggling to get performant code from LLMs? 🤔

We can help! 💪 We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).

Ready to dive in? 🚀
🔹 EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
🔹 Tutorial: github.com/Blosc/EuroSc...

#HPC #Blosc2

GitHub - EmilDohne/compressed-image: Fast and memory-efficient, compressed in-memory image storage for C++ and Python. Fast and memory-efficient, compressed in-memory image storage for C++ and Python. - EmilDohne/compressed-image

📣Great to see the community building powerful tools on Blosc2! 🚀

Check out compress-image: a new C++/Python library for working with compressed images directly in memory.

Kudos to Emil Dohne for this fantastic work!

Project here: github.com/EmilDohne/co...

#Blosc2 #FOSS #ImageProcessing

The slides of my talk about _Blosc2: Compress Better, Compute Bigger_ for the recent @euroscipy.bsky.social:
www.blosc.org/docs/2025-Eu...

EuroSciPy 2025 was great! A human sized event with lots of interesting talks and people ready to help you. Thanks to the organizers for such a fantastic event!