π C-Blosc2 3.0.0 RC1 is out!
What's new?
π¦ VL-blocks for irregular data (strings, JSON)
ποΈ LZ4/LZ4HC dictionary compression
π‘οΈ Important safety fixes
Check out the full release notes here: github.com/Blosc/c-blos...
Give it a spin and provide feedback!
#Blosc2 #OpenSource #C
Posts by ironArray SLU
Look at the bump in performance that we will see with the next Python-Blosc2 release.
Matrix multiplication has been speeded up by using blocks and Blosc2 prefilters and its own efficient and multithreaded engine.
Expect between 5x and 6x better speed for matrices with no padding.
We designed DSL kernels in Blosc2 so that they can be used in the main platforms; nowadays this necessarily includes Web Assembly (WASM) in the browser.
We also implemented a new JIT compiler for WASM specially meant for Blosc2 DSL kernels.
Play with it at: cat2.cloud/demo/roots/@...
Have fun!
Blosc2 4.1 Release!
We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!ποΈ
Notebook - github.com/Blosc/python...)
Super-efficient DSL kernels are coming with forthcoming Python-Blosc 4.1.0.
A DSL kernel is a function that takes ndarray objects as input and returns a ndarray object as output.
Performance with classic Mandelbrot is kind of mind-blowing.
See github.com/Blosc/python... for full notebook.
The new engine in Python-Blosc2 4.0 delivers quite awesome performance results. Processing a 400 MB array can be up to 9.6x faster than NumPy π€―
The best part is that it fully supports NumPy's array and ufunc interfaces. High performance with zero friction! ποΈπ¨
ironarray.io/blog/miniexp...
Enjoy!
Happy to sponsor this work, and very pleased with the results π€
This will be immensely helpful for making our Cat2.Cloud offer more efficient and user-friendly β€οΈ
π’ Blosc2 π€ OpenZL π
Use the OpenZL compression ποΈ library from Blosc2: github.com/Blosc/blosc2...!
πΜ²πΜ²πΜ²βΜ²πΜ²πΜ²πΜ²πΜ²πΜ²πΜ²πΜ²βΜ²πΜ²πΜ²πΜ²πΜ²πΜ²πΈΜ²βΜ²πΜ²πΜ²πΜ²πΜ²π£Μ²πΜ²
and just like that, OpenZL compression + Blosc2 compute engine!
Check out the OpenZL project openzl.org.
Inside story on the plugin β©οΈ blosc.org/posts/openzl...
π Our #PyDataGlobal 2025 tutorial on modern #Blosc2 & #Caterva2 features is out!
Learn how compression boosts array performance & enables cloud computing without downloads. βοΈ
Watch here: π www.youtube.com/watch?v=tUvS...
#Python #HPC #DataScience #BigData
Visualize data on your phone with Cat2Cloud! π±β¨
Create interactive plots in your mobile browser. No laptop needed!
Launch our demo, create graphs with Matplotlib/Plotly, customize, and render instantly. Register to save & share your work. ππ
Try it: cat2.cloud/demo/static/...
Numba can make UDFs really shine β¨β¨β¨
Specially interesting in these times, where SSDs, but specially RAM prices, are skyrocketing: arstechnica.com/gadgets/2025...
π€ Can a library that computes on compressed data actually outperform performance heavyweights like NumPy and NumExpr?
Find some surprising answers π www.blosc.org/posts/roofli...
During the walk, I'm also introducing a funny anecdote back when NumPy was a πΆ
Enjoy!
#Blosc2 #HPC #NumPy #Numexpr
It's Black Friday Week! ποΈπ€
Don't miss out! Use the coupon code BLACKFRIDAY to get a generous 50% OFF your first order on Cat2Cloud. π°
This offer is valid until Cyber Monday (Dec 1st), so don't delay! β³
Get it today! π ironarray.io/pricing
Unlock the power of your HDF5 data in the cloud! βοΈ
Cat2Cloud now offers native, out-of-the-box support for HDF5 files. Upload and process your HDF5 data as seamlessly as any other format. β¨
Ready to see it in action? Try our online demo server today! π cat2cloud.com/demo/
#HDF5 #CloudComputing
The crown jewel of Cat2Cloud π !
Cat2Cloud's most exciting feature: πΏπ²πΊπΌππ² π·ππ½πππ²πΏ π»πΌππ²π―πΌπΌπΈπ!
βοΈ cloud-based computation
βοΈ cloud-hosted data
βοΈ cloud-hosted jupyter notebooks!
β‘No environment headaches, no waiting for computations - all in a seamless interface from the browser!
Tired of downloading large datasets? Cat2Cloud is now live! π
Bring computation directly to your data. Host, run, and share workflows with incredible speed. β‘
Read the announcement: ironarray.io/blog/cat2clo...
#Cat2Cloud #BigData #DataScience #Python #HPC
Stop downloading. Start computing.
Everything changes on November 18, 2025.
#Cat2Cloud is coming.
Our Blosc2 tutorial for @euroscipy.bsky.social 2025 is up! Learn how compression boosts tensor data handling, sharing & computing.
www.youtube.com/watch?v=BdpT... #DataScience #BigData #HPC #OpenSource
Blosc2 is making its way towards becoming a general array library for data that is in memory, on disk or remote. This will be extremely useful to add flexibility to our cat2cloud SaaS service: ironarray.io/cat2cloud π π
π IronPill 1π
Blosc2 calculates Fourier approximations:
β‘5x faster than NumPy
π£ fraction of the memory footprint
π one-line syntax πππ(πβ*βπππ(π)β+βπβ*βπππ(π),βππ‘ππ=π·)
Full notebook: github.com/Blosc/python...
(inspiration: towardsdatascience.com/numexpr-the-...)
#Blosc2
#Data
#SignalProcessing
π’Blosc2 3.10.2 Released! π’
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
π¨Blosc2 3.9.1π¨
Blosc2 as a mature computation engine >>>
β’ Array API standard compliance - 70 new functions
β’ Fast linalg: tensordot 12x π
πππππ than NumPy for large arrays !
β’ Fast calc: Funcs like hypot 10x π
πππππ than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
It's surprising how often the powerful SIMD capabilities of modern processors are overlooked. Harnessing them is key to unlocking next-level performance.
Struggling to get performant code from LLMs? π€
We can help! πͺ We've spent countless hours profiling and micro-benchmarking Blosc2 for you. A thing that LLMs cannot do (yet).
Ready to dive in? π
πΉ EuroSciPy Talk: www.blosc.org/docs/2025-Eu...
πΉ Tutorial: github.com/Blosc/EuroSc...
#HPC #Blosc2
π We're thrilled to announce *TreeStore*, a new class in Python-Blosc2! Endow your datasets with a hierarchical structure! β‘οΈ
π We've blogged about it:
www.blosc.org/posts/new-tr...
It's in beta, and available in Python-Blosc2 v3.7.2. Enjoy!
#Python #Blosc2 #TreeStore #DataScience #OpenSource
π£ #Caterva2 2025.8.7 is out! π
We did a major refactoring for a simpler, more robust system, with client APIs unaffected. β
The highlight is the new cat2agent π€, a CLI client to watch a directory and auto-sync it with a Caterva2 server.
Release notes: github.com/ironArray/Ca...
#OpenSource
Tired of trial-and-error with #Blosc2 compression?
You can do better with #Btune! π
Btune can be trained to automatically find the best parameters for your specific datasets and use case.
Learn more about optimizing your compression workflow: ironarray.io/btune
#DataCompression #Optimization
Accessing remote datasets in less than 100 ms
Thanks to the advanced double partitioning techniques in #Blosc2, our #Caterva2 package can serve small slices of big datasets (3.8 GB) through internet in less than the blink of an eye.
Try it out by yourself! π cat2.cloud/demo/roots/@...
Share Data Faster!
#BigData #RemoteAccess #Performance
For those who could not attend, the recording of our recent webinar, "A Gentle Introduction to Cat2Cloud," is now available!
ironarray.io/cat2cloud#we...
If interested, remember that the subscription to our beta program is currently open!
Compress Better, Compute Bigger, Share Faster!