Anndata now supports @zarr.dev v3, great for both performance and interoperability. Check out our guide for more info, especially sharding: anndata.readthedocs.io/en/stable/tu.... Don’t worry though, we remain fully v2 backwards compatible - upgrade fearlessly!
Posts by Zarr
♻️ 7/8 - Webinar: Reusable Deep Learning with EOPF Zarr Samples - ESA Copernicus Earth Observation Processor Framework
Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE).
#datascience #deeplearning
The Google Earth Engine code editor displaying an evaporation map loaded directly from ARCO-ERA5! The black and white map overlooks the continental US. It's easy to make out land masses, but there are also cloud-looking visuals on the map.
I've been waiting a few years for this: Zarr v2 support was just launched in Google Earth Engine! Check out this demo that loads ARCO-ERA5 into GEE 🔥
code.earthengine.google.com/67ac1e48848d...
developers.google.com/earth-engine...
If you missed today's presentation at the LPS by @thejeran.bsky.social on Browzarr, a browser-based visualization toolkit for exploring and analyzing Zarr data stores, go and check out the version online, and open issues and do feature requests on GitHub. github.com/EarthyScienc...
comic doodle of Evgeny Zakharov in a suit and stripey shirt, with a small plane to the left, while DNA strands and bases are above, a camera is taking a photo of a feather and a wasp, the coloring is grey shades on a red background.
comic doodle of Jerome Kelleher in a t-shirt and stripey shirt, the background is full of small peon people with DNA strands in them and 4 files with the word ZARR written on them, the coloring is grey shades on a green background.
doodles of two Tree of Life department speakers @sangerinstitute.bsky.social this week, Evgeny Zakharov talking about insanely large scale barcode sequencing and Jerome Kelleher talking about large scale human genomic data analysis.
that's a lot of data 🧬📄
We welcome a new project to OpenSustain.tech #climate #sustainability #opensource #opensustain #openscience github.com/zarr-develop...
ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩
doi.org/10.1093/giga...
OME-Zarr 4 life
"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."
1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.
Curious about climate patterns? The new ERA Explorer app lets you compare 85 years of climate data worldwide. Analyse climatological averages at any map point or explore month-by-month data.Dive deeper with ERA Explorer! era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S #beautifuldata
@zarr.dev even 🤩 Love it #beautifuldata
🧠 Interested in extending #Zarr?
Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅
github.com/zarr-develop...
Just back from #CNG2025, I wrote up some thoughts on the traction the @zarr.dev format is gaining in the broader geospatial industry (specifically Earth Observation). I also summarize what features and tools the user and developer communities are asking for to fully leverage Zarr. 👇👇👇
1/ 💡 Our latest blog post in the fundamentals series, written by @tegnicholas.bsky.social, demystifies cloud-optimized scientific data formats!
Read more: earthmover.io/blog/fundame...
🚀 Big launch today: introducing Flux — a game-changing way to serve geospatial data via standard APIs in seconds. Built for scale, speed, and simplicity.
This one was a lot of fun to work on! Why @xarray.bsky.social and @zarr.dev are faster than DuckDB and Parquet for gridded data...from first principles.
What's behind ERA Explorer's speed? Meet the ZARR archive! 🚀 ZARR revolutionises data processing, enabling fast, efficient access to over 80 years of climate data.
Test out its speed 👉 era-explorer.climate.copernicus.eu?lat=50.86&ln...
#C3S @zarr.dev #beautifuldata
Just started using Zarr - literally unbelievably good.
🤩 " #NASA ... leveraged #Icechunk’s virtualization capabilities to present the entire collection of over a #million files as a single analysis-ready #Zarr data cube. "
🚨 New blog post 🚨
In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.
ICYMI: A MATLAB implementation of @zarr.dev has dropped from @mathworks.bsky.social 🚀
github.com/mathworks/MA...
Really cool new neuroscience benchmark just dropped.
Data is in @zarr.dev and demos use tensorstore.
zapbench-release.storage.googleapis.com/landing.html
Very happy to announce our winter release of syGlass: 2.2.0!
Now control syGlass with your voice. We've also upgraded the auto-segmentation, mask handling & proofreading, and the narration system. We've added basic support for @zarr.dev. Check out the changelog: www.syglass.io/blog/announc...
You, yes you, can help the Cloud Native Geospatial Movement!
Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them?
Learn how to give back in my post: cholmes.medium.com/you-yes-you-...
We're a bit late to the bsky game so we appreciate a boost! @loicaroyer.bsky.social @haesleinhuepf.bsky.social @florianjug.bsky.social @lhinderling.bsky.social @kbias.bsky.social @zarr.dev @xarray.bsky.social @scipyconf.bsky.social @drlachie.bsky.social @henriqueslab.bsky.social @globias.bsky.social
If you missed the Zarr-Python 3 release party last week, no worries because today, we released zarr-python 3.0.1 and numcodecs 0.15.0.
release notes 👉 zarr.readthedocs.io/en/stable/re...
Microscopy Nodes loads data from a @zarr.dev bucket, making it easy to use open data archives that host Zarr data!
This is a mitotic cell from Walther et al. 2018, that's hosted publicly on the Image Data Resource 😱
😍 That's what friends are for!!
#opensource #scientific #python #ftw 💪
🎉 Zarr-Python 3 is here! 🎉
- Full support for Zarr v3 spec
- Chunk-sharding for more efficient data storage
- Major performance boosts with async I/O & parallel compression
💻 pip install --upgrade zarr
💻 conda install --channel conda-forge zarr
Blog post: https://buff.ly/3C3OwYw