the gallery of real-world online Zarr stores {zaro} now tests against (via gha)
zaro needs your feedback, this is a #Zarr engine in R using #Arrow for the heavy lifting (IKR!, main player is arrow::S3FileSystem) #RStats
github.com/hypertidy/zaro
An Earth-view from space showing the blue curve of the planet against a dark background. The foreground features the EOPF logo—a stylized "E" combined with a colourful cube and a cloud icon. To the right, the text reads "WEBINAR #1 EXPLORER" in orange and white. At the bottom, the ESA and EOF logos are displayed in white.
📅 Join the official launch of the #EOPF #Sentinel #Zarr Explorer: 9 March (15:00 CET)
Supported by @esa.int, this webinar demonstrates browser-based Sentinel data visualisation using Zarr/GeoZarr.
@thrivegeo.bsky.social @developmentseed.org @eox.at
🔗 Register: www.tickettailor.com/events/thriv...
#zarr #geospatial #datacube the potential 🤯
🌍 #Earth, #Ocean & #Atmospheric Scientists
Quick poll: Are you using #scientificdata formats? (#NetCDF, #HDF5, #Zarr, etc.)
✅ Takes only 5' (Required fields) to 15' (Optional fields)!
👉 Link: forms.office.com/Pages/Respon...
Please share, your input helps improve research tools!
#MATLAB #Python
🛢️ #Zarr format (i.e. cloud friendly multidimensional arrays) seems finally poised on the cusp of widespread operational use, with huge momentum building around both the format itself and the ecosystem around it. @esa.int's #EOPF program to deliver Sentinel data in Zarr is particularly exciting!
Curious about the new #Zarr data format for #Sentinel data? Want to ask experts from @developmentseed.org and thriveGEO how to use it?
Join our Office Hours session on Nov 4, 10-11am (UTC+1):
⭐ buytickets.at/thrivegeo/19...
Everyone is welcome!
Weather data is vital but too often accessing it means reinventing the wheel. Discover how dynamical.org used Source's data publishing utility to create a common good, making petabytes of #Zarr formatted #weatherdata
✅ Easy✅ Fast ✅ Open
Read the #casestudy here: docs.source.coop/case-studies...
Earlier this week E84-er Julia Signell visited the European Space Agency (ESA) remote sensing facility outside of Rome to hammer out the details of how to represent #Zarr data in STAC.
Expect a blog post in the next week or so summarizing the outcomes!
📢Blosc2 3.10.2 Released! 📢
Lazy evaluation for ALL Blosc2 functions in version 3.10!
Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!
#Zarr
#HDF5
#Python
🛰 At #BigDatafromSpace2025 (BiDS’25), the EOPF Tutorial: Getting Started with Zarr showed how cloud-native tools like #Zarr & #STAC make #EarthObservation data more scalable & accessible.
If you wish to build analysis-ready #Sentinel-3 data cubes, why not try this newly published #JupyterNotebook? It demonstrates how to use the #xcube-eopf plugin for data analysis.
#Zarr format
#EOPFSampleService project
#datacubes
eopf-sample-service.github.io/eopf-sample-...
This is typical from coordinate array models, they are sloppy
There are many examples, using degenerate rectilinear coordinates is always a terrible idea, sadly the loudly trumpeted successor of all formats has adopted this practice blithely from netcdf,hdf #Zarr
🌍 Excited for #BiDS25 in Riga!
📅 29/09 Tutorial | 30/09 Hackathon
Supported by our colleague Konstantin Ntokas, the EOPF Zarr Hackathon dives deep into #CloudNative #EO with #Zarr, STAC, Dask, Julia & more.
👉 Register here: bit.ly/4oYOJ2P
Davin Potts to the right of a poster titled "Zarr + DragonHPC can acelerate reads from large OME-Zarr microscopy datasets by 3X-300X" At the top is a screeenshot of napari. Below is a diagram of networked data access by Dragon DDict.
Favorite #SciPy2025 moment (so far?):
poster by Davin Potts on speeding up HPC file IO for #Zarr files and involving napari and the awesome @jookuma.bsky.social
I met Davin's son at SciPy 2024 and demo'd napari and introduced him to Jordao 🤯
Butterfly effect?
ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩
doi.org/10.1093/giga...
Screenshot of the PDF available at https://cloud.gerbi-gmb.de/s/6LrYfMByymPnHP5/download/2025_OME-Zarr_sw_developer.pdf
Screenshot of the PDF available at https://cloud.gerbi-gmb.de/s/y4rBGFM6dXn8Jkr/download/2025_OME-Zarr_web_developer.pdf
🚀 We’re hiring again! Join @gerbi-gmb.de as a Software Developer!
💻 Build scalable #bioimaging solutions
🌍 Collaborate globally
🎯 Contribute to open science through #OME #Zarr
📣 Tell your #NGFF friends.
Remote, full-time. Apply by 30 June 2025: All submissions via bit.ly/gerbi-jobs-2...
Analysis-ready VCF at Biobank scale using Zarr. #VCF #Zarr #GeneticVariants #Genomics #Bioinformatics @gigascience.bsky.social 🧬 🖥️
academic.oup.com/gigascience/...
To all our #Zarr friends out there, a reminder that this is a placeholder. Please follow @zarr.dev for the Real Zarr ™️
"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."
🧠 Interested in extending #Zarr?
Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅
github.com/zarr-develop...
Some Postdoc throwback today riding the NJtransit to Princeton.
On my way to the #WCRP km scale hackathon for the week.
www.wcrp-esmo.org/activities/w...
Excited to play around with #healpix #zarr #icechunk and some super high res data.
🤩 " #NASA ... leveraged #Icechunk’s virtualization capabilities to present the entire collection of over a #million files as a single analysis-ready #Zarr data cube. "
#sciencejobs #imageprocessing #bioimage #zarr #xarray @czbiohub.bsky.social
𝗖𝗙 𝗠𝗲𝘁𝗮𝗱𝗮𝘁𝗮 𝗖𝗼𝗻𝘃𝗲𝗻𝘁𝗶𝗼𝗻𝘀 support #OpenScience by automating processes via metadata in #NetCDF and #Zarr files. They establish a unified language for the #weather, #climate, #ocean, and #EO community. buff.ly/Vmtz6zH
#remotesensing #EarthObs
My personal bet is that DuckDB will eventually be able to read multidimensional array data stored in EarthMover (i.e. #Zarr) via the reframing of rasters as tables and visa versa.
github.com/zarr-develop...
Looking for a job where you get to play with #Zarr
🧊🧊
🧊🧊❔
👇
Please help the #Zarr community welcome @normanrz.bsky.social as the newest member of the Steering Council! 👏🏼
zarr.dev/blog/steerin...
And there's of course github.com/grimbough/Rarr if you're interested, @jerry-shannon.bsky.social. Nothing like #Zarr in #R (to make a mouthful)
Tall, narrow screenshot of https://zarr.dev/implementations/ showing all the language implementations of Zarr and their current status.
Thanks to gitub.com/ldeakin the list of #zarr implementations is now shiny and new! ✨
zarr.dev/implementati... 👈
If any are missing or need updating, please let us know.
#beautifuldata in #zarr 😍
