| A bit about me... |
|---|
| 💼 Engineer @ Earthmover |
| 🌎 Active member of the Pangeo Community |
| 🌕 Core developer of Xarray |
| 🧪 PhD in fusion plasma physics from Uni. York & CCFE |
I also work on several other open-source projects for science.
Recent blog posts¶
The article I wish I could have read back when I first heard of Zarr in 2018. Explains how object storage and conventional filesystems are different, and the key properties that make Zarr work so well in cloud object storage.
Imagine being able to visit one website, search for any scientific dataset from any institution in the world, preview it, then stream the data out at high speed, in the format you prefer. We have the technology - here's what we should build.
How xarray's new DataTree feature came about, and thoughts on how public agencies can support the open-source scientific software that they depend on.
Cubed was designed to address the main problems with Dask, so I integrated it with Xarray.
Dask's distributed scheduler algorithm got a major fix after we tested its' limits on a huge oceanography analysis problem.