The HDF Group's Call the Doctor
Find the latest information about the HDF file formats and new developments from The HDF Group and the HDF community.
Episodes
91 episodes
Benchmarking Cloud Optimized HDF5 files locally and on AWS S3 - Aleksandar Jelenak, Call the Doctor
Aleksandar Jelenak presented benchmark results comparing an original and cloud optimized versions of the same file when either in local file system or AWS S3.This session was recorded on November 19, 2024. You can also
•
40:44
Field selection and data streaming with h5py and h5pyd - John Readey on Call the Doctor 11/12/24
The HDF Group’s John Readey hosted Call the Doctor today, Tuesday, November 12. In this session, John discussed field selection and data streaming with h5py and h5pyd.This session was recorded on November 12, 2024. You can also
•
26:43
HDF5 2.0 - Your questions and HDF5 2.0 Discussion with Director of Engineering Dana Robinson 11/5/24
The HDF Group's director of engineering continued the discussion on HDF5 2.0. You can check out the planned work at the HDF5 2.0 Planning wiki. Projects for HDF5 2.0 include:...
•
38:49
Versioned HDF5 - HDF Clinic with Gerd Heber (Call the Doctor) 10/29/24
The HDF Group's executive director Gerd Heber made himself available for community questions and highlighted another great community project, Versioned HDF5.Check o...
•
30:17
Hyperslab vs point-selection in HPC - Scot Breitenfeld on Call the Doctor 10/22/24
Scot Breitenfeld of The HDF Group made himself available for user questions and reviewed a recent comparison of hyperslab selection versus point selection in an HPC context.This session was recorded on October 22, 2024. You can also
•
20:56
New info on upcoming HDF5 releases - Dana Robinson on Call the Doctor 10/15
In this session of Call the Doctor, The HDF Group's Director of Engineer Dana Robinson explained why the next (scheduled for April 2025) release of HDF5 will be HDF5 2.0 and what changes you can expect to see in this next major release....
•
32:37
h5pyd updates (hsload and h5acl) - John Readey on Call the Doctor 10/8/24
The HDF Group's John Readey hosted Call the Doctor. He followed up on his topic last month, which was fancy indexing. You can watch that video to catch up. On the forum, a community user...
•
20:13
Dana Robinson on Call the Doctor 10/1/24 - HDF5 1.16 and other updates
The HDF Group's Dana Robinson talked about the next release of HDF5 and why we're debating whether it will be 1.16 or 1.14.6. He also briefly talked about the upcoming HEP - HDF Enhancement Process and how that will help provide transparency an...
•
11:06
Fortran & HPC Expert Scot Breitenfeld on Call the Doctor - September 24, 2024
Scot Breitenfeld hosted Call the Doctor on September 24. Scot's our HPC and Fortran expert and shared some HPC news including some testing on Aurora. There was a question and ensuing discussion on determining chunking parameters for using compr...
•
14:37
A Python script for dataset statistics for a HDF5 file - Aleksandar Jelenak on Call the Doctor 9/17
The HDF Group's Aleksandar Jelenak hosted Call the Doctor on Tuesday, 9/17 and talked about a Python script he wrote for additional (compared to h5stat) dataset sta...
•
22:28
SWMR and FancySelections for h5pyd with HSDS - Call the Doctor 9/10
The HDF Group's John Readey used his Call the Doctor session to talk about SWMR (single writer multiple reader) and FancySelections for h5pyd with HSDS. Example notebooks referenced by John during this session:
•
22:34
Upcoming Releases and some communications notes from The HDF Group - Dana Robinson 9/3/24
The HDF Group's Director of Engineering Dana Robinson provided some general updates. Dana talked about upcoming releases of HDF5, HDF4, and HDFView. Communications Coordinator Lori Cooper announced the availability of the 2024 HDF5 User Group M...
•
13:38
A look at the latest PureHDF Release - Call the Doctor with Gerd Heber 7-30-24
In addition to answering community questions, we will examine the latest PureHDF release(s). PureHDF v1.0.0 and v2.0.0 were released on June 24 (2024), and there have been subsequent minor releases (see
•
43:55
HPC and Fortran expert Scot Breitenfeld on Call the Doctor 8/27/24
The HDF Group's Scot Breitenfeld ended up using this session to discuss topics including subfiling, support of multidimensional arrays by various languages, the future of Fortran and more with community members and The HDF Group co-workers.&nbs...
•
18:08
Hidefix: Multi-threaded read-only acces to local HDF5/netCDF4 files - Aleksandar Jelenak
The HDF Group’s Aleksandar Jelenak will talk about a Hidefix, a Rust package for multithreaded read-only access to local HDF5/netCDF4 files. https://github.com/gauteh/hidefix It can also be imported as a Python package and used as an xarray bac...
•
24:27
libhdf5 improvements for Cloud Optimized HDF5 files - Aleksandar Jelenak on Call the Doctor 7/16/24
The HDF Group's senior informatics architect, Aleksandar Jelenak talked about some hdf5lib changes in the pipeline that will bring improvements for Cloud Optimized HDF5 files.This session was recorded on July 16, 2024. You can also
•
28:29
Performance enhancements using the h5pyd MultiManager - John Readey on Call the Doctor 7/9/24
The HDF Group's John Readey used his Call the Doctor session to talk about performance enhancements using the h5pyd MultiManager.For a use case where MultiManager came in clutch, check out this recent
•
22:09
Upcoming Releases and Engineering Activities - Dana Robinson on Call the Doctor 7/2/24
The HDF Group's Engineering Director Dana Robinson hosted the first Call the Doctor of the month and used his time to talk about upcoming releases and some activities and thoughts we’ve been working through on versioning. Then he talked about p...
•
40:20
HDF5 Documentation - Gerd Heber on Call the Doctor 6/25/24
In this episode of Call the Doctor, The HDF Group's Gerd Heber discusses the evolution of HDF documentation, highlighting challenges and past approaches and describes our shift towards treating documentation like code, citing the adoption of to...
•
23:36
s5cmd for S3 - parallel, file system, very fast, and works with S3 - ideal for the HDF community - Aleksandar Jelenak on Call the Doctor
Aleksandar Jelenak of The HDF Group hosted Call the Doctor and shared his experiences with the s5cmd command-line tool that makes working with S3 object stores much easier and faster. He likes it and ...
•
28:26
Using Github Codespaces with h5pyd - John Readey on Call the Doctor
In this episode of Call the Doctor, John Readey introduced GitHub Codespaces and demonstrates their use with the h5pyd repository. Codespaces allow running a repository in the cloud without local setup. The speaker sets up a Codespace for the h...
•
23:34
Learn about the possible HDF5 1.16 Release with Dana Robinson - Call the Doctor 6/4/24
In this episode of Call the Doctor, Engineering Director Dana Robinson talks about the potential for a HDF5 1.16 release and discusses some HDF5 roadmap options with community members.This session was recorded on June 6, 2024. Y...
•
36:16
HDF5 in HPC with Scot Breitenfeld - Call the Doctor for Tuesday 5/28
In this episode of Call the Doctor, Scot Breitenfeld went over recent benchmarks comparing all versions of HDF5, and talked through some of the development that caused changes in those benchmarks. Scot was also available for community questions...
•
7:22
John Readey on Github Codespaces - Call the Doctor May 14, 2024
The HDF Group's John Readey walked through using Github Codespaces with HSDS.This session was recorded on May 14, 2024. You can also watch this episode online.
•
4:56
h5py and cloud optimized hdf files with Aleksander Jelenak on Call the Doctor
In this "Call the Doctor" session hosted by Aleksander Jelenak, the agenda was opened for questions regarding h5py or Cloud optimization of HDF files. The discussion delveed into understanding the applicability of techniques used in h5py to the...
•
29:45