Bamboost
bamboost/core/hdf5/ref

bamboost.core.hdf5.ref

Source: https://gitlab.com/cmbm-ethz/bamboost/-/blob/next/bamboost/core/hdf5/ref.py

This module provides a high-level abstraction for working with HDF5 (h5py) groups and datasets. It is built on the concept of describing an object in the file with a reference to it (deterministic reference: a file instance, and a path inside the HDF file).

The reference handles file opening and closing, and provides a simple interface to data, attributes and subgroups. In essence, this model provides h5py objects like any other in-memory data structure.

Attributes

  • log=BAMBOOST_LOGGER.getChild('hdf5')
  • MPI_ACTIVE='mpio' in h5py.h5py.registered_drivers() and h5py.h5py.get_config().mpi and bamboost.mpi.MPI_ON
  • _RT_group=TypeVar('_RT_group', bound=Union['Group', 'Dataset'])
  • _g=bamboost.core.hdf5.ref.Group
  • _d=bamboost.core.hdf5.ref.Dataset

Classes

InvalidReferenceError

InvalidReferenceError(self, path, filename)
Arguments:

RefStatus

Attributes:
  • INVALID=0
  • VALID=1
  • NOT_CHECKED=2

H5Reference

H5Reference(self, path, file)
Arguments:
  • path:str
  • file:HDF5File[bamboost._typing._MT]
Attributes:
  • _status:RefStatus=bamboost.core.hdf5.ref.RefStatus.bamboost.core.hdf5.ref.RefStatus.NOT_CHECKED
  • _file=bamboost.core.hdf5.ref.H5Reference(file)
  • _path=HDF5Path(path)
  • _obj:typing.Union[h5py.h5py.Group, h5py.h5py.Dataset, h5py.h5py.Datatype]

    Returns the h5py object bound at the path of this reference.

  • attrs:AttrsDict[bamboost._typing._MT]
  • parent:Group[bamboost._typing._MT]
H5Reference.__getitem__(self, value)
Arguments:
  • value
H5Reference.__repr__(self) -> str
H5Reference.new(cls, path, file, _type=None) -> _RT_group

Returns a new pointer object.

Arguments:
  • cls
  • path:str
  • file:HDF5File[bamboost._typing._MT]
  • _type:typing.Optional[typing.Type[_RT_group]]=None
H5Reference._is_valid(self)

Group

Group(self, path, file)
Arguments:
  • path
  • file
Attributes:
  • _group_map=FilteredFileMap(file.file_map, path)
  • _status=RefStatus(_valid)
  • _obj:h5py.h5py.Group
Group.__iter__(self)
Group.__contains__(self, key) -> bool
Arguments:
  • key:str
Group.__delitem__(self, key) -> None

Deletes an item.

Arguments:
  • key
Group.__setitem__(self, key, newvalue)

Used to set an attribute. Will be written as an attribute to the group.

Arguments:
  • key
  • newvalue
Group.keys(self)
Group.groups(self)
Group.datasets(self)
Group.items(self, *, filter=None) -> Generator[Tuple[str, Union[Group[_MT], Dataset[_MT]]], None, None]
Arguments:
  • filter:typing.Optional[typing.Literal['groups', 'datasets']]=None
Group.require_self(self) -> None

Create the group if it doesn't exist yet.

Group.require_group(self, name, *, return_type=None)

Create a group if it doesn't exist yet.

Arguments:
  • name
  • return_type=None
Group.require_dataset(self, name, shape, dtype, exact=False, **kwargs) -> h5py.Dataset
Arguments:
  • name:str
  • shape:tuple[int, ...]
  • dtype
  • exact:bool=False
  • kwargs={}
Group.add_numerical_dataset(self, name, vector, attrs=None, dtype=None, *, file_map=True) -> None

Add a dataset to the group. Error is thrown if attempting to overwrite with different shape than before. If same shape, data is overwritten (this is inherited from h5py -> require_dataset)

Arguments:
  • name:str

    Name for the dataset

  • vector:ArrayLike

    Data to write (max 2d)

  • attrs:typing.Optional[typing.Dict[str, typing.Any]]=None

    Optional. Attributes of dataset.

  • dtype:typing.Optional[str]=None

    Optional. dtype of dataset. If not specified, uses dtype of inpyt array

  • file_map:bool=True

    Optional. If True, the dataset is added to the file map. Default is True.

Group.add_dataset(self, name, data, attrs=None, dtype=None) -> None
Arguments:
  • name:str
  • data:typing.Any
  • attrs:typing.Optional[typing.Dict[str, typing.Any]]=None
  • dtype:typing.Optional[str]=None
Group._ipython_key_completions_(self)
Group._is_valid(self)
Group._assert_file_map_is_valid(self)
Group._repr_html_(self)

Repr showing the content of the group.

Dataset

Attributes:
  • _obj:h5py.h5py.Dataset
  • shape:tuple[int, ...]
  • dtype
  • array:numpy.numpy.ndarray
Dataset.__getitem__(self, key) -> Any
Arguments:
  • key:tuple | slice | int

hdf5path

Previous Page

simulation

Next Page

On this page

Attributes
Classes
InvalidReferenceError
RefStatus
H5Reference
__getitem__
__repr__
new
_is_valid
Group
__iter__
__contains__
__delitem__
__setitem__
keys
groups
datasets
items
require_self
require_group
require_dataset
add_numerical_dataset
add_dataset
_ipython_key_completions_
_is_valid
_assert_file_map_is_valid
_repr_html_
Dataset
__getitem__