slice_chunks

coffea.dataset_tools.slice_chunks(fileset: Dict[str, DatasetSpec], theslice: Any = slice(None, None, None)) Dict[str, DatasetSpec][source]

Modify the input dataset so that only the chunks of each file specified by the input slice are processed.

Parameters:
  • fileset (FilesetSpec) – The set of datasets to be sliced.

  • theslice (Any, default slice(None)) – How to slice the array of row-ranges (steps) in the input fileset.

Returns:

out – The reduce fileset with only the row-ranges specific by theslice left.

Return type:

FilesetSpec