coffea.processor#

A framework for analysis scale-out

Functions#

accumulate(items[, accum])

Classes#

ProcessorABC()

ABC for a generalized processor

IterativeExecutor([status, unit, desc, ...])

Execute in one thread iteratively

FuturesExecutor(status, unit, desc, ...)

Execute using multiple local cores using python futures

DaskExecutor([status, unit, desc, ...])

Execute using dask futures

ParslExecutor([status, unit, desc, ...])

Execute using parsl pyapp wrapper

TaskVineExecutor([status, unit, desc, ...])

Execute using TaskVine distributed computing framework

Runner(executor, pre_executor, chunksize, ...)

A tool to run a processor using uproot for data delivery

CheckpointerABC()

ABC for a generalized checkpointer

SimpleCheckpointer(checkpoint_dir[, ...])

AccumulatorABC()

Abstract base class for an accumulator

value_accumulator(default_factory[, initial])

Holds a value of arbitrary type

list_accumulator([iterable])

A list with accumulator semantics

set_accumulator

A set with accumulator semantics

dict_accumulator

A dictionary with accumulator semantics

defaultdict_accumulator

A defaultdict with accumulator semantics

column_accumulator(value)

An appendable numpy.ndarray or ak.Array

Result()

A Rust-style result type wrapping either a success value or an exception.

Ok(value)

A successful result containing a value.

Err(exception[, value])

A failed result containing an exception, optionally with a partial value.

Class Inheritance Diagram#

Inheritance diagram of coffea.processor.processor.ProcessorABC, coffea.processor.executor.IterativeExecutor, coffea.processor.executor.FuturesExecutor, coffea.processor.executor.DaskExecutor, coffea.processor.executor.ParslExecutor, coffea.processor.taskvine_executor.TaskVineExecutor, coffea.processor.executor.Runner, coffea.processor.checkpointer.CheckpointerABC, coffea.processor.checkpointer.SimpleCheckpointer, coffea.processor.accumulator.AccumulatorABC, coffea.processor.accumulator.value_accumulator, coffea.processor.accumulator.list_accumulator, coffea.processor.accumulator.set_accumulator, coffea.processor.accumulator.dict_accumulator, coffea.processor.accumulator.defaultdict_accumulator, coffea.processor.accumulator.column_accumulator, coffea.processor.executor.Result, coffea.processor.executor.Ok, coffea.processor.executor.Err