Pipeline

Automation pipeline for end-to-end workflows.

class modeva.automation.pipeline.Pipeline(name: str = 'modeva-pipeline', save: bool = False)[source]

Pipeline controller.

Pipeline is a DAG of base steps, each step will be executed.

Parameters:
namestr, default=”modeva-pipeline”

Name of the pipeline.

savebool, default=False

Whether to save the pipeline results.

add_step(name: str, func: Callable, func_inputs: Dict[str, Any] | None = None, parent: Sequence[str] | None = None, save_data: bool = False, save_model: bool = False, save_testsuite: bool = False, title: str = None)[source]

Add a step to pipeline.

Parameters:
namestr or Path

The name of the pipeline.

funcCallable

The callable function for this step.

func_inputsOptional[Dict[str, Any]], default = None

Inputs for the callable function.

parentOptional[Sequence[str]] = None

Parent step of this step

save_databool, default = False

Whether to register the data object to database.

save_modelbool, default = False

Whether to register the model object to database.

save_testsuitebool, default = False

Whether to register the validation result object to database.

titlestr, default = None

Title of this step.

run()[source]

Run the pipeline.