Overview

The Pipeline module in Recurve enables you to orchestrate data workflows efficiently. Rather than manually running models to retrieve results, you can define pipelines that automate the entire data transformation process. Pipelines represent your data workflows, from which you can schedule periodic runs, manage dependencies between models, and monitor workflow status in real time.

In Recurve, pipeline is a another type of asset that can contain multiple models. When you create a pipeline, Recurve automatically queries the relationship between models - derived from data lineage - and visualizes them in a DAG (directed acyclic graph).

Key features

The Pipeline module currently supports the following features:

• Modeling pipeline: Create pipelines from data models.

• Job: Configure job and schedule run from pipelines.