Modeling pipeline
Last updated
Last updated
Modeling pipelines are pipelines that contain data models. You can create a pipeline to describe a workflow of multiple models and schedule job to periodically run the workflow.
Follow these steps:
In your Recurve project, go to Data Design > Pipelines.
Click on the + icon and select Creating modeling pipeline.
Provide the name for your pipeline.
Select the models that the pipeline should contain.
In Variable settings, you can view the list of variables associated with the models.
On each variable, you can decide to lock the current value; this applies to dynamic variables, such as current datetime. You can also provide a custom value.
Click Confirm.
The new modeling pipeline is then added under the Models folder and presented in the DAG view.
Click Publish.
Once the pipeline is created and published, you can start scheduling runs through jobs. See: Job.