Job

While a pipeline describes your data workflow, a job describes the execution of a pipeline. In job configuration, you can specify the target environment, run schedule, and notifications when the job fails.

Create a job

Follow these steps:

1. From the Pipelines tab, select a pipeline.

2. Switch to the Jobs tab and click + Create a job.

3. Provide the configuration for the job.

1. Detail

Provide the name, select the target environment, and customize the associated model variables.

2. Schedule

Provide the schedule for the job and the trigger type:

• Standard setup: trigger the run at a specific time between certain intervals.

• Advanced setup: specify the schedule in crontab format, for those familiar with the cron scheduler. See: Cron.

• Manually trigger: no scheduling and can be manually triggered in the Pipeline Health dashboard. See: Pipeline Health.

3. Notification

Here you can configure notifications on job failure. By default, notifications are sent by email.

1. Click Create.

The new job will be displayed in the Jobs section.