How to define dependencies between jobs #19061
Unanswered
AlessioV98
asked this question in
Q&A
Replies: 1 comment
-
Not sure if you still need this answered but I'll answer it anyway for the other people who find themselves here. Within our org, we're able to do this using the Something like this...
Note that the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, as stated in the title, I'd like to achieve a behaviour in which I have 4 ingestion jobs (defined through "define_asset_job" API, all 4 scheduled at the same time and based on independent assets, and then I have a processing job that is supposed to run iff all 4 ingestion jobs above has successfully runned on schedule (could be once a day, could be once a week).
All jobs have been unit tested and work singularly, no need to further define them
What I do need to do is to comprend how this dependecy behaviour can be achieved, for example I've already tried using sensors (with @run_status_sensor decorator) but that doesn't seem to handle my case (i.e: the monitored jobs parameter in its definition seems to be an "or" clause in which if a single one of those jobs succeded than the sensor is triggered, I would like to fire the sensor if ALL 4 monitored jobs succedes as stated before)
Maybe I should define this logic in the sensor function itself but atm im a bit confused on the right approach
Thanks in advance for the support, also feel free to ask for any missing detail.
Beta Was this translation helpful? Give feedback.
All reactions