You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello.
I am using Dagster OSS in a custom kubernetes deployment.
My dagster.yaml specifies run_coordinator as QueuedRunCoordinator.
I can successfully run jobs with run_launcher set to DefaultRunLauncher or K8sRunLauncher.
I would like to run some jobs as subprocesses in my code location server container (which I can do with DefaultRunLauncher) and some jobs in separate kubernetes pods (which I can do with K8sRunLauncher).
I can do one or other, but not both.
I don't need to run individual steps/ops in separate pods. Happy to choose at the job level.
I have tried using DefaultRunLauncher at the instance level, and k8s_job_executor at the job level, but this gives...
AttributeError: 'DefaultRunLauncher' object has no attribute 'image_pull_policy'
Is there any way to select a run launcher at the job level?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hello.
I am using Dagster OSS in a custom kubernetes deployment.
My dagster.yaml specifies run_coordinator as QueuedRunCoordinator.
I can successfully run jobs with run_launcher set to DefaultRunLauncher or K8sRunLauncher.
I would like to run some jobs as subprocesses in my code location server container (which I can do with DefaultRunLauncher) and some jobs in separate kubernetes pods (which I can do with K8sRunLauncher).
I can do one or other, but not both.
I don't need to run individual steps/ops in separate pods. Happy to choose at the job level.
I have tried using DefaultRunLauncher at the instance level, and k8s_job_executor at the job level, but this gives...
AttributeError: 'DefaultRunLauncher' object has no attribute 'image_pull_policy'
Is there any way to select a run launcher at the job level?
Beta Was this translation helpful? Give feedback.
All reactions