Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EcsRunLauncher regression - "Could not determine image for run" #26138

Open
treilly1 opened this issue Nov 25, 2024 · 1 comment · May be fixed by #26139
Open

EcsRunLauncher regression - "Could not determine image for run" #26138

treilly1 opened this issue Nov 25, 2024 · 1 comment · May be fixed by #26139
Labels
type: bug Something isn't working

Comments

@treilly1
Copy link

treilly1 commented Nov 25, 2024

What's the issue?

What did you expect to happen?

  • No breaking ECSRunLauncher changes when upgrading. Since underlying image is specified on my ECS task def (and controlled via CICD process), I'd expect dagster to use image defined on task def.

How to reproduce?

  • For ECS launchers configured like documentation outlines, attempt kicking off a run.
run_launcher:
  module: "dagster_aws.ecs"
  class: "EcsRunLauncher"
  config:
    task_definition: "arn:aws:ecs:us-east-1:1234567890:task-definition/my-task-definition:1"
    container_name: "my_container_name"

Dagster version

1.9.2

Deployment type

Other Docker-based deployment

Deployment details

  • All dagster resources are deployed to an ECS cluster

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.
By submitting this issue, you agree to follow Dagster's Code of Conduct.

@zyd14
Copy link
Contributor

zyd14 commented Nov 25, 2024

I have a PR to roll back the check I added that is causing the error; but tracing through the code it's unclear to me that this will actually fix the issue. It seems like image is being pulled from the job's repository_origin, and it seems like run_task_kwargs needs image to be non-None . There's a lot of infra to set up to be able to test this, I'm hoping @treilly1 will be able to test my changes with their existing infra if possible

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
None yet
2 participants