Skip to content

GlueJobOperator in verbose mode do not pull logs correctly #56535

Description

@adamgorkaextbi

Apache Airflow Provider(s)

amazon

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==9.10.0 up to newest at current time 9.15.0

Apache Airflow version

2.11.0

Operating System

Debian GNU/Linux 12

Deployment

Official Apache Airflow Helm Chart

Deployment details

official helm chart

What happened

GlueJobOperator in dereferable mode, wait_for_completion=true, verbose=true mode is not pulling logs
newly introduced
waiter_with_logging is not working correctly
[2025-10-09, 22:25:23 UTC] {waiter_with_logging.py:158} INFO - Status of AWS Glue job is: RUNNING

What you think should happen instead

I should see glue logs in airflow UI i task details log section

How to reproduce

run GlueJobOperator in dereferable mode,
wait_for_completion=true, verbose=true

Anything else

all the time

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions