rjgoyln commented on PR #71495:
URL: https://github.com/apache/airflow/pull/71495#issuecomment-5284768167
> `ERROR` is the one state where the verbose branch still disagrees with the
`job_complete` waiter that the non-verbose branch uses. The waiter has an
explicit `{"expected": "ERROR", "state": "failure"}` acceptor and the
operator's `JOB_RUN_TERMINAL_STATES` lists it, but this loop classifies only
`FAILED`/`TIMEOUT`/`STOPPED` as failure and `SUCCEEDED` as success, so an
`ERROR` run falls through to "keep polling" and only surfaces after
`waiter_max_attempts` (75 × 60s by default for `GlueJobOperator`, 60 × 120s for
`GlueJobSensor`) as `waiter exceeded max attempts` which reads as a timeout
rather than as a job error.
>
> It is worth to open a pr to a follow-up. Do you want to take it?
Great catch! I'd be happy to take care of it. I will open a follow-up PR to
handle the ERROR state shortly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
