dejii commented on code in PR #54101:
URL: https://github.com/apache/airflow/pull/54101#discussion_r2288019881
##########
providers/google/src/airflow/providers/google/cloud/triggers/cloud_storage_transfer_service.py:
##########
@@ -87,13 +88,9 @@ async def run(self) -> AsyncIterator[TriggerEvent]:
for job, operation in zip(jobs, operations):
if operation is None:
- yield TriggerEvent(
- {
- "status": "error",
- "message": f"Transfer job {job.name} has no
latest operation.",
- }
- )
- return
+ self.log.info("Transfer job %s has no latest operation
yet, waiting.", job.name)
+ all_operations_found = False
+ continue
Review Comment:
Hi :)
Yes, but I think for transfers the timeout should be explicitly specified by
the user, since transfer times can vary significantly depending on the size and
number of objects.
Just to clarify, the main goal of this PR is to fix a bug where the
`CloudStorageTransferServiceCreateJobsTrigger` isn’t able to poll because the
operation hasn’t started.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
