potiuk commented on issue #36963: URL: https://github.com/apache/airflow/issues/36963#issuecomment-1985648227
> If cloud logging streamed the logs directly into the airflow gcs logs path, would that be a pathway to seeing the logs in airflow? No. GCS is object storage. It's not a streaming solution. It means that you have an OBJECT to pull, not a file to stream. Once you create an object in GCS it's immutable. You can replace it with new object but you cannot append to it. This is absolutely impossible to stream something to object in GCS because the object does not exist until you finished sending the last byte for it - you cannot read from the object unless it exists. This is a very basic feature of GCS in case you were not aware of. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
