pranavbhandari24 opened a new issue, #22078:
URL: https://github.com/apache/beam/issues/22078

   ### What happened?
   
   GcsUtil does not propagate error messages. This leads to vague error logs in 
dataflow which makes them hard to debug.  
   
   In 
[GcsUtil#bucketAccessible](https://github.com/apache/beam/blob/928da54e1a95219bfbfa420fbf9c8fb5514fd683/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/GcsUtil.java#L627),
 if the bucket is not accessible because of permissions or if the bucket does 
not exist, the error is swallowed. 
   For example, in 
[GcsPathValidator#verifyPathIsAccessible](https://github.com/apache/beam/blob/928da54e1a95219bfbfa420fbf9c8fb5514fd683/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/storage/GcsPathValidator.java#L80),
 if the bucket is not accessible due to permission issues the error message 
thrown is `Output path does not exist or is not writeable` or `Could not find 
file`. 
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: extensions-java-gcp


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to