ahmedabu98 commented on issue #32746: URL: https://github.com/apache/beam/issues/32746#issuecomment-2407472167
The high latency warnings can be a little noisy -- they were added in in `2.2.16` ([ref](https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/2ffc8e6cbf99e31c0d9ee14bacd5564ef1b08b06/gcs/src/main/java/com/google/cloud/hadoop/fs/gcs/GhfsStorageStatistics.java#L121)) > Also, the request count on GCS is quite high compared to 20RPS on Pubsub. Agreed that's weird for just 20 rows/sec. Is this a project-based metric? Are you sure nothing else is writing to GCS at the same time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
