satishkotha commented on issue #1872:
URL: https://github.com/apache/hudi/issues/1872#issuecomment-665278060
@luffyd were you able to figure out a workaround? If not, consider opening a
jira. We think adding jitter and retries when hudi calls S3 may help. (feel
free to open Pull request)
satishkotha commented on issue #1872:
URL: https://github.com/apache/hudi/issues/1872#issuecomment-663788217
Hi,
Number of 'createMarkerFile' calls = (number of partitions) + (number of
file groups) *touched* by upsert operation.
What is the partition for your workload? What
satishkotha commented on issue #1872:
URL: https://github.com/apache/hudi/issues/1872#issuecomment-663688088
This is likely more of AWS support question. A quick search shows
https://aws.amazon.com/premiumsupport/knowledge-center/emr-s3-503-slow-down/
Can you see if any of the solut
