luffyd commented on issue #1872: URL: https://github.com/apache/hudi/issues/1872#issuecomment-663690493
I have noticed slowing down ingestion worked. It seems like number of calls to "HoodieWriteHandle.createMarkerFile" is resulting an S3 call. But can you give any hints on 1. how number calls to "HoodieWriteHandle.createMarkerFile" is related to number of partitions 2. how number calls to "HoodieWriteHandle.createMarkerFile" is related to number of files in a partition ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
