[GitHub] [hudi] danny0405 commented on pull request #9052: [HUDI-6439] DirectWriteMarkers create file need judge appendfile whether exist
danny0405 commented on PR #9052: URL: https://github.com/apache/hudi/pull/9052#issuecomment-1608659216 > it seems to be the same problem which should be fixed by a previous PR. May wait for further feedback. Thanks so much for the help. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #9052: [HUDI-6439] DirectWriteMarkers create file need judge appendfile whether exist
danny0405 commented on PR #9052: URL: https://github.com/apache/hudi/pull/9052#issuecomment-1607127509 @guanziyue Can you take a look at this PR, the background is when bucket index is used for Spark engine, the exception happens in very high odds, is there any good idea we can strength the usability? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #9052: [HUDI-6439] DirectWriteMarkers create file need judge appendfile whether exist
danny0405 commented on PR #9052: URL: https://github.com/apache/hudi/pull/9052#issuecomment-1607053920 This file path `.0368-4295-486f-bfe1-b30053491f4e-0_20230625172922537.log.1_368-8-12373.marker.APPEND` is deduplicated, and the write token `368-8-12373` is concatenated by `partitionId-stageId-attemptId`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org