[GitHub] [hudi] danny0405 commented on pull request #9052: [HUDI-6439] DirectWriteMarkers create file need judge appendfile whether exist

2023-06-26 Thread via GitHub


danny0405 commented on PR #9052:
URL: https://github.com/apache/hudi/pull/9052#issuecomment-1608659216

   > it seems to be the same problem which should be fixed by a previous PR. 
May wait for further feedback.
   
   Thanks so much for the help.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [hudi] danny0405 commented on pull request #9052: [HUDI-6439] DirectWriteMarkers create file need judge appendfile whether exist

2023-06-26 Thread via GitHub


danny0405 commented on PR #9052:
URL: https://github.com/apache/hudi/pull/9052#issuecomment-1607127509

   @guanziyue Can you take a look at this PR, the background is when bucket 
index is used for Spark engine, the exception happens in very high odds, is 
there any good idea we can strength the usability?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [hudi] danny0405 commented on pull request #9052: [HUDI-6439] DirectWriteMarkers create file need judge appendfile whether exist

2023-06-26 Thread via GitHub


danny0405 commented on PR #9052:
URL: https://github.com/apache/hudi/pull/9052#issuecomment-1607053920

   This file path 
`.0368-4295-486f-bfe1-b30053491f4e-0_20230625172922537.log.1_368-8-12373.marker.APPEND`
 is deduplicated, and the write token `368-8-12373` is concatenated by 
`partitionId-stageId-attemptId`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org