Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-09 Thread via GitHub
nsivabalan closed pull request #10909: [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce URL: https://github.com/apache/hudi/pull/10909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2092181639 ## CI report: * 78efc7ca1cc033e445086b925cae48204d214871 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2092056966 ## CI report: * b5ebcf8de8abc367918e5ab570be4bcd52b33208 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-05-02 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2092052645 ## CI report: * b5ebcf8de8abc367918e5ab570be4bcd52b33208 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-25 Thread via GitHub
yihua commented on code in PR #10909: URL: https://github.com/apache/hudi/pull/10909#discussion_r1537958935 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/RowCustomColumnsSortPartitioner.java: ## @@ -51,7 +51,7 @@ public

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2014766403 ## CI report: * b5ebcf8de8abc367918e5ab570be4bcd52b33208 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2014693276 ## CI report: * 5f6135593aab6329b060ea1ee30388eb22c0dc97 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2014679290 ## CI report: * 5f6135593aab6329b060ea1ee30388eb22c0dc97 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2014572622 ## CI report: * 5f6135593aab6329b060ea1ee30388eb22c0dc97 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2014505672 ## CI report: * 5f6135593aab6329b060ea1ee30388eb22c0dc97 Azure:

Re: [PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
hudi-bot commented on PR #10909: URL: https://github.com/apache/hudi/pull/10909#issuecomment-2014497841 ## CI report: * 5f6135593aab6329b060ea1ee30388eb22c0dc97 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [HUDI-7528] Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce [hudi]

2024-03-22 Thread via GitHub
nsivabalan opened a new pull request, #10909: URL: https://github.com/apache/hudi/pull/10909 ### Change Logs Fixing RowCustomColumnsSortPartitioner to use repartition instead of coalesce. w/ coalesce, chances that user defined shuffle parallelism may not be honored. ###