Re: [PR] [HUDI-7303] Fix date field type unexpectedly convert to Long when usi… [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10517: URL: https://github.com/apache/hudi/pull/10517#issuecomment-1903414508 ## CI report: * 513d914fa72c497458c834d0b33962996b3d3e03 Azure:

Re: [PR] [HUDI-7303] Fix date field type unexpectedly convert to Long when usi… [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10517: URL: https://github.com/apache/hudi/pull/10517#issuecomment-1903405196 ## CI report: * 513d914fa72c497458c834d0b33962996b3d3e03 Azure:

Re: [PR] [HUDI-7310] Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10528: URL: https://github.com/apache/hudi/pull/10528#issuecomment-1903388167 ## CI report: * 0c268f8c3ff082913d8522edfa1674fa88b19ab6 Azure:

Re: [I] [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem [hudi]

2024-01-21 Thread via GitHub
eric9204 commented on issue #10544: URL: https://github.com/apache/hudi/issues/10544#issuecomment-1903368491 `--hoodie-conf fs.hdfs.impl.disable.cache=true` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem [hudi]

2024-01-21 Thread via GitHub
LIKE-HUB commented on issue #10544: URL: https://github.com/apache/hudi/issues/10544#issuecomment-1903353144 This is my submit command ./bin/flink run -m yarn-cluster -yjm 1024 -ytm 4096 -c org.apache.hudi.sink.compact.HoodieFlinkCompactor lib/hudi-flink1.13-bund-0.14.0.jar --path

Re: [PR] [HUDI-7310] Optimize Column Stats Partition Pruning for Non-Partition Pruning Queries [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10528: URL: https://github.com/apache/hudi/pull/10528#issuecomment-1903345377 ## CI report: * 0c268f8c3ff082913d8522edfa1674fa88b19ab6 Azure:

[I] [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem [hudi]

2024-01-21 Thread via GitHub
LIKE-HUB opened a new issue, #10544: URL: https://github.com/apache/hudi/issues/10544 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?yes - Join the mailing list to engage in conversations and get faster support at

Re: [I] [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem [hudi]

2024-01-21 Thread via GitHub
LIKE-HUB closed issue #10543: [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem URL: https://github.com/apache/hudi/issues/10543 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] [SUPPORT]When I write HUDI with Flink use asynchronous compaction, I use the --service parameter, but I run into a problem [hudi]

2024-01-21 Thread via GitHub
LIKE-HUB commented on issue #10543: URL: https://github.com/apache/hudi/issues/10543#issuecomment-1903339926 > mething went wrong. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[I] [SUPPORT] [hudi]

2024-01-21 Thread via GitHub
LIKE-HUB opened a new issue, #10543: URL: https://github.com/apache/hudi/issues/10543 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at

Re: [PR] [MINOR] change hive/adb tool not auto create database default [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #9640: URL: https://github.com/apache/hudi/pull/9640#issuecomment-1903330240 ## CI report: * cefd96781f2f87b7af3a92e5c6334724f7aeb400 UNKNOWN * 453da96a0389b91f7eefc06f7f2ab30a9147fa15 Azure:

Re: [I] hoodie.bulkinsert.shuffle.parallelism Not activated [hudi]

2024-01-21 Thread via GitHub
KnightChess commented on issue #10418: URL: https://github.com/apache/hudi/issues/10418#issuecomment-1903289437 #10532 fix `hoodie.bulkinsert.shuffle.parallelism` can not work when dedup source. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [MINOR] change hive/adb tool not auto create database default [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #9640: URL: https://github.com/apache/hudi/pull/9640#issuecomment-1903288829 ## CI report: * cefd96781f2f87b7af3a92e5c6334724f7aeb400 UNKNOWN * 453da96a0389b91f7eefc06f7f2ab30a9147fa15 Azure:

(hudi) branch master updated: [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type (#10541)

2024-01-21 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 834cf4a63ce [HUDI-7317] FlinkTableFactory

[jira] [Closed] (HUDI-7317) FlinkTableFactory snatifyCheck should contains index type

2024-01-21 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-7317. Resolution: Fixed Fixed via master branch: 834cf4a63ceb1193025010d3f8f0cc065e23c46d > FlinkTableFactory

Re: [PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
danny0405 merged PR #10541: URL: https://github.com/apache/hudi/pull/10541 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7240] Clean delete logic [hudi]

2024-01-21 Thread via GitHub
danny0405 commented on PR #10398: URL: https://github.com/apache/hudi/pull/10398#issuecomment-1903283157 Thanks for raising this fix, I think it is a good chance we fix the event time sequence comparison of delete records with payloads, I can see 2 mistaks in our code that uses processing

[I] [SUPPORT] Dataloss in FlinkCDC into Hudi without any exception or other infomation [hudi]

2024-01-21 Thread via GitHub
xuzifu666 opened a new issue, #10542: URL: https://github.com/apache/hudi/issues/10542 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at

Re: [PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
xuzifu666 commented on code in PR #10541: URL: https://github.com/apache/hudi/pull/10541#discussion_r1461296888 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -176,13 +177,24 @@ public Set> optionalOptions() { */

Re: [PR] [HUDI-7311] Add literal type auto conversion before filter push down [hudi]

2024-01-21 Thread via GitHub
danny0405 commented on PR #10531: URL: https://github.com/apache/hudi/pull/10531#issuecomment-1902972320 Then fix that commit first. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
danny0405 commented on code in PR #10541: URL: https://github.com/apache/hudi/pull/10541#discussion_r1461295667 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java: ## @@ -176,13 +177,24 @@ public Set> optionalOptions() { */

Re: [PR] [HUDI-7302] Consistent hashing row writer support sorting [hudi]

2024-01-21 Thread via GitHub
boneanxs commented on code in PR #10515: URL: https://github.com/apache/hudi/pull/10515#discussion_r1461279717 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/ConsistentBucketIndexBulkInsertPartitionerWithRows.java: ## @@ -105,10 +121,55 @@

Re: [PR] [HUDI-7311] Add literal type auto conversion before filter push down [hudi]

2024-01-21 Thread via GitHub
paul8263 commented on PR #10531: URL: https://github.com/apache/hudi/pull/10531#issuecomment-1902879944 > Oops, there are test failures:

Re: [PR] [MINOR] Fix flaky testMultiWriterWithAsyncTableServicesWithConflict test [hudi]

2024-01-21 Thread via GitHub
KnightChess commented on code in PR #10526: URL: https://github.com/apache/hudi/pull/10526#discussion_r1460890602 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/TestHoodieClientMultiWriter.java: ## @@ -531,34 +531,35 @@ public void

Re: [PR] [MINOR] change hive/adb tool not auto create database default [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #9640: URL: https://github.com/apache/hudi/pull/9640#issuecomment-1902627401 ## CI report: * cefd96781f2f87b7af3a92e5c6334724f7aeb400 UNKNOWN * 453da96a0389b91f7eefc06f7f2ab30a9147fa15 Azure:

Re: [PR] [MINOR] change hive/adb tool not auto create database default [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #9640: URL: https://github.com/apache/hudi/pull/9640#issuecomment-1902625282 ## CI report: * cefd96781f2f87b7af3a92e5c6334724f7aeb400 UNKNOWN * 453da96a0389b91f7eefc06f7f2ab30a9147fa15 Azure:

Re: [PR] [MINOR] change hive/adb tool not auto create database default [hudi]

2024-01-21 Thread via GitHub
KnightChess commented on PR #9640: URL: https://github.com/apache/hudi/pull/9640#issuecomment-1902624729 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] [SUPPORT] MOR hudi 0.14, Bloom Filters are not being used on query time [hudi]

2024-01-21 Thread via GitHub
KnightChess commented on issue #10511: URL: https://github.com/apache/hudi/issues/10511#issuecomment-1902623887 @bk-mz you can see scan rdd `the number of output rows` in spark sql tag ui. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10541: URL: https://github.com/apache/hudi/pull/10541#issuecomment-1902611975 ## CI report: * 44aabdf9fed879357dcca4e7ce8ff7420f1ce8a4 Azure:

Re: [PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10541: URL: https://github.com/apache/hudi/pull/10541#issuecomment-1902567532 ## CI report: * 44aabdf9fed879357dcca4e7ce8ff7420f1ce8a4 Azure:

Re: [PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
hudi-bot commented on PR #10541: URL: https://github.com/apache/hudi/pull/10541#issuecomment-1902565571 ## CI report: * 44aabdf9fed879357dcca4e7ce8ff7420f1ce8a4 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [HUDI-7317] FlinkTableFactory snatifyCheck should contains index type [hudi]

2024-01-21 Thread via GitHub
xuzifu666 opened a new pull request, #10541: URL: https://github.com/apache/hudi/pull/10541 ### Change Logs FlinkTableFactory snatifyCheck should contains index type ### Impact low ### Risk level (write none, low medium or high below) none ###

[jira] [Updated] (HUDI-7317) FlinkTableFactory snatifyCheck should contains index type

2024-01-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7317: - Labels: pull-request-available (was: ) > FlinkTableFactory snatifyCheck should contains index

[jira] [Created] (HUDI-7317) FlinkTableFactory snatifyCheck should contains index type

2024-01-21 Thread xy (Jira)
xy created HUDI-7317: Summary: FlinkTableFactory snatifyCheck should contains index type Key: HUDI-7317 URL: https://issues.apache.org/jira/browse/HUDI-7317 Project: Apache Hudi Issue Type: Improvement