Re: [PR] [Minor] Fix the flaky tests in TestRemoteHoodieTableFileSystemView [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10179: URL: https://github.com/apache/hudi/pull/10179#issuecomment-1827271846 ## CI report: * d75287dd478b46eb7ed67d22bf435178ec59c447 Azure:

Re: [PR] [HUDI-7142] Support Custom partitioner in append mode [hudi]

2023-11-26 Thread via GitHub
xuzifu666 commented on code in PR #10180: URL: https://github.com/apache/hudi/pull/10180#discussion_r1405687916 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java: ## @@ -213,12 +215,31 @@ public static DataStream append(

Re: [PR] [HUDI-7142] Support Custom partitioner in append mode [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10180: URL: https://github.com/apache/hudi/pull/10180#issuecomment-1827213780 ## CI report: * 611e7943aac119e852c6a7bed530e2ea76e9dd6d Azure:

Re: [PR] [HUDI-7142] Support Custom partitioner in append mode [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10180: URL: https://github.com/apache/hudi/pull/10180#issuecomment-1827207369 ## CI report: * 611e7943aac119e852c6a7bed530e2ea76e9dd6d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Commented] (HUDI-7131) The requested schema is not compatible with the file schema

2023-11-26 Thread loukey_j (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789922#comment-17789922 ] loukey_j commented on HUDI-7131: [~xushiyan] please take a look > The requested schema is not compatible

[jira] [Updated] (HUDI-7142) Support Custom partitioner in append mode

2023-11-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7142: - Labels: pull-request-available (was: ) > Support Custom partitioner in append mode >

[PR] [HUDI-7142] Support Custom partitioner in append mode [hudi]

2023-11-26 Thread via GitHub
zhangyue19921010 opened a new pull request, #10180: URL: https://github.com/apache/hudi/pull/10180 ### Change Logs Support Custom partitioner in append mode. For example default `DefaultInsertPartitioner` can be use to re-balance input records aiming to reduce small files.

[jira] [Created] (HUDI-7142) Support Custom partitioner in append mode

2023-11-26 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-7142: --- Summary: Support Custom partitioner in append mode Key: HUDI-7142 URL: https://issues.apache.org/jira/browse/HUDI-7142 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-7141) Timeline server for Hudi when off VPN

2023-11-26 Thread Ron Gonzalez (Jira)
Ron Gonzalez created HUDI-7141: -- Summary: Timeline server for Hudi when off VPN Key: HUDI-7141 URL: https://issues.apache.org/jira/browse/HUDI-7141 Project: Apache Hudi Issue Type: Bug

Re: [PR] [Minor] Fix the flaky tests in TestRemoteHoodieTableFileSystemView [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10179: URL: https://github.com/apache/hudi/pull/10179#issuecomment-1827112467 ## CI report: * d75287dd478b46eb7ed67d22bf435178ec59c447 Azure:

Re: [PR] [Minor] Fix the flaky tests in TestRemoteHoodieTableFileSystemView [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10179: URL: https://github.com/apache/hudi/pull/10179#issuecomment-1827107855 ## CI report: * d75287dd478b46eb7ed67d22bf435178ec59c447 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7110][FOLLOW-UP] Improve call procedure for show column stats information [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10169: URL: https://github.com/apache/hudi/pull/10169#issuecomment-1827107801 ## CI report: * 8b7cb9417e26e96ca908e298a614587d60d32620 Azure:

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-11-26 Thread via GitHub
danny0405 commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1405592067 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,209 @@ +## Proposers + +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao + +## Approvers + +## Status + +JIRA:

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-11-26 Thread via GitHub
danny0405 commented on code in PR #8062: URL: https://github.com/apache/hudi/pull/8062#discussion_r1405590162 ## rfc/rfc-65/rfc-65.md: ## @@ -0,0 +1,110 @@ +## Proposers +- @stream2000 +- @hujincalrin +- @huberylee +- @YuweiXiao +## Approvers +## Status +JIRA:

[PR] [Minor] Fix the flaky tests in TestRemoteHoodieTableFileSystemView [hudi]

2023-11-26 Thread via GitHub
danny0405 opened a new pull request, #10179: URL: https://github.com/apache/hudi/pull/10179 ### Change Logs Fix the flakyness. ### Impact none ### Risk level (write none, low medium or high below) none ### Documentation Update _Describe any

Re: [PR] [HUDI-7110][FOLLOW-UP] Improve call procedure for show column stats information [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10169: URL: https://github.com/apache/hudi/pull/10169#issuecomment-1827009928 ## CI report: * cf2dfbb98288f66c715312a5d2becf37b550838f Azure:

Re: [PR] [MINOR] Schema Converter should use default identity transform if not specified [hudi]

2023-11-26 Thread via GitHub
the-other-tim-brown commented on PR #10178: URL: https://github.com/apache/hudi/pull/10178#issuecomment-1827009405 Discovered in this thread in slack https://apache-hudi.slack.com/archives/C4D716NPQ/p1700923981962149 -- This is an automated message from the Apache Git Service. To respond

Re: [PR] [HUDI-7110][FOLLOW-UP] Improve call procedure for show column stats information [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10169: URL: https://github.com/apache/hudi/pull/10169#issuecomment-1827004296 ## CI report: * cf2dfbb98288f66c715312a5d2becf37b550838f Azure:

Re: [I] [SUPPORT]hudi upsert data Caused by: org.apache.hadoop.fs.PathIsNotEmptyDirectoryException [hudi]

2023-11-26 Thread via GitHub
blackcheckren commented on issue #9029: URL: https://github.com/apache/hudi/issues/9029#issuecomment-1827003764 I also encountered this problem, but the corresponding directory on S3 could not be deleted after dozens of manual attempts, and the log showed that a folder with the same name

Re: [PR] [MINOR] Schema Converter should use default identity transform if not specified [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10178: URL: https://github.com/apache/hudi/pull/10178#issuecomment-1826890322 ## CI report: * f79a2ac67bb608f59391f2c1203314d737ddc074 Azure:

Re: [PR] [MINOR] Schema Converter should use default identity transform if not specified [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10178: URL: https://github.com/apache/hudi/pull/10178#issuecomment-1826845570 ## CI report: * f79a2ac67bb608f59391f2c1203314d737ddc074 Azure:

Re: [PR] [MINOR] Schema Converter should use default identity transform if not specified [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10178: URL: https://github.com/apache/hudi/pull/10178#issuecomment-1826844194 ## CI report: * f79a2ac67bb608f59391f2c1203314d737ddc074 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [MINOR] Schema Converter should use default identity transform if not specified [hudi]

2023-11-26 Thread via GitHub
the-other-tim-brown opened a new pull request, #10178: URL: https://github.com/apache/hudi/pull/10178 ### Change Logs Use the default value of `""` when there is no property set for the schema converter ### Impact Makes configuration easier for users trying to use

Re: [I] [SUPPORT] Seeking Assistance with Delta Streamer and Schema Registry Integration [hudi]

2023-11-26 Thread via GitHub
soumilshah1995 closed issue #10177: [SUPPORT] Seeking Assistance with Delta Streamer and Schema Registry Integration URL: https://github.com/apache/hudi/issues/10177 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] [SUPPORT] Seeking Assistance with Delta Streamer and Schema Registry Integration [hudi]

2023-11-26 Thread via GitHub
soumilshah1995 commented on issue #10177: URL: https://github.com/apache/hudi/issues/10177#issuecomment-1826811495 issue resolved :D had to change --hoodie-conf hoodie.deltastreamer.source.kafka.value.deserializer.class=io.confluent.kafka.serializers.KafkaAvroDeserializer \

[I] [SUPPORT] Seeking Assistance with Delta Streamer and Schema Registry Integration [hudi]

2023-11-26 Thread via GitHub
soumilshah1995 opened a new issue, #10177: URL: https://github.com/apache/hudi/issues/10177 Dear Community, I hope this message finds you well. I am currently facing an issue with the Delta Streamer, particularly around the schema registry. The error message I'm encountering is:

Re: [PR] [HUDI-7140] [DNM] Trial Patch to test CI run [hudi]

2023-11-26 Thread via GitHub
hudi-bot commented on PR #10176: URL: https://github.com/apache/hudi/pull/10176#issuecomment-1826721993 ## CI report: * bce8f8d3cc8d2dc90b3dcf7d0ecd1dca7efc1346 Azure:

Re: [PR] [HUDI-5823]Poc code for Partition ttl management [hudi]

2023-11-26 Thread via GitHub
zyclove commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1826720079 Will version 1.0 support this feature? This feature is greatly needed. @stream2000 Thanks. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [HUDI-5823][RFC-65] RFC for Partition Lifecycle Management [hudi]

2023-11-26 Thread via GitHub
zyclove commented on PR #8062: URL: https://github.com/apache/hudi/pull/8062#issuecomment-1826719670 Will version 1.0 support this feature? This feature is greatly needed. @danny0405 @stream2000 -- This is an automated message from the Apache Git Service. To respond to the message,