Re: [PR] [MINOR] Azure binary 2024 01 a4 [hudi]

hudi-bot commented on PR #10453: URL: https://github.com/apache/hudi/pull/10453#issuecomment-1879579333 ## CI report: * 96f36f01e66579155cd3d08cfd73b3c0ee3502f1 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a1 [hudi]

hudi-bot commented on PR #10450: URL: https://github.com/apache/hudi/pull/10450#issuecomment-1879579314 ## CI report: * d5a0d881454265fb345668e2dab2f2799cd2d94d Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a2 [hudi]

hudi-bot commented on PR #10451: URL: https://github.com/apache/hudi/pull/10451#issuecomment-1879579322 ## CI report: * 1590c173c45f8d935de1df421151bda8378f6fbb Azure:

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1879569043 ## CI report: * ae3572005431da476574d5cbdf6a324ba93d4725 UNKNOWN * da26f51a6f2f97adba00012a6cd0eb9a1ce99d56 Azure:

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1879560487 ## CI report: * ae3572005431da476574d5cbdf6a324ba93d4725 UNKNOWN * da26f51a6f2f97adba00012a6cd0eb9a1ce99d56 Azure:

Re: [I] [SUPPORT] how to config hudi table TTL in S3? The table_meta can be separated into a directory? [hudi]

stream2000 commented on issue #10316: URL: https://github.com/apache/hudi/issues/10316#issuecomment-1879554776 > so that data cleaning can also use hierarchical storage and different life cycles can you elaborate more detail about this? I working with partition TTL management and hope

Re: [PR] [MINOR] Azure binary 2024 01 a4 [hudi]

hudi-bot commented on PR #10453: URL: https://github.com/apache/hudi/pull/10453#issuecomment-1879553485 ## CI report: * 5f2abd6ff0bcab82780de3177c8f88ea5193c6e8 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a3 [hudi]

hudi-bot commented on PR #10452: URL: https://github.com/apache/hudi/pull/10452#issuecomment-1879553457 ## CI report: * 28ba1725ec640740b682e8718ecd7ae632e3ca96 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a2 [hudi]

hudi-bot commented on PR #10451: URL: https://github.com/apache/hudi/pull/10451#issuecomment-1879553448 ## CI report: * dc006dfbb5547379a96d86edc7439be9ae8b2356 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a4 [hudi]

hudi-bot commented on PR #10453: URL: https://github.com/apache/hudi/pull/10453#issuecomment-1879540194 ## CI report: * 5f2abd6ff0bcab82780de3177c8f88ea5193c6e8 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a3 [hudi]

hudi-bot commented on PR #10452: URL: https://github.com/apache/hudi/pull/10452#issuecomment-1879540089 ## CI report: * 28ba1725ec640740b682e8718ecd7ae632e3ca96 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a2 [hudi]

hudi-bot commented on PR #10451: URL: https://github.com/apache/hudi/pull/10451#issuecomment-1879539947 ## CI report: * dc006dfbb5547379a96d86edc7439be9ae8b2356 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a1 [hudi]

hudi-bot commented on PR #10450: URL: https://github.com/apache/hudi/pull/10450#issuecomment-1879539848 ## CI report: * e89f67d7713a2ec1522e4a349fb9420eb6840108 Azure:

Re: [PR] [MINOR] do not merge, test with just the slow tests removed [hudi]

hudi-bot commented on PR #10454: URL: https://github.com/apache/hudi/pull/10454#issuecomment-1879531800 ## CI report: * 1652d1f7ffcf2175a7f6aec13522114c4bb7b70e Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a1 [hudi]

hudi-bot commented on PR #10450: URL: https://github.com/apache/hudi/pull/10450#issuecomment-1879531781 ## CI report: * e89f67d7713a2ec1522e4a349fb9420eb6840108 Azure:

Re: [PR] [MINOR] do not merge, test with just the slow tests removed [hudi]

hudi-bot commented on PR #10454: URL: https://github.com/apache/hudi/pull/10454#issuecomment-1879503519 ## CI report: * 1652d1f7ffcf2175a7f6aec13522114c4bb7b70e Azure:

Re: [PR] [MINOR] do not merge, test with just the slow tests removed [hudi]

hudi-bot commented on PR #10454: URL: https://github.com/apache/hudi/pull/10454#issuecomment-1879501334 ## CI report: * 1652d1f7ffcf2175a7f6aec13522114c4bb7b70e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR] Azure binary 2024 01 a4 [hudi]

hudi-bot commented on PR #10453: URL: https://github.com/apache/hudi/pull/10453#issuecomment-1879498712 ## CI report: * 5f2abd6ff0bcab82780de3177c8f88ea5193c6e8 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a3 [hudi]

hudi-bot commented on PR #10452: URL: https://github.com/apache/hudi/pull/10452#issuecomment-1879498702 ## CI report: * 28ba1725ec640740b682e8718ecd7ae632e3ca96 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a2 [hudi]

hudi-bot commented on PR #10451: URL: https://github.com/apache/hudi/pull/10451#issuecomment-1879498694 ## CI report: * dc006dfbb5547379a96d86edc7439be9ae8b2356 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a1 [hudi]

hudi-bot commented on PR #10450: URL: https://github.com/apache/hudi/pull/10450#issuecomment-1879498679 ## CI report: * e89f67d7713a2ec1522e4a349fb9420eb6840108 Azure:

[PR] [MINOR] do not merge, test with just the slow tests removed [hudi]

jonvex opened a new pull request, #10454: URL: https://github.com/apache/hudi/pull/10454 ### Change Logs test ### Impact test ### Risk level (write none, low medium or high below) none ### Documentation Update N/A ### Contributor's

Re: [PR] [MINOR] Azure binary 2024 01 a3 [hudi]

hudi-bot commented on PR #10452: URL: https://github.com/apache/hudi/pull/10452#issuecomment-1879453341 ## CI report: * 28ba1725ec640740b682e8718ecd7ae632e3ca96 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a4 [hudi]

hudi-bot commented on PR #10453: URL: https://github.com/apache/hudi/pull/10453#issuecomment-1879453354 ## CI report: * 5f2abd6ff0bcab82780de3177c8f88ea5193c6e8 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a2 [hudi]

hudi-bot commented on PR #10451: URL: https://github.com/apache/hudi/pull/10451#issuecomment-1879453317 ## CI report: * dc006dfbb5547379a96d86edc7439be9ae8b2356 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a1 [hudi]

hudi-bot commented on PR #10450: URL: https://github.com/apache/hudi/pull/10450#issuecomment-1879453294 ## CI report: * e89f67d7713a2ec1522e4a349fb9420eb6840108 Azure:

Re: [PR] [MINOR] Azure binary 2024 01 a4 [hudi]

hudi-bot commented on PR #10453: URL: https://github.com/apache/hudi/pull/10453#issuecomment-1879449230 ## CI report: * 5f2abd6ff0bcab82780de3177c8f88ea5193c6e8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR] Azure binary 2024 01 a3 [hudi]

hudi-bot commented on PR #10452: URL: https://github.com/apache/hudi/pull/10452#issuecomment-1879449203 ## CI report: * 28ba1725ec640740b682e8718ecd7ae632e3ca96 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR] Azure binary 2024 01 a2 [hudi]

hudi-bot commented on PR #10451: URL: https://github.com/apache/hudi/pull/10451#issuecomment-1879449177 ## CI report: * dc006dfbb5547379a96d86edc7439be9ae8b2356 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR] Azure binary 2024 01 a1 [hudi]

hudi-bot commented on PR #10450: URL: https://github.com/apache/hudi/pull/10450#issuecomment-1879449149 ## CI report: * e89f67d7713a2ec1522e4a349fb9420eb6840108 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [MINOR] Azure binary 2024 01 a4 [hudi]

jonvex opened a new pull request, #10453: URL: https://github.com/apache/hudi/pull/10453 ### Change Logs test ### Impact test ### Risk level (write none, low medium or high below) none ### Documentation Update N/A ### Contributor's

Re: [PR] [MINOR] Disable org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC [hudi]

hudi-bot commented on PR #10449: URL: https://github.com/apache/hudi/pull/10449#issuecomment-1879435075 ## CI report: * 8c34c357854d24d701de5316fc65480fb852bc7b Azure:

[PR] [MINOR] Azure binary 2024 01 a3 [hudi]

jonvex opened a new pull request, #10452: URL: https://github.com/apache/hudi/pull/10452 ### Change Logs test ### Impact test ### Risk level (write none, low medium or high below) none ### Documentation Update N/A ### Contributor's

[PR] [MINOR] Azure binary 2024 01 a2 [hudi]

jonvex opened a new pull request, #10451: URL: https://github.com/apache/hudi/pull/10451 ### Change Logs test ### Impact test ### Risk level (write none, low medium or high below) none ### Documentation Update N/A ### Contributor's

[PR] [MINOR] Azure binary 2024 01 a1 [hudi]

jonvex opened a new pull request, #10450: URL: https://github.com/apache/hudi/pull/10450 ### Change Logs test ### Impact test ### Risk level (write none, low medium or high below) none ### Documentation Update N/A ### Contributor's

Re: [PR] [HUDI-5903]: Introduce Glue sync configs [hudi]

bvaradar commented on code in PR #8208: URL: https://github.com/apache/hudi/pull/8208#discussion_r1443523085 ## hudi-aws/src/main/java/org/apache/hudi/config/GlueSyncConfig.java: ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or more

Re: [PR] [MINOR] Disable org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC [hudi]

hudi-bot commented on PR #10449: URL: https://github.com/apache/hudi/pull/10449#issuecomment-1879277248 ## CI report: * 8c34c357854d24d701de5316fc65480fb852bc7b Azure:

Re: [PR] [MINOR] Disable org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC [hudi]

hudi-bot commented on PR #10449: URL: https://github.com/apache/hudi/pull/10449#issuecomment-1879270007 ## CI report: * 8c34c357854d24d701de5316fc65480fb852bc7b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[PR] [MINOR] Disable org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC [hudi]

jonvex opened a new pull request, #10449: URL: https://github.com/apache/hudi/pull/10449 ### Change Logs This test was causing following tests to get stuck. Something to do with the lock provider maybe. After investigating for a couple hours I wasn't able to discover anything.

[jira] [Created] (HUDI-7275) org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC causes issues with following tests

Jonathan Vexler created HUDI-7275: - Summary: org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC causes issues with following tests Key: HUDI-7275 URL:

Re: [I] [SUPPORT] Clean action failure triggers an exception while trying to check whether metadata is a table [hudi]

shubhamn21 commented on issue #10127: URL: https://github.com/apache/hudi/issues/10127#issuecomment-1879131474 Thank you! Closing this issue - I'll set up hive metastore to avoid these issues. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] [SUPPORT] Clean action failure triggers an exception while trying to check whether metadata is a table [hudi]

shubhamn21 closed issue #10127: [SUPPORT] Clean action failure triggers an exception while trying to check whether metadata is a table URL: https://github.com/apache/hudi/issues/10127 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Created] (HUDI-7274) AnalysisException thrown when executing SQL time travel query using TIMESTAMP AS OF

Jesús Camacho Rodríguez created HUDI-7274: - Summary: AnalysisException thrown when executing SQL time travel query using TIMESTAMP AS OF Key: HUDI-7274 URL: https://issues.apache.org/jira/browse/HUDI-7274

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

hudi-bot commented on PR #10191: URL: https://github.com/apache/hudi/pull/10191#issuecomment-1878999084 ## CI report: * db7a22bac00d2670c5103ca28434fb9a2e1d1256 Azure:

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

hudi-bot commented on PR #10191: URL: https://github.com/apache/hudi/pull/10191#issuecomment-1878762919 ## CI report: * 6f3cd06ffdd5f8df8e12120b7f4685b2294d1f7f Azure:

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

hudi-bot commented on PR #10191: URL: https://github.com/apache/hudi/pull/10191#issuecomment-1878752192 ## CI report: * 6f3cd06ffdd5f8df8e12120b7f4685b2294d1f7f Azure:

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

KnightChess commented on PR #10191: URL: https://github.com/apache/hudi/pull/10191#issuecomment-1878727118 @voonhous hi, I have made some modifications according to your suggestions @danny0405 I have support multiple hash fields according to your advice. If you have other questions or

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

KnightChess commented on code in PR #10191: URL: https://github.com/apache/hudi/pull/10191#discussion_r1442914368 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BucketIndexSupport.scala: ## @@ -0,0 +1,193 @@ +/* + * Licensed to the Apache Software

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

KnightChess commented on code in PR #10191: URL: https://github.com/apache/hudi/pull/10191#discussion_r1442911322 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestBucketIndexQuery.scala: ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apache Software

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1878569717 ## CI report: * ae3572005431da476574d5cbdf6a324ba93d4725 UNKNOWN * da26f51a6f2f97adba00012a6cd0eb9a1ce99d56 Azure:

Re: [I] [SUPPORT] INSERT_OVERWRITE_TABLE on subsequent runs fails with a metadata file not found error (v0.14.0) [hudi]

ad1happy2go commented on issue #10445: URL: https://github.com/apache/hudi/issues/10445#issuecomment-1878559399 Thanks for raising this @howardcho . Record Index is not working with INSERT_OVERWRITE_TABLE. It is working with col stats index and bloom. Below is the minimal reproducible code

[jira] [Created] (HUDI-7273) Record Index is not working with iNSERT_OVERWRITE_TABLE

Aditya Goenka created HUDI-7273: --- Summary: Record Index is not working with iNSERT_OVERWRITE_TABLE Key: HUDI-7273 URL: https://issues.apache.org/jira/browse/HUDI-7273 Project: Apache Hudi

Re: [I] hoodie.bulkinsert.shuffle.parallelism Not activated [hudi]

KnightChess commented on issue #10418: URL: https://github.com/apache/hudi/issues/10418#issuecomment-1878465493 @zhangjw123321 you can try set it in spark submit, --conf, or by code sparkconf.set('xxx','yyy'), will match other branch, not use parent rdd size

Re: [I] hoodie.bulkinsert.shuffle.parallelism Not activated [hudi]

zhangjw123321 commented on issue #10418: URL: https://github.com/apache/hudi/issues/10418#issuecomment-1878422256 > @zhangjw123321 I test in my local, `spark.default.parallelism` look like can not effect in sql set, can you set when submit spark job, like --conf. before try it, how much

Re: [PR] [HUDI-7266] add clustering metric for flink [hudi]

hudi-bot commented on PR #10420: URL: https://github.com/apache/hudi/pull/10420#issuecomment-1878421799 ## CI report: * 4bbd4f7e21ae5f1b8b9484e0da9edeb4c0fe69ef Azure:

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1878420511 ## CI report: * 3bdc9bbe380b07cb8e55656714570405cb78 Azure:

Re: [I] hoodie.bulkinsert.shuffle.parallelism Not activated [hudi]

KnightChess commented on issue #10418: URL: https://github.com/apache/hudi/issues/10418#issuecomment-1878402401 @zhangjw123321 I test in my local, `spark.default.parallelism` look like can not effect in sql set, can you set when submit spark job, like --conf. before try it, how much cores

Re: [I] [SUPPORT] [OCC] HoodieException: Error getting all file groups in pending clustering [hudi]

subash-metica commented on issue #7057: URL: https://github.com/apache/hudi/issues/7057#issuecomment-1878374530 Hi, I am facing the issue again, the problem is happening for random instances and no common pattern I could see. Hudi version: 0.13.1 The error stack trace,

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1878365424 ## CI report: * 3bdc9bbe380b07cb8e55656714570405cb78 Azure:

Re: [PR] [HUDI-6194] prevent flink writer getting the wrong instant to write [hudi]

voonhous commented on PR #8673: URL: https://github.com/apache/hudi/pull/8673#issuecomment-1878361789 Adding some illustration for future reference: # Normal Flow  As can be seen

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1878356019 ## CI report: * 3bdc9bbe380b07cb8e55656714570405cb78 Azure:

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

hudi-bot commented on PR #10191: URL: https://github.com/apache/hudi/pull/10191#issuecomment-1878345737 ## CI report: * 6f3cd06ffdd5f8df8e12120b7f4685b2294d1f7f Azure:

Re: [PR] [HUDI-6207] spark support bucket index query for table with bucket index [hudi]

KnightChess closed pull request #10191: [HUDI-6207] spark support bucket index query for table with bucket index URL: https://github.com/apache/hudi/pull/10191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] hoodie.bulkinsert.shuffle.parallelism Not activated [hudi]

zhangjw123321 commented on issue #10418: URL: https://github.com/apache/hudi/issues/10418#issuecomment-1878335425 

Re: [PR] [HUDI-6194] prevent flink writer getting the wrong instant to write [hudi]

zhangyue19921010 commented on code in PR #8673: URL: https://github.com/apache/hudi/pull/8673#discussion_r1442531234 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java: ## @@ -423,25 +431,41 @@ private void

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1878296567 ## CI report: * 3bdc9bbe380b07cb8e55656714570405cb78 Azure:

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1878287788 ## CI report: * 3bdc9bbe380b07cb8e55656714570405cb78 Azure: