[jira] [Comment Edited] (HUDI-6126) Fix test testInsertDatasetWIthTimelineTimezoneUTC to not block CI

2024-02-22 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819946#comment-17819946 ] Geser Dugarov edited comment on HUDI-6126 at 2/23/24 7:19 AM: -- Possibly, the

[jira] [Commented] (HUDI-6126) Fix test testInsertDatasetWIthTimelineTimezoneUTC to not block CI

2024-02-22 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819946#comment-17819946 ] Geser Dugarov commented on HUDI-6126: - Possibly, the bug is similar to [#HUDI-7275], which is fixed by

Re: [PR] [HUDI-7275] Separate use of HoodieTimelineTimeZone.UTC and LOCAL in tests to prevent infinite loops [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10738: URL: https://github.com/apache/hudi/pull/10738#issuecomment-1960801853 ## CI report: * 18435cdea361b920b8ff01e4ded0143d94c6d6f5 Azure:

Re: [PR] [MINOR][TESTING] Test PR [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10737: URL: https://github.com/apache/hudi/pull/10737#issuecomment-1960801832 ## CI report: * 0f4271e8c543fd2cda736a2af5c9356533c48cba Azure:

Re: [PR] [HUDI-7275] Separate use of HoodieTimelineTimeZone.UTC and LOCAL in tests to prevent infinite loops [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10738: URL: https://github.com/apache/hudi/pull/10738#issuecomment-1960795993 ## CI report: * 18435cdea361b920b8ff01e4ded0143d94c6d6f5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [MINOR][TESTING] Test PR [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10737: URL: https://github.com/apache/hudi/pull/10737#issuecomment-1960795966 ## CI report: * 0f4271e8c543fd2cda736a2af5c9356533c48cba UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

[jira] [Updated] (HUDI-7275) org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC causes issues with following tests

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7275: - Labels: pull-request-available (was: ) >

[PR] [HUDI-7275] Separate use of HoodieTimelineTimeZone.UTC and LOCAL in tests to prevent infinite loops [hudi]

2024-02-22 Thread via GitHub
geserdugarov opened a new pull request, #10738: URL: https://github.com/apache/hudi/pull/10738 ### Change Logs Fixed disabled TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC by moving it in a separate class. The problem is in the value of static

Re: [PR] [MINOR][TESTING] Test PR [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10737: URL: https://github.com/apache/hudi/pull/10737#issuecomment-1960763757 new comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] [MINOR][TESTING] Test PR [hudi]

2024-02-22 Thread via GitHub
yihua opened a new pull request, #10737: URL: https://github.com/apache/hudi/pull/10737 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

(hudi) branch master updated: [HUDI-7438] Add GitHub action to check Azure CI report (#10731)

2024-02-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 6f74c7f6ec6 [HUDI-7438] Add GitHub action to check

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua merged PR #10731: URL: https://github.com/apache/hudi/pull/10731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960761910 Merging this one as the PR only touches GitHub workflows of the repo. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10736: URL: https://github.com/apache/hudi/pull/10736#issuecomment-1960756910 ## CI report: * 6c41fe5e29de60a4d33701ebfd4aefc898cc605f Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960756877 ## CI report: * 163e0c63a0ca481fd49164c4a081a8bba23bfe96 Azure:

Re: [PR] [HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10736: URL: https://github.com/apache/hudi/pull/10736#issuecomment-1960752243 ## CI report: * 6c41fe5e29de60a4d33701ebfd4aefc898cc605f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960752213 ## CI report: * 163e0c63a0ca481fd49164c4a081a8bba23bfe96 Azure:

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1960751397 ## CI report: * ae3572005431da476574d5cbdf6a324ba93d4725 UNKNOWN * 8712b4dd774255ccf17d9d7c8c354892d1caa677 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960751296 Based on [GitHub docs](https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#issue_comment), `issue_comment` event will only trigger a workflow run if the

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960747179 ## CI report: * 163e0c63a0ca481fd49164c4a081a8bba23bfe96 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960734948 test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960733949 new comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960731692 test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] [HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data [hudi]

2024-02-22 Thread via GitHub
vinishjail97 opened a new pull request, #10736: URL: https://github.com/apache/hudi/pull/10736 ### Change Logs There were test failures in the original PR and had to be reverted, bringing back the change and fixed the tests now. https://github.com/apache/hudi/pull/10687

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960722912 new comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960722280 New comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960721085 ## CI report: * 163e0c63a0ca481fd49164c4a081a8bba23bfe96 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960717157 ## CI report: * 163e0c63a0ca481fd49164c4a081a8bba23bfe96 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960715461 New comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500197876 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI Review Comment: Apache license added. -- This is an automated message from the Apache

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960701278 New comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500189855 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI + +on: + pull_request: +types: [ opened, reopened, synchronize, edited ] +

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500188782 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI + +on: + pull_request: +types: [ opened, reopened, synchronize, edited ] +

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1960688398 ## CI report: * ae3572005431da476574d5cbdf6a324ba93d4725 UNKNOWN * 67ee450c21d566e068ef08696bc3a70a9dc1691d Azure:

Re: [PR] [HUDI-5823] Partition ttl management [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #9723: URL: https://github.com/apache/hudi/pull/9723#issuecomment-1960684133 ## CI report: * ae3572005431da476574d5cbdf6a324ba93d4725 UNKNOWN * 67ee450c21d566e068ef08696bc3a70a9dc1691d Azure:

Re: [PR] Verify field exist in schema before fetching the value [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10733: URL: https://github.com/apache/hudi/pull/10733#issuecomment-1960679890 ## CI report: * 6ae6e2bdd3a2734076f838a3ddea3d74b1e70abf Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500170324 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI + +on: + pull_request: +types: [ opened, reopened, synchronize, edited ] +

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500170105 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI Review Comment: Existing .yml files don't have Apache license and .yml files are not

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
vinothchandar commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500166265 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI + +on: + pull_request: +types: [ opened, reopened, synchronize, edited ] +

[I] Bugs about the hudi table created by hive catalog and wrong results when querying RO table [hudi]

2024-02-22 Thread via GitHub
AshinGau opened a new issue, #10735: URL: https://github.com/apache/hudi/issues/10735 **Describe the problem you faced** 1. When I create a hudi table in hive catalog, it works well in flink sql, but can't be read by spark or flink hudi catalog. It seems that the hudi table create by

[jira] [Commented] (HUDI-7437) bug fix: TestAvroKafkaSource. testAppendKafkaOffsetsSourceFormatAdapter

2024-02-22 Thread Vinish Reddy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819883#comment-17819883 ] Vinish Reddy commented on HUDI-7437: Reverted the PR causing the failureĀ 

[jira] [Assigned] (HUDI-7437) bug fix: TestAvroKafkaSource. testAppendKafkaOffsetsSourceFormatAdapter

2024-02-22 Thread Vinish Reddy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinish Reddy reassigned HUDI-7437: -- Assignee: Vinish Reddy > bug fix: TestAvroKafkaSource.

(hudi) branch master updated: Revert "[HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data (#10687)" (#10734)

2024-02-22 Thread codope
This is an automated email from the ASF dual-hosted git repository. codope pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 9d2174acd6b Revert "[HUDI-7416] Add interface for

Re: [PR] [HUDI-7437] Revert "[HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data (#10687) [hudi]

2024-02-22 Thread via GitHub
codope merged PR #10734: URL: https://github.com/apache/hudi/pull/10734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HUDI-7437) bug fix: TestAvroKafkaSource. testAppendKafkaOffsetsSourceFormatAdapter

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7437: - Labels: pull-request-available (was: ) > bug fix: TestAvroKafkaSource.

[PR] [HUDI-7437] Revert "[HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data (#10687) [hudi]

2024-02-22 Thread via GitHub
vinishjail97 opened a new pull request, #10734: URL: https://github.com/apache/hudi/pull/10734 This reverts commit 93cd25fded8b0225ddfc54a49cc40fc5e4ad740c to unblock master https://issues.apache.org/jira/browse/HUDI-7437 ### Change Logs _Describe context and summary for

Re: [PR] [HUDI-6860] Move createNewInstantTime out of HoodieActiveTimeline [hudi]

2024-02-22 Thread via GitHub
boneanxs commented on PR #10714: URL: https://github.com/apache/hudi/pull/10714#issuecomment-1960641014 > @boneanxs Can you help for the review and clarify the initiative aim of the task? Hey @danny0405 @wombatu-kun, sorry for misunderstanding. The intention of this issue is to

[jira] [Updated] (HUDI-7437) bug fix: TestAvroKafkaSource. testAppendKafkaOffsetsSourceFormatAdapter

2024-02-22 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7437: -- Summary: bug fix: TestAvroKafkaSource. testAppendKafkaOffsetsSourceFormatAdapter (was: Fix flaky test:

Re: [PR] Verify field exist in schema before fetching the value [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10733: URL: https://github.com/apache/hudi/pull/10733#issuecomment-1960617859 ## CI report: * 6ae6e2bdd3a2734076f838a3ddea3d74b1e70abf Azure:

Re: [PR] Verify field exist in schema before fetching the value [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10733: URL: https://github.com/apache/hudi/pull/10733#issuecomment-1960613191 ## CI report: * 6ae6e2bdd3a2734076f838a3ddea3d74b1e70abf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960608036 ## CI report: * 163e0c63a0ca481fd49164c4a081a8bba23bfe96 Azure:

[PR] Verify field exist in schema before fetching the value [hudi]

2024-02-22 Thread via GitHub
maninc opened a new pull request, #10733: URL: https://github.com/apache/hudi/pull/10733 ### Change Logs - Avro 1.10 throws ```AvroRuntimeException``` when field is not present in the schema. - Since reader schema doesn't contain all fields present in the table. This causes

(hudi) branch master updated: [MINOR] Move release candidate validation to a separate GitHub action (#10729)

2024-02-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 215fd8a0fb0 [MINOR] Move release candidate

Re: [PR] [MINOR] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
yihua merged PR #10729: URL: https://github.com/apache/hudi/pull/10729 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960556876 ## CI report: * ff76aee5326feb223a6c1099caa77d88ea7262a9 Azure:

Re: [PR] [MINOR] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10729: URL: https://github.com/apache/hudi/pull/10729#issuecomment-1960556841 ## CI report: * f1504f74c4ff4cebee372025c55c84106f4f3219 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960515693 ## CI report: * ff76aee5326feb223a6c1099caa77d88ea7262a9 Azure:

(hudi) branch branch-0.x created (now 1ca8cc7dc55)

2024-02-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git at 1ca8cc7dc55 [HUDI-7207] Sequentially delete complete instant files in archival to prevent inconsistency during data

(hudi) 01/01: [HUDI-7207] Sequentially delete complete instant files in archival to prevent inconsistency during data reads (#10711)

2024-02-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git commit 1ca8cc7dc55de0ae7fcaa3b30939abfca152cbb2 Author: majian <47964462+majian1...@users.noreply.github.com> AuthorDate: Thu

Re: [PR] [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats [hudi]

2024-02-22 Thread via GitHub
yihua closed pull request #10712: [HUDI-7246] Fix Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats URL: https://github.com/apache/hudi/pull/10712 -- This is an automated message from the Apache Git Service. To respond to the message,

(hudi) branch branch-0.x deleted (was 1ca8cc7dc55)

2024-02-22 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch branch-0.x in repository https://gitbox.apache.org/repos/asf/hudi.git was 1ca8cc7dc55 [HUDI-7207] Sequentially delete complete instant files in archival to prevent inconsistency during data

Re: [PR] [HUDI-1517] create marker file for every log file (#4913) [hudi]

2024-02-22 Thread via GitHub
yihua closed pull request #10487: [HUDI-1517] create marker file for every log file (#4913) URL: https://github.com/apache/hudi/pull/10487 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [HUDI-7228] Fix eager closure of log reader input streams with log record reader (0.x branch) [hudi]

2024-02-22 Thread via GitHub
yihua closed pull request #10339: [HUDI-7228] Fix eager closure of log reader input streams with log record reader (0.x branch) URL: https://github.com/apache/hudi/pull/10339 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [HUDI-6497][0.x branch] WIP HoodieStorage abstraction [hudi]

2024-02-22 Thread via GitHub
yihua closed pull request #10185: [HUDI-6497][0.x branch] WIP HoodieStorage abstraction URL: https://github.com/apache/hudi/pull/10185 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960509199 ## CI report: * ff76aee5326feb223a6c1099caa77d88ea7262a9 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960505885 Test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960501648 new comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [MINOR] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10729: URL: https://github.com/apache/hudi/pull/10729#issuecomment-1960501435 ## CI report: * 9942030e908f0f9f19ba5ed876dc83f1bbbe68a0 Azure:

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960501104 new comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960497257 new comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500050635 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI + +on: + issue_comment: +types: [ created, edited ] + +jobs: Review Comment: test

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500050635 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,72 @@ +name: Azure CI + +on: + issue_comment: +types: [ created, edited ] + +jobs: Review Comment: test

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960470868 New comment -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960461816 Testing new comment again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500030803 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,74 @@ +name: Azure CI + +on: + pull_request: +types: [ opened, reopened, synchronize, edited ] +

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960448385 ## CI report: * ff76aee5326feb223a6c1099caa77d88ea7262a9 Azure:

Re: [PR] [HUDI-7416] Add interface for StreamProfile to be used in StreamSync for reading and writing data [hudi]

2024-02-22 Thread via GitHub
linliu-code commented on PR #10687: URL: https://github.com/apache/hudi/pull/10687#issuecomment-1960447292 the failure is caused by a flaky test: https://issues.apache.org/jira/browse/HUDI-7437 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
linliu-code commented on code in PR #10731: URL: https://github.com/apache/hudi/pull/10731#discussion_r1500023174 ## .github/workflows/azure_ci_check.yml: ## @@ -0,0 +1,74 @@ +name: Azure CI + +on: + pull_request: +types: [ opened, reopened, synchronize, edited ] +

[I] [FeatureRequest] Support Schema evolution for complex type field [hudi]

2024-02-22 Thread via GitHub
jw-amazon opened a new issue, #10732: URL: https://github.com/apache/hudi/issues/10732 Hello, I am opening this feature request to support Schema evolution for complex type field. Currently, we have defined a field like this ``` complex_attributes array> ```

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960435104 ## CI report: * ff76aee5326feb223a6c1099caa77d88ea7262a9 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua commented on PR #10731: URL: https://github.com/apache/hudi/pull/10731#issuecomment-1960428223 Testing new comment, which should trigger `Azure CI / check-azure-ci-report` to rerun. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [HUDI-7384] Secondary index support [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10625: URL: https://github.com/apache/hudi/pull/10625#issuecomment-1960425736 ## CI report: * a65a927d36374dbd1cbdc818cfdfa7b3cac2f94c Azure:

[jira] [Updated] (HUDI-7438) Add GitHub action to check Azure CI report

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-7438: - Labels: pull-request-available (was: ) > Add GitHub action to check Azure CI report >

[PR] [HUDI-7438] Add GitHub action to check Azure CI report [hudi]

2024-02-22 Thread via GitHub
yihua opened a new pull request, #10731: URL: https://github.com/apache/hudi/pull/10731 ### Change Logs This PR adds the GitHub action to check Azure CI report. The action fails if Azure CI does not pass. The action checks the last `hudi-bot` comment to look for the Azure CI

[jira] [Created] (HUDI-7438) Add GitHub action to check Azure CI report

2024-02-22 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7438: --- Summary: Add GitHub action to check Azure CI report Key: HUDI-7438 URL: https://issues.apache.org/jira/browse/HUDI-7438 Project: Apache Hudi Issue Type: Improvement

Re: [PR] initial commit to update doris docs [hudi]

2024-02-22 Thread via GitHub
nfarah86 commented on PR #10683: URL: https://github.com/apache/hudi/pull/10683#issuecomment-1960381907 this pr is ready now @bhasudha @xushiyan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [HUDI-7430] Fix empty schema issue for compactor [hudi]

2024-02-22 Thread via GitHub
linliu-code commented on code in PR #10718: URL: https://github.com/apache/hudi/pull/10718#discussion_r1499978609 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java: ## @@ -271,9 +262,9 @@ private int doCompact(JavaSparkContext jsc) throws Exception

Re: [PR] [MINOR] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10729: URL: https://github.com/apache/hudi/pull/10729#issuecomment-1960359942 ## CI report: * 9942030e908f0f9f19ba5ed876dc83f1bbbe68a0 Azure:

Re: [PR] [MINOR] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10729: URL: https://github.com/apache/hudi/pull/10729#issuecomment-1960349852 ## CI report: * 9942030e908f0f9f19ba5ed876dc83f1bbbe68a0 Azure:

Re: [PR] initial commit to update doris docs [hudi]

2024-02-22 Thread via GitHub
nfarah86 commented on code in PR #10683: URL: https://github.com/apache/hudi/pull/10683#discussion_r1499951338 ## website/docs/sql_queries.md: ## @@ -325,14 +325,11 @@ for more details. ## Doris -Copy on Write Tables in Hudi version 0.10.0 can be queried via Doris external

Re: [PR] [MINOR] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10729: URL: https://github.com/apache/hudi/pull/10729#issuecomment-1960336731 ## CI report: * 9942030e908f0f9f19ba5ed876dc83f1bbbe68a0 Azure:

Re: [PR] [MINOR][TESTING] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
yihua closed pull request #10730: [MINOR][TESTING] Move release candidate validation to a separate GitHub action URL: https://github.com/apache/hudi/pull/10730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] [MINOR][TESTING] Move release candidate validation to a separate GitHub action [hudi]

2024-02-22 Thread via GitHub
yihua opened a new pull request, #10730: URL: https://github.com/apache/hudi/pull/10730 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performance

Re: [PR] [HUDI-7430] Fix empty schema issue for compactor [hudi]

2024-02-22 Thread via GitHub
linliu-code commented on code in PR #10718: URL: https://github.com/apache/hudi/pull/10718#discussion_r1499910893 ## hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieCompactor.java: ## @@ -0,0 +1,115 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] [MINOR] Comment out release candidate validation in GitHub actions [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10729: URL: https://github.com/apache/hudi/pull/10729#issuecomment-1960275763 ## CI report: * 9942030e908f0f9f19ba5ed876dc83f1bbbe68a0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7384] Secondary index support [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10625: URL: https://github.com/apache/hudi/pull/10625#issuecomment-1960262454 ## CI report: * 2656b3eb1564f312a56756679514a670f581daa9 Azure:

Re: [PR] [HUDI-7430] Fix empty schema issue for compactor [hudi]

2024-02-22 Thread via GitHub
linliu-code commented on code in PR #10718: URL: https://github.com/apache/hudi/pull/10718#discussion_r1499888944 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java: ## @@ -271,9 +262,9 @@ private int doCompact(JavaSparkContext jsc) throws Exception

[PR] [MINOR] Comment out release candidate validation in GitHub actions [hudi]

2024-02-22 Thread via GitHub
yihua opened a new pull request, #10729: URL: https://github.com/apache/hudi/pull/10729 ### Change Logs This PR comments out release candidate validation in GitHub actions to make report of PR checks clean. ### Impact As above. ### Risk level none

Re: [PR] [HUDI-7384] Secondary index support [hudi]

2024-02-22 Thread via GitHub
hudi-bot commented on PR #10625: URL: https://github.com/apache/hudi/pull/10625#issuecomment-1960244329 ## CI report: * 2656b3eb1564f312a56756679514a670f581daa9 Azure:

Re: [PR] [HUDI-7430] Fix empty schema issue for compactor [hudi]

2024-02-22 Thread via GitHub
linliu-code commented on code in PR #10718: URL: https://github.com/apache/hudi/pull/10718#discussion_r1499888944 ## hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java: ## @@ -271,9 +262,9 @@ private int doCompact(JavaSparkContext jsc) throws Exception

  1   2   >