[jira] [Updated] (HUDI-1856) Upstream changes made in PrestoDB to eliminate file listing to Trino

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1856: - Fix Version/s: 0.11.0 (was: 0.10.0) > Upstream changes made in PrestoDB to

[jira] [Updated] (HUDI-1912) Presto defaults to GenericHiveRecordCursor for all Hudi tables

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1912: - Fix Version/s: 0.11.0 (was: 0.10.0) > Presto defaults to GenericHiveRecordCursor

[jira] [Updated] (HUDI-2396) Tracking larger changes in 0.9.0 to be called out in 0.10.0

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2396: - Fix Version/s: (was: 0.11.0) > Tracking larger changes in 0.9.0 to be called out in 0.10.0 >

[GitHub] [hudi] xiarixiaoyao commented on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

2021-11-26 Thread GitBox
xiarixiaoyao commented on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-980520231 @leesf @vinothchandar @xushiyan If there is a large amount of data, the performance gap is very obvious. Our environment uses 100g of data, and the performance is

[GitHub] [hudi] lsyldliu edited a comment on issue #4030: [SUPPORT] Flink uses updated fields to update data

2021-11-26 Thread GitBox
lsyldliu edited a comment on issue #4030: URL: https://github.com/apache/hudi/issues/4030#issuecomment-980515305 Hi, @dik111 I want to sure with you, is your use case occur a schema evolution in updated changelog or schema in fixed, only lack of some fields in updated changelog?

[GitHub] [hudi] yihua commented on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

2021-11-26 Thread GitBox
yihua commented on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-980519014 @leesf I removed the `release-blockers` label for 0.10.0. We should still triage the issue. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (HUDI-2862) Table upgrade/downgrade should be guarded with table level lock

2021-11-26 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2862: - Status: Resolved (was: Patch Available) > Table upgrade/downgrade should be guarded with

[jira] [Updated] (HUDI-2475) Rolling Upgrade downgrade story for 0.10 & enabling metadata

2021-11-26 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2475: - Status: Resolved (was: Patch Available) > Rolling Upgrade downgrade story for 0.10 &

[jira] [Resolved] (HUDI-2102) support hilbert curve for hudi

2021-11-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo resolved HUDI-2102. - > support hilbert curve for hudi > -- > > Key: HUDI-2102 >

[GitHub] [hudi] yihua merged pull request #3952: [HUDI-2102] Support hilbert curve for hudi

2021-11-26 Thread GitBox
yihua merged pull request #3952: URL: https://github.com/apache/hudi/pull/3952 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [HUDI-2102] Support hilbert curve for hudi (#3952)

2021-11-26 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 780a2ac [HUDI-2102] Support hilbert curve for

[hudi] branch master updated (3a8d64e -> 2c7656c)

2021-11-26 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 3a8d64e [HUDI-2868] Fix skipped HoodieSparkSqlWriterSuite (#4125) add 2c7656c [HUDI-2475] [HUDI-2862] Metadata

[GitHub] [hudi] yihua merged pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
yihua merged pull request #4114: URL: https://github.com/apache/hudi/pull/4114 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3952: [HUDI-2102]support hilbert curve for hudi.

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #3952: URL: https://github.com/apache/hudi/pull/3952#issuecomment-980507331 ## CI report: * 688052e6a4e22f30bd6728609edea968d9cc1bfd UNKNOWN * 503ebc7ff871791004511bae1bc79465e341062d Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3952: [HUDI-2102]support hilbert curve for hudi.

2021-11-26 Thread GitBox
hudi-bot commented on pull request #3952: URL: https://github.com/apache/hudi/pull/3952#issuecomment-980516914 ## CI report: * 688052e6a4e22f30bd6728609edea968d9cc1bfd UNKNOWN * 18d2357845c09748e5cd7297b3d3f4569baad7d8 Azure:

[GitHub] [hudi] lsyldliu commented on issue #4030: [SUPPORT] Flink uses updated fields to update data

2021-11-26 Thread GitBox
lsyldliu commented on issue #4030: URL: https://github.com/apache/hudi/issues/4030#issuecomment-980515305 Hi, @dik111 I want to sure with you, is your use case occur a schema evolution in updated changelog or schema in fixed, only lack of some fields in updated changelog? -- This is an

[GitHub] [hudi] hudi-bot removed a comment on pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4114: URL: https://github.com/apache/hudi/pull/4114#issuecomment-980508381 ## CI report: * 4944ddfa78d4037799f81473f7e1740cc7a6cd25 UNKNOWN * df29d00961d7171f90cbafa0e04786c52f2d4f10 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4114: URL: https://github.com/apache/hudi/pull/4114#issuecomment-980514500 ## CI report: * 4944ddfa78d4037799f81473f7e1740cc7a6cd25 UNKNOWN * df29d00961d7171f90cbafa0e04786c52f2d4f10 UNKNOWN * fdfd64a0e62d239a800a996264b9709006207b02

[GitHub] [hudi] hudi-bot commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980511858 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 7870ac806a91600cf17421bf437dc999b419ff65 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980510039 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 9c02ab1a3f30280e8fa7fab5e19da523cb9a0263 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4138: [HUDI-2781] Set spark3 in azure pipelines

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4138: URL: https://github.com/apache/hudi/pull/4138#issuecomment-980510903 ## CI report: * 3dc22aa951fd602f0f6f6f897bdcd8b688ef4af7 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4138: [HUDI-2781] Set spark3 in azure pipelines

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4138: URL: https://github.com/apache/hudi/pull/4138#issuecomment-980505768 ## CI report: * 3dc22aa951fd602f0f6f6f897bdcd8b688ef4af7 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980510039 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 9c02ab1a3f30280e8fa7fab5e19da523cb9a0263 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980507704 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 9c02ab1a3f30280e8fa7fab5e19da523cb9a0263 Azure:

[GitHub] [hudi] nsivabalan commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
nsivabalan commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980509692 @hudi-bot azure run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (HUDI-2102) support hilbert curve for hudi

2021-11-26 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-2102: Fix Version/s: 0.10.0 (was: 0.11.0) > support hilbert curve for hudi >

[jira] [Assigned] (HUDI-651) Incremental Query on Hive via Spark SQL does not return expected results

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-651: Assignee: Sagar Sumit (was: sivabalan narayanan) > Incremental Query on Hive via

[jira] [Updated] (HUDI-651) Incremental Query on Hive via Spark SQL does not return expected results

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-651: - Fix Version/s: 0.11.0 (was: 0.10.0) > Incremental Query on Hive via

[jira] [Updated] (HUDI-1602) Corrupted Avro schema extracted from parquet file

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1602: -- Fix Version/s: 0.11.0 (was: 0.10.0) > Corrupted Avro schema

[jira] [Updated] (HUDI-2559) Ensure unique timestamps are generated for commit times with concurrent writers

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2559: -- Fix Version/s: 0.11.0 (was: 0.10.0) > Ensure unique timestamps

[jira] [Updated] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1015: -- Status: Resolved (was: Patch Available) > Audit all getAllPartitionPaths() calls and

[jira] [Updated] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2077: -- Fix Version/s: 0.11.0 (was: 0.10.0) > Flaky test:

[jira] [Updated] (HUDI-2861) Failed rollback is never re-attempted

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2861: -- Status: Resolved (was: Patch Available) > Failed rollback is never re-attempted >

[jira] [Updated] (HUDI-2845) Metadata CLI - fix partition/file listing and add validation feature

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2845: -- Status: Resolved (was: Patch Available) > Metadata CLI - fix partition/file listing

[jira] [Updated] (HUDI-2850) Clustering CLI - schedule and run options are crashing with NumberFormatException

2021-11-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2850: -- Status: Resolved (was: Patch Available) > Clustering CLI - schedule and run options

[jira] [Updated] (HUDI-2825) Docs for markers

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2825: - Fix Version/s: 0.11.0 (was: 0.10.0) > Docs for markers > > >

[jira] [Updated] (HUDI-2725) Add precommit validators doc

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2725: - Status: Resolved (was: Patch Available) > Add precommit validators doc > >

[jira] [Commented] (HUDI-2725) Add precommit validators doc

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449754#comment-17449754 ] Danny Chen commented on HUDI-2725: -- Fixed via master branch: dcd746b233ed76e4cb573fd6bff2031ecc1e41bb >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4114: URL: https://github.com/apache/hudi/pull/4114#issuecomment-980507936 ## CI report: * 4944ddfa78d4037799f81473f7e1740cc7a6cd25 UNKNOWN * df29d00961d7171f90cbafa0e04786c52f2d4f10 UNKNOWN *

[GitHub] [hudi] danny0405 merged pull request #4011: [HUDI-2725] - Add Docs for Pre-Commit Validators

2021-11-26 Thread GitBox
danny0405 merged pull request #4011: URL: https://github.com/apache/hudi/pull/4011 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4114: URL: https://github.com/apache/hudi/pull/4114#issuecomment-980508381 ## CI report: * 4944ddfa78d4037799f81473f7e1740cc7a6cd25 UNKNOWN * df29d00961d7171f90cbafa0e04786c52f2d4f10 UNKNOWN * fdfd64a0e62d239a800a996264b9709006207b02

[hudi] branch asf-site updated: [HUDI-2725] - Add Docs for Pre-Commit Validators (#4011)

2021-11-26 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new dcd746b [HUDI-2725] - Add Docs for

[jira] [Updated] (HUDI-2527) Flaky test: TestHoodieClientMultiWriter.testMultiWriterWithAsyncTableServicesWithConflict

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2527: - Fix Version/s: 0.11.0 (was: 0.10.0) > Flaky test: >

[jira] [Updated] (HUDI-2374) AvroDFSSource does not use the overridden schema to deserialize Avro binaries.

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2374: - Fix Version/s: 0.11.0 (was: 0.10.0) > AvroDFSSource does not use the overridden

[jira] [Updated] (HUDI-1872) Move HoodieFlinkStreamer into hudi-utilities module

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1872: - Fix Version/s: 0.11.0 (was: 0.10.0) > Move HoodieFlinkStreamer into hudi-utilities

[jira] [Updated] (HUDI-1280) Add tool to capture earliest or latest offsets in kafka topics

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1280: - Fix Version/s: 0.11.0 (was: 0.10.0) > Add tool to capture earliest or latest

[jira] [Updated] (HUDI-84) Benchmark write/read paths on Hudi vs non-Hudi datasets

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-84: --- Fix Version/s: 0.11 (was: 0.10.0) > Benchmark write/read paths on Hudi vs non-Hudi

[jira] [Updated] (HUDI-1401) Presto use of Metadata Table for file listings

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1401: - Fix Version/s: 0.11.0 (was: 0.10.0) > Presto use of Metadata Table for file

[jira] [Updated] (HUDI-2220) the words 'accroding' in the comments is incorrect

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2220: - Fix Version/s: (was: 0.10.0) > the words 'accroding' in the comments is incorrect >

[jira] [Resolved] (HUDI-2778) Optimize statistics collection related codes and add more docs for z-order

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2778. -- > Optimize statistics collection related codes and add more docs for z-order >

[jira] [Updated] (HUDI-2736) Redundant metadata table initialization by the metadata writer

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2736: - Fix Version/s: (was: 0.10.0) > Redundant metadata table initialization by the metadata writer >

[jira] [Commented] (HUDI-2778) Optimize statistics collection related codes and add more docs for z-order

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449753#comment-17449753 ] Danny Chen commented on HUDI-2778: -- Fixed via master branch: 9de995134888b6e36fac1f50722b4d3577d00ab3 >

[jira] [Updated] (HUDI-2778) Optimize statistics collection related codes and add more docs for z-order

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2778: - Fix Version/s: (was: 0.11.0) > Optimize statistics collection related codes and add more docs for

[GitHub] [hudi] hudi-bot removed a comment on pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4114: URL: https://github.com/apache/hudi/pull/4114#issuecomment-980503833 ## CI report: * 4944ddfa78d4037799f81473f7e1740cc7a6cd25 UNKNOWN * df29d00961d7171f90cbafa0e04786c52f2d4f10 UNKNOWN *

[jira] [Updated] (HUDI-2697) Minor changes about hbase index config.

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2697: - Fix Version/s: (was: 0.11.0) > Minor changes about hbase index config. >

[jira] [Updated] (HUDI-2676) Hudi should synchronize owner information to hudi _rt/_ro table。

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2676: - Fix Version/s: (was: 0.11.0) > Hudi should synchronize owner information to hudi _rt/_ro table。 >

[jira] [Resolved] (HUDI-2697) Minor changes about hbase index config.

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2697. -- > Minor changes about hbase index config. > > >

[GitHub] [hudi] hudi-bot commented on pull request #4114: [HUDI-2475] [HUDI-2862] Metadata table creation and avoid bootstrapping race for write client & add locking for upgrade

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4114: URL: https://github.com/apache/hudi/pull/4114#issuecomment-980507936 ## CI report: * 4944ddfa78d4037799f81473f7e1740cc7a6cd25 UNKNOWN * df29d00961d7171f90cbafa0e04786c52f2d4f10 UNKNOWN * fdfd64a0e62d239a800a996264b9709006207b02

[jira] [Commented] (HUDI-2676) Hudi should synchronize owner information to hudi _rt/_ro table。

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449751#comment-17449751 ] Danny Chen commented on HUDI-2676: -- Fixed via master branch: acc40625f594576353919323c2b34c43309f18d5 >

[jira] [Resolved] (HUDI-2676) Hudi should synchronize owner information to hudi _rt/_ro table。

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2676. -- > Hudi should synchronize owner information to hudi _rt/_ro table。 >

[jira] [Commented] (HUDI-2697) Minor changes about hbase index config.

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449752#comment-17449752 ] Danny Chen commented on HUDI-2697: -- Fixed via master branch: 0e8461e9abc97537954a2c1dd716aed53e52dc62 >

[jira] [Updated] (HUDI-2098) add Hdfs file lock for HUDI

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2098: - Fix Version/s: (was: 0.10.0) (was: 0.11.0) > add Hdfs file lock for HUDI >

[jira] [Closed] (HUDI-2098) add Hdfs file lock for HUDI

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-2098. Resolution: Invalid Close as invalid because the PR is closed. > add Hdfs file lock for HUDI >

[jira] [Resolved] (HUDI-1995) FIx typo in oss cn docs

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-1995. -- > FIx typo in oss cn docs > --- > > Key: HUDI-1995 >

[jira] [Updated] (HUDI-1995) FIx typo in oss cn docs

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1995: - Fix Version/s: (was: 0.10.0) > FIx typo in oss cn docs > --- > >

[jira] [Updated] (HUDI-1995) FIx typo in oss cn docs

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1995: - Fix Version/s: 0.10.0 (was: 0.11.0) > FIx typo in oss cn docs >

[jira] [Commented] (HUDI-1995) FIx typo in oss cn docs

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449749#comment-17449749 ] Danny Chen commented on HUDI-1995: -- Fixed via master branch: 4a2ab0d1148cb5f065a6266a1b09d01b054f43bc >

[GitHub] [hudi] hudi-bot commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
hudi-bot commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980507704 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 9c02ab1a3f30280e8fa7fab5e19da523cb9a0263 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980499488 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 9c02ab1a3f30280e8fa7fab5e19da523cb9a0263 Azure:

[jira] [Updated] (HUDI-1202) Fix Gradle dependency issue when pulling in hudi-spark_2.12

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1202: - Fix Version/s: (was: 0.10.0) > Fix Gradle dependency issue when pulling in hudi-spark_2.12 >

[jira] [Updated] (HUDI-1221) Ensure docker demo page reflects the latest support on all query engines

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1221: - Fix Version/s: (was: 0.10.0) > Ensure docker demo page reflects the latest support on all query

[jira] [Updated] (HUDI-1219) Code optimization on hudi-common moudle

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1219: - Fix Version/s: (was: 0.10.0) > Code optimization on hudi-common moudle >

[jira] [Updated] (HUDI-1600) Fix document to reflect Hudi supports MOR for spark datasource for incremental queries

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1600: - Fix Version/s: (was: 0.10.0) > Fix document to reflect Hudi supports MOR for spark datasource for >

[jira] [Resolved] (HUDI-1752) Add HoodieFlinkClient InsertOverwrite

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-1752. -- > Add HoodieFlinkClient InsertOverwrite > - > > Key:

[jira] [Updated] (HUDI-1752) Add HoodieFlinkClient InsertOverwrite

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1752: - Fix Version/s: (was: 0.11.0) > Add HoodieFlinkClient InsertOverwrite >

[jira] [Updated] (HUDI-1936) Introduce a optional property for conditional upsert

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1936: - Fix Version/s: (was: 0.10.0) > Introduce a optional property for conditional upsert >

[jira] [Updated] (HUDI-1139) Add support for JuiceFS

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1139: - Fix Version/s: (was: 0.10.0) > Add support for JuiceFS > --- > >

[jira] [Updated] (HUDI-1053) Make ComplexKeyGenerator also support non partitioned Hudi dataset

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1053: - Fix Version/s: (was: 0.10.0) > Make ComplexKeyGenerator also support non partitioned Hudi dataset >

[jira] [Updated] (HUDI-1081) Document AWS Hudi integration

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1081: - Fix Version/s: (was: 0.10.0) > Document AWS Hudi integration > - > >

[jira] [Updated] (HUDI-778) Add code coverage badge to README file

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-778: Fix Version/s: (was: 0.10.0) > Add code coverage badge to README file >

[jira] [Reopened] (HUDI-778) Add code coverage badge to README file

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen reopened HUDI-778: - > Add code coverage badge to README file > -- > > Key:

[jira] [Closed] (HUDI-778) Add code coverage badge to README file

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-778. --- Resolution: Won't Fix > Add code coverage badge to README file > -- > >

[jira] [Updated] (HUDI-977) deal the test module hudi-integ-test

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-977: Fix Version/s: (was: 0.10.0) > deal the test module hudi-integ-test >

[jira] [Updated] (HUDI-1024) Document S3 related guide and tips

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-1024: - Fix Version/s: (was: 0.10.0) > Document S3 related guide and tips >

[jira] [Updated] (HUDI-2869) Metadata bootstrapping should ignore data files from partial/inflight commits

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2869: - Fix Version/s: (was: 0.10.0) > Metadata bootstrapping should ignore data files from partial/inflight

[jira] [Updated] (HUDI-2808) Supports deduplication for streaming write

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2808: - Fix Version/s: (was: 0.10.0) > Supports deduplication for streaming write >

[jira] [Updated] (HUDI-691) hoodie.*.consume.* should be set whitelist in hive-site.xml

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-691: Fix Version/s: (was: 0.10.0) > hoodie.*.consume.* should be set whitelist in hive-site.xml >

[jira] [Updated] (HUDI-483) Fix unit test for Archiving to reflect empty instant files for requested commit/deltacommits

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-483: Fix Version/s: (was: 0.10.0) > Fix unit test for Archiving to reflect empty instant files for requested

[jira] [Updated] (HUDI-2719) Add back support for copying over extra metadata from previous commit

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2719: - Fix Version/s: (was: 0.10.0) > Add back support for copying over extra metadata from previous commit

[jira] [Updated] (HUDI-2664) Investigate: Dependency library sources are pulled during maven build

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2664: - Fix Version/s: (was: 0.10.0) > Investigate: Dependency library sources are pulled during maven build

[jira] [Updated] (HUDI-2668) [UMBRELLA] upgrade libraries or dependency versions

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2668: - Fix Version/s: (was: 0.10.0) > [UMBRELLA] upgrade libraries or dependency versions >

[jira] [Updated] (HUDI-2703) [RFC-37] Metadata based bloom index

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2703: - Fix Version/s: (was: 0.10.0) > [RFC-37] Metadata based bloom index >

[jira] [Updated] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2759: - Fix Version/s: (was: 0.10.0) > extract HoodieCatalogTable as a bridge between spark catalog table and

[jira] [Updated] (HUDI-2661) java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.catalog.CatalogTable.copy

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2661: - Fix Version/s: (was: 0.10.0) > java.lang.NoSuchMethodError: >

[jira] [Updated] (HUDI-2653) Skip the reading files that are cleaned for the split reader

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2653: - Fix Version/s: (was: 0.11.0) > Skip the reading files that are cleaned for the split reader >

[jira] [Updated] (HUDI-2650) Select count (*) generates wrong result

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2650: - Fix Version/s: (was: 0.10.0) > Select count (*) generates wrong result >

[jira] [Updated] (HUDI-2652) Improve streaming read for flink

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2652: - Fix Version/s: (was: 0.10.0) > Improve streaming read for flink > >

[jira] [Closed] (HUDI-2653) Skip the reading files that are cleaned for the split reader

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-2653. Resolution: Won't Fix > Skip the reading files that are cleaned for the split reader >

[jira] [Updated] (HUDI-2642) Add support ignoring case in update sql operation

2021-11-26 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-2642: - Fix Version/s: (was: 0.10.0) > Add support ignoring case in update sql operation >

[GitHub] [hudi] hudi-bot removed a comment on pull request #3952: [HUDI-2102]support hilbert curve for hudi.

2021-11-26 Thread GitBox
hudi-bot removed a comment on pull request #3952: URL: https://github.com/apache/hudi/pull/3952#issuecomment-980505736 ## CI report: * 688052e6a4e22f30bd6728609edea968d9cc1bfd UNKNOWN * 503ebc7ff871791004511bae1bc79465e341062d Azure:

  1   2   3   4   5   6   7   8   9   >