[jira] [Assigned] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-7844: --- Assignee: Ethan Guo > Fix HoodieSparkSqlTestBase to throw error upon test failure >

[jira] [Updated] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7844: Description: This PR ([https://github.com/apache/hudi/pull/11162]) introduces the following changes that

[jira] [Updated] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7844: Description: This PR ([https://github.com/apache/hudi/pull/11162]) introduces the following changes that

[jira] [Created] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7844: --- Summary: Fix HoodieSparkSqlTestBase to throw error upon test failure Key: HUDI-7844 URL: https://issues.apache.org/jira/browse/HUDI-7844 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7844: Fix Version/s: 1.0.0 > Fix HoodieSparkSqlTestBase to throw error upon test failure >

[jira] [Updated] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7844: Description: This PR (https://github.com/apache/hudi/pull/11162) introduces the following changes in     

[jira] [Updated] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7844: Attachment: Screenshot 2024-06-07 at 22.27.21.png > Fix HoodieSparkSqlTestBase to throw error upon test

[jira] [Updated] (HUDI-7843) Support record merge mode with partial updates

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7843: Description: Right now the new partial update support with partial updates stored in the log block works in

[jira] [Updated] (HUDI-7843) Support record merge mode with partial updates

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7843: Fix Version/s: 1.0.0 > Support record merge mode with partial updates >

[jira] [Updated] (HUDI-7843) Support record merge mode with partial updates

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7843: Description: Right now the new partial update support with partial updates stored in the log block works in

[jira] [Created] (HUDI-7843) Support record merge mode with partial updates

2024-06-07 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7843: --- Summary: Support record merge mode with partial updates Key: HUDI-7843 URL: https://issues.apache.org/jira/browse/HUDI-7843 Project: Apache Hudi Issue Type: New

[jira] [Updated] (HUDI-7842) Update docs with the new record merge mode config

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7842: Fix Version/s: 1.0.0 > Update docs with the new record merge mode config >

[jira] [Updated] (HUDI-7842) Update docs with the new record merge mode config

2024-06-07 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7842: Description: We should educate users on the new record merge mode config introduced by HUDI-6798 that

[jira] [Created] (HUDI-7842) Update docs with the new record merge mode config

2024-06-07 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-7842: --- Summary: Update docs with the new record merge mode config Key: HUDI-7842 URL: https://issues.apache.org/jira/browse/HUDI-7842 Project: Apache Hudi Issue Type: Task

[jira] [Closed] (HUDI-7428) Support Netease Object Storage protocol for Hudi

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7428. --- Resolution: Fixed > Support Netease Object Storage protocol for Hudi >

[jira] [Updated] (HUDI-7427) Improve meta sync latency logging

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7427: Fix Version/s: 0.15.0 1.0.0 > Improve meta sync latency logging >

[jira] [Updated] (HUDI-7428) Support Netease Object Storage protocol for Hudi

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7428: Fix Version/s: 0.15.0 > Support Netease Object Storage protocol for Hudi >

[jira] [Closed] (HUDI-7427) Improve meta sync latency logging

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7427. --- Resolution: Fixed > Improve meta sync latency logging > - > >

[jira] [Updated] (HUDI-7423) Support table type name incase-sensitive when create table in sparksql

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7423: Fix Version/s: 0.15.0 > Support table type name incase-sensitive when create table in sparksql >

[jira] [Updated] (HUDI-7416) Add interface for StreamProfile to be used in StreamSync for reading and writing data.

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7416: Issue Type: New Feature (was: Improvement) > Add interface for StreamProfile to be used in StreamSync for

[jira] [Updated] (HUDI-7416) Add interface for StreamProfile to be used in StreamSync for reading and writing data.

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7416: Fix Version/s: 0.15.0 1.0.0 > Add interface for StreamProfile to be used in StreamSync

[jira] [Closed] (HUDI-7423) Support table type name incase-sensitive when create table in sparksql

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7423. --- Resolution: Fixed > Support table type name incase-sensitive when create table in sparksql >

[jira] [Updated] (HUDI-7418) Implement file extension filter for s3 incr source

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7418: Fix Version/s: 0.15.0 1.0.0 > Implement file extension filter for s3 incr source >

[jira] [Updated] (HUDI-7415) Support OLAP engine query from origin table avoid empty result in default

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7415: Fix Version/s: 0.15.0 1.0.0 > Support OLAP engine query from origin table avoid empty

[jira] [Closed] (HUDI-7415) Support OLAP engine query from origin table avoid empty result in default

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7415. --- Resolution: Fixed > Support OLAP engine query from origin table avoid empty result in default >

[jira] [Updated] (HUDI-7406) Rename classes to be readable in storage abstraction

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7406: Fix Version/s: 0.15.0 > Rename classes to be readable in storage abstraction >

[jira] [Updated] (HUDI-7410) Use SeekableDataInputStream as the input of native HFile reader

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7410: Fix Version/s: 0.15.0 > Use SeekableDataInputStream as the input of native HFile reader >

[jira] [Updated] (HUDI-7417) NPE in StreamSync if empty batch and schema and upsert operation new table

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7417: Fix Version/s: 0.15.0 1.0.0 > NPE in StreamSync if empty batch and schema and upsert

[jira] [Updated] (HUDI-7362) Athena does not support s3a partition scheme anymore leading to missing data

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7362: Fix Version/s: 1.0.0 > Athena does not support s3a partition scheme anymore leading to missing data >

[jira] [Updated] (HUDI-7104) Cleaner could miss to clean up some files w/ savepoint interplay

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7104: Issue Type: Bug (was: Improvement) > Cleaner could miss to clean up some files w/ savepoint interplay >

[jira] [Updated] (HUDI-7357) Introduce generic StorageConfiguration

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7357: Fix Version/s: 0.15.0 > Introduce generic StorageConfiguration > -- > >

[jira] [Updated] (HUDI-7104) Cleaner could miss to clean up some files w/ savepoint interplay

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7104: Fix Version/s: 0.15.0 1.0.0 > Cleaner could miss to clean up some files w/ savepoint

[jira] [Closed] (HUDI-7104) Cleaner could miss to clean up some files w/ savepoint interplay

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7104. --- Resolution: Fixed > Cleaner could miss to clean up some files w/ savepoint interplay >

[jira] [Updated] (HUDI-7357) Introduce generic StorageConfiguration

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7357: Issue Type: New Feature (was: Improvement) > Introduce generic StorageConfiguration >

[jira] [Closed] (HUDI-7397) Add support to purge a clustering instant

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7397. --- Resolution: Fixed > Add support to purge a clustering instant > - > >

[jira] [Updated] (HUDI-7364) Move InLineFs classes to hudi-hadoop-common module

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7364: Fix Version/s: 0.15.0 > Move InLineFs classes to hudi-hadoop-common module >

[jira] [Updated] (HUDI-7397) Add support to purge a clustering instant

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7397: Fix Version/s: 0.15.0 1.0.0 > Add support to purge a clustering instant >

[jira] [Updated] (HUDI-7373) Revert config name back to hoodie.write.set.null.for.missing.columns in master

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7373: Fix Version/s: 0.15.0 1.0.0 > Revert config name back to

[jira] [Updated] (HUDI-7394) Fix run script of hudi-timeline-server-bundle

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7394: Fix Version/s: 1.0.0 > Fix run script of hudi-timeline-server-bundle >

[jira] [Closed] (HUDI-7373) Revert config name back to hoodie.write.set.null.for.missing.columns in master

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7373. --- Resolution: Fixed > Revert config name back to hoodie.write.set.null.for.missing.columns in master >

[jira] [Updated] (HUDI-7392) Fix connection leak causing lingering CLOSE_WAIT TCP connections

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7392: Fix Version/s: 1.0.0 > Fix connection leak causing lingering CLOSE_WAIT TCP connections >

[jira] [Updated] (HUDI-7387) Serializable Class need contains serialVersionUID to keep compatibility in upgrade

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7387: Fix Version/s: 0.15.0 > Serializable Class need contains serialVersionUID to keep compatibility in >

[jira] [Updated] (HUDI-7367) Add makeQualified to HoodieLocation

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7367: Fix Version/s: 0.15.0 > Add makeQualified to HoodieLocation > --- > >

[jira] [Updated] (HUDI-7338) Bump HBase, pulsar-client, and jetty version

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7338: Fix Version/s: 0.15.0 > Bump HBase, pulsar-client, and jetty version >

[jira] [Updated] (HUDI-7366) Fix HoodieLocation with encoded paths

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7366: Fix Version/s: 0.15.0 > Fix HoodieLocation with encoded paths > - > >

[jira] [Updated] (HUDI-7375) Fix flaky test: testLogReaderWithDifferentVersionsOfDeleteBlocks

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7375: Fix Version/s: (was: 0.15.0) > Fix flaky test: testLogReaderWithDifferentVersionsOfDeleteBlocks >

[jira] [Updated] (HUDI-7375) Fix flaky test: testLogReaderWithDifferentVersionsOfDeleteBlocks

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7375: Fix Version/s: 0.15.0 1.0.0 > Fix flaky test:

[jira] [Updated] (HUDI-6868) Hudi HiveSync doesn't support extracting passwords from credential store

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6868: Fix Version/s: 0.15.0 1.0.0 > Hudi HiveSync doesn't support extracting passwords from

[jira] [Updated] (HUDI-7344) Use Java [Input/Output]Stream instead of FSData[Input/Output]Stream when possible

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7344: Fix Version/s: 0.15.0 > Use Java [Input/Output]Stream instead of FSData[Input/Output]Stream when >

[jira] [Updated] (HUDI-7218) Integrate new HFile reader with HoodieHFileReader

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7218: Fix Version/s: 0.15.0 > Integrate new HFile reader with HoodieHFileReader >

[jira] [Updated] (HUDI-7345) Remove usage of org.apache.hadoop.util.VersionUtil

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7345: Fix Version/s: 0.15.0 > Remove usage of org.apache.hadoop.util.VersionUtil >

[jira] [Updated] (HUDI-7343) Replace Path.SEPARATOR with HoodieLocation.SEPARATOR

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7343: Fix Version/s: 0.15.0 > Replace Path.SEPARATOR with HoodieLocation.SEPARATOR >

[jira] [Updated] (HUDI-7347) Introduce SeekableDataInputStream for random access

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7347: Fix Version/s: 0.15.0 > Introduce SeekableDataInputStream for random access >

[jira] [Closed] (HUDI-6868) Hudi HiveSync doesn't support extracting passwords from credential store

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-6868. --- Resolution: Fixed > Hudi HiveSync doesn't support extracting passwords from credential store >

[jira] [Updated] (HUDI-7346) Remove usage of org.apache.hadoop.hbase.util.Bytes

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7346: Fix Version/s: 0.15.0 > Remove usage of org.apache.hadoop.hbase.util.Bytes >

[jira] [Updated] (HUDI-7340) Use spillable map for cached log records in HoodieBaseFileGroupRecordBuffer

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7340: Fix Version/s: 0.15.0 > Use spillable map for cached log records in HoodieBaseFileGroupRecordBuffer >

[jira] [Closed] (HUDI-7336) Introduce new HoodieStorage abstraction

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7336. --- Resolution: Fixed > Introduce new HoodieStorage abstraction > --- > >

[jira] [Assigned] (HUDI-7336) Introduce new HoodieStorage abstraction

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-7336: --- Assignee: Ethan Guo > Introduce new HoodieStorage abstraction >

[jira] [Updated] (HUDI-7351) Hive-sync partition pushdown does not work with glue

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7351: Fix Version/s: 0.15.0 > Hive-sync partition pushdown does not work with glue >

[jira] [Updated] (HUDI-7336) Introduce new HoodieStorage abstraction

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7336: Fix Version/s: 0.15.0 1.0.0 > Introduce new HoodieStorage abstraction >

[jira] [Updated] (HUDI-7342) Use BaseFileUtils to hide format-specific logic in HoodiePartitionMetadata

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7342: Fix Version/s: 0.15.0 > Use BaseFileUtils to hide format-specific logic in HoodiePartitionMetadata >

[jira] [Updated] (HUDI-7327) hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSource unless meta cols are dropped

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7327: Fix Version/s: 0.15.0 1.0.0 >

[jira] [Updated] (HUDI-7323) Transformer schema inference uses stale schema

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7323: Fix Version/s: 0.15.0 1.0.0 > Transformer schema inference uses stale schema >

[jira] [Closed] (HUDI-7323) Transformer schema inference uses stale schema

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7323. --- Resolution: Fixed > Transformer schema inference uses stale schema >

[jira] [Updated] (HUDI-7335) Create hudi-hadoop-common for hadoop-specific implementation

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7335: Fix Version/s: 0.15.0 > Create hudi-hadoop-common for hadoop-specific implementation >

[jira] [Closed] (HUDI-7228) Close LogFileReaders eaglerly with LogRecordReader

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7228. --- Resolution: Fixed > Close LogFileReaders eaglerly with LogRecordReader >

[jira] [Updated] (HUDI-7316) AbstractHoodieLogRecordReader should accept already-constructed HoodieTableMetaClient in order to reduce occurrences of file listing calls when reloading active timeline

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7316: Fix Version/s: 0.15.0 > AbstractHoodieLogRecordReader should accept already-constructed >

[jira] [Updated] (HUDI-7228) Close LogFileReaders eaglerly with LogRecordReader

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7228: Fix Version/s: 0.15.0 1.0.0 > Close LogFileReaders eaglerly with LogRecordReader >

[jira] [Updated] (HUDI-7311) Comparing date with date literal in string format causes class cast exception during filter push down

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7311: Fix Version/s: 0.15.0 > Comparing date with date literal in string format causes class cast exception >

[jira] [Updated] (HUDI-7298) Write bad records to error table in more cases instead of failing stream

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7298: Fix Version/s: 0.15.0 1.0.0 > Write bad records to error table in more cases instead of

[jira] [Updated] (HUDI-7315) Disable constructing NOT filter predicate when pushing down its wrapped filter unsupported, as its operand's primitive value is incomparable.

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7315: Fix Version/s: 0.15.0 > Disable constructing NOT filter predicate when pushing down its wrapped > filter

[jira] [Closed] (HUDI-7237) Minor Improvements to Schema Handling in Delta Sync

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7237. --- Resolution: Fixed > Minor Improvements to Schema Handling in Delta Sync >

[jira] [Updated] (HUDI-7237) Minor Improvements to Schema Handling in Delta Sync

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7237: Fix Version/s: 0.15.0 1.0.0 > Minor Improvements to Schema Handling in Delta Sync >

[jira] [Updated] (HUDI-7309) Disable filter pushing down when the parquet type corresponding to its field logical type is not comparable

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7309: Fix Version/s: 0.15.0 > Disable filter pushing down when the parquet type corresponding to its field >

[jira] [Updated] (HUDI-7303) Date field type unexpectedly convert to Long when using date comparison operator

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7303: Fix Version/s: 0.15.0 > Date field type unexpectedly convert to Long when using date comparison > operator

[jira] [Updated] (HUDI-7277) hoodie.bulkinsert.shuffle.parallelism not activated with no-partitioned table

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7277: Fix Version/s: 0.15.0 > hoodie.bulkinsert.shuffle.parallelism not activated with no-partitioned table >

[jira] [Updated] (HUDI-7317) FlinkTableFactory snatifyCheck should contains index type

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7317: Fix Version/s: 0.15.0 > FlinkTableFactory snatifyCheck should contains index type >

[jira] [Updated] (HUDI-7314) Hudi Create table support index type check

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7314: Fix Version/s: 0.15.0 1.0.0 > Hudi Create table support index type check >

[jira] [Closed] (HUDI-7314) Hudi Create table support index type check

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7314. --- Resolution: Fixed > Hudi Create table support index type check > -- >

[jira] [Updated] (HUDI-7297) Exception thrown when field type mismatch is ambiguous

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7297: Fix Version/s: 0.15.0 > Exception thrown when field type mismatch is ambiguous >

[jira] [Updated] (HUDI-7305) Fix cast exception while reading byte/short/float type of partitioned field

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7305: Fix Version/s: 0.15.0 > Fix cast exception while reading byte/short/float type of partitioned field >

[jira] [Updated] (HUDI-7170) Implement HFile reader independent of HBase

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7170: Fix Version/s: 0.15.0 > Implement HFile reader independent of HBase >

[jira] [Closed] (HUDI-7246) Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7246. --- Resolution: Fixed > Data Skipping Issue: No Results When Query Conditions Involve Both Columns > with and

[jira] [Updated] (HUDI-7246) Data Skipping Issue: No Results When Query Conditions Involve Both Columns with and without Column Stats

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7246: Fix Version/s: 0.15.0 1.0.0 > Data Skipping Issue: No Results When Query Conditions

[jira] [Updated] (HUDI-7296) Reduce combinations for some tests to make ci faster

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7296: Fix Version/s: 0.15.0 1.0.0 > Reduce combinations for some tests to make ci faster >

[jira] [Updated] (HUDI-7300) Parquet DFS source should support merging schemas

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7300: Fix Version/s: 0.15.0 1.0.0 > Parquet DFS source should support merging schemas >

[jira] [Updated] (HUDI-7300) Parquet DFS source should support merging schemas

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7300: Status: Patch Available (was: In Progress) > Parquet DFS source should support merging schemas >

[jira] [Closed] (HUDI-7300) Parquet DFS source should support merging schemas

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7300. --- Resolution: Fixed > Parquet DFS source should support merging schemas >

[jira] [Updated] (HUDI-6902) Detect and fix flaky tests

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6902: Fix Version/s: 0.15.0 1.0.0 > Detect and fix flaky tests > -- >

[jira] [Closed] (HUDI-7288) Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7288. --- Resolution: Fixed > Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created > by

[jira] [Updated] (HUDI-7293) Incremental read of insert table using rebalance strategy

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7293: Fix Version/s: 0.15.0 > Incremental read of insert table using rebalance strategy >

[jira] [Updated] (HUDI-7278) Skip writing bloom filter for saving CPU

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7278: Fix Version/s: 0.15.0 1.0.0 > Skip writing bloom filter for saving CPU >

[jira] [Updated] (HUDI-7286) On the Flink side, the index. type parameter is case sensitive

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7286: Fix Version/s: 0.15.0 > On the Flink side, the index. type parameter is case sensitive >

[jira] [Updated] (HUDI-7241) spark sql choose broad cast has join for very large HUDI relation

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7241: Issue Type: Bug (was: Improvement) > spark sql choose broad cast has join for very large HUDI relation >

[jira] [Updated] (HUDI-7288) Fix ArrayIndexOutOfBoundsException when upgrade nonPartitionedTable created by 0.10/0.11 HUDI version

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7288: Fix Version/s: 0.15.0 1.0.0 > Fix ArrayIndexOutOfBoundsException when upgrade

[jira] [Updated] (HUDI-7282) Hudi COW APPEND mode can be verified through cluster that even if the index is bucket

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7282: Fix Version/s: 0.15.0 > Hudi COW APPEND mode can be verified through cluster that even if the index > is

[jira] [Updated] (HUDI-7241) spark sql choose broad cast has join for very large HUDI relation

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7241: Fix Version/s: 0.15.0 1.0.0 > spark sql choose broad cast has join for very large HUDI

[jira] [Closed] (HUDI-7241) spark sql choose broad cast has join for very large HUDI relation

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7241. --- Resolution: Fixed > spark sql choose broad cast has join for very large HUDI relation >

[jira] [Closed] (HUDI-5973) Add cachedSchema per write batch to fix idempotency with getSourceSchema calls

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5973. --- Resolution: Fixed > Add cachedSchema per write batch to fix idempotency with getSourceSchema calls >

[jira] [Updated] (HUDI-7284) Differentiate between replacecommits in stream sync

2024-06-06 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7284: Fix Version/s: 0.15.0 1.0.0 > Differentiate between replacecommits in stream sync >

  1   2   3   4   5   6   7   8   9   10   >