[jira] [Closed] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

2021-12-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3054. > Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter >

[jira] [Commented] (HUDI-2427) SQL stmt broken with spark 3.1.x

2021-12-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462788#comment-17462788 ] Raymond Xu commented on HUDI-2427: -- The upcoming 0.11 docs will have the support matrix

[jira] [Assigned] (HUDI-3052) Flaky TestJsonKafkaSource in CI runs

2021-12-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3052: Assignee: Raymond Xu > Flaky TestJsonKafkaSource in CI runs >

[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Sprint: Hudi-Sprint-0.10.1 > Fix HiveSyncTool drop partitions using JDBC >

[jira] [Commented] (HUDI-3034) Enable maven parallel build in Azure CI

2021-12-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462045#comment-17462045 ] Raymond Xu commented on HUDI-3034: -- Fixed in master f57e28fe396951ce6e4690373b6e75035362409f > Enable

[jira] [Closed] (HUDI-3034) Enable maven parallel build in Azure CI

2021-12-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3034. Resolution: Fixed > Enable maven parallel build in Azure CI > --- > >

[jira] [Updated] (HUDI-2187) [RFC-31] Add shim layer to support multiple hive version

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2187: - Fix Version/s: (was: 0.10.0) > [RFC-31] Add shim layer to support multiple hive version >

[jira] [Updated] (HUDI-2834) Validate against supported hive versions

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2834: - Status: Patch Available (was: In Progress) > Validate against supported hive versions >

[jira] [Updated] (HUDI-2187) [RFC-31] Add shim layer to support multiple hive version

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2187: - Priority: Major (was: Blocker) > [RFC-31] Add shim layer to support multiple hive version >

[jira] [Updated] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2818: - Status: Patch Available (was: In Progress) > 2to3 upgrade only checks hoodie.table.keygenerator.class >

[jira] [Created] (HUDI-2834) Validate against supported hive versions

2021-11-22 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2834: Summary: Validate against supported hive versions Key: HUDI-2834 URL: https://issues.apache.org/jira/browse/HUDI-2834 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-2811) Support Spark 3.2

2021-11-20 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2811: Summary: Support Spark 3.2 Key: HUDI-2811 URL: https://issues.apache.org/jira/browse/HUDI-2811 Project: Apache Hudi Issue Type: Improvement Components:

[jira] [Updated] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1932: - Status: Closed (was: Patch Available) > Hive Sync should not always update last_commit_time_sync >

[jira] [Reopened] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-1932: -- > Hive Sync should not always update last_commit_time_sync >

[jira] [Resolved] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1932. -- > Hive Sync should not always update last_commit_time_sync >

[jira] [Closed] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1932. > Hive Sync should not always update last_commit_time_sync >

[jira] [Updated] (HUDI-2187) [RFC-31] Add shim layer to support multiple hive version

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2187: - Summary: [RFC-31] Add shim layer to support multiple hive version (was: Add shim layer to support

[jira] [Updated] (HUDI-2811) Support Spark 3.2

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2811: - Labels: sev:critical (was: ) > Support Spark 3.2 > - > > Key: HUDI-2811

[jira] [Updated] (HUDI-2811) Support Spark 3.2

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2811: - Description: Reported issues * [https://github.com/apache/hudi/issues/4001] *   > Support Spark 3.2 >

[jira] [Updated] (HUDI-2811) Support Spark 3.2

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2811: - Description: Reported issues * [https://github.com/apache/hudi/issues/4001] *

[jira] [Updated] (HUDI-2811) Support Spark 3.2 and Parquet 1.12.x

2021-11-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2811: - Summary: Support Spark 3.2 and Parquet 1.12.x (was: Support Spark 3.2) > Support Spark 3.2 and Parquet

[jira] [Closed] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2818. > 2to3 upgrade only checks hoodie.table.keygenerator.class >

[jira] [Reopened] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-2818: -- > 2to3 upgrade only checks hoodie.table.keygenerator.class >

[jira] [Resolved] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2818. -- > 2to3 upgrade only checks hoodie.table.keygenerator.class >

[jira] [Updated] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2818: - Status: Closed (was: Patch Available) > 2to3 upgrade only checks hoodie.table.keygenerator.class >

[jira] [Resolved] (HUDI-2838) refresh table manually after drop partition

2021-11-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2838. -- > refresh table manually after drop partition > --- > >

[jira] [Closed] (HUDI-2838) refresh table manually after drop partition

2021-11-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2838. > refresh table manually after drop partition > --- > >

[jira] [Assigned] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2781: Assignee: Yann Byron > Test 0.10 RC for Spark 3.x > -- > >

[jira] [Updated] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2781: - Priority: Blocker (was: Major) > Test 0.10 RC for Spark 3.x > -- > >

[jira] [Updated] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2781: - Reviewers: Raymond Xu > Test 0.10 RC for Spark 3.x > -- > > Key:

[jira] [Commented] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446269#comment-17446269 ] Raymond Xu commented on HUDI-2781: --  ok it's good to start testing early next week. > Test 0.10 RC for

[jira] [Updated] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2781: - Reviewers: Rajesh Mahindra (was: Raymond Xu) > Test 0.10 RC for Spark 3.x > -- >

[jira] [Updated] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2781: - Reviewers: Raymond Xu (was: Rajesh Mahindra) > Test 0.10 RC for Spark 3.x > -- >

[jira] [Commented] (HUDI-2452) spark on hudi metadata key length < 0 and file not found error

2021-11-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446588#comment-17446588 ] Raymond Xu commented on HUDI-2452: -- [~shivnarayan] can you link the fixing PR and ticket please? it says

[jira] [Comment Edited] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445536#comment-17445536 ] Raymond Xu edited comment on HUDI-1870 at 11/17/21, 11:02 PM: -- when build

[jira] [Commented] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445536#comment-17445536 ] Raymond Xu commented on HUDI-1870: -- when build with and change spark3.version to 3.0.\{1,2,3}  

[jira] [Assigned] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1870: Assignee: Yann Byron (was: XiaoyuGeng) > Move spark avro serialization class into hudi repo >

[jira] [Commented] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445542#comment-17445542 ] Raymond Xu commented on HUDI-1870: -- [~biyan900...@gmail.com] here is a separate PR for CI builds for this

[jira] [Updated] (HUDI-2516) Upgrade to Junit 5.8.1

2021-11-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2516: - Priority: Critical (was: Blocker) > Upgrade to Junit 5.8.1 > -- > >

[jira] [Created] (HUDI-2757) Support AWS Glue API for metastore sync

2021-11-13 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2757: Summary: Support AWS Glue API for metastore sync Key: HUDI-2757 URL: https://issues.apache.org/jira/browse/HUDI-2757 Project: Apache Hudi Issue Type: New Feature

[jira] [Commented] (HUDI-2500) Spark datasource delete not working on Spark SQL created table

2021-11-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443165#comment-17443165 ] Raymond Xu commented on HUDI-2500: -- Ok [~biyan900...@gmail.com] looks like this is not a bug. You meant

[jira] [Updated] (HUDI-2500) Spark datasource delete not working on Spark SQL created table

2021-11-13 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2500: - Priority: Critical (was: Blocker) > Spark datasource delete not working on Spark SQL created table >

[jira] [Resolved] (HUDI-2505) [UMBRELLA] Spark DataSource APIs and Spark SQL discrepancies

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2505. -- > [UMBRELLA] Spark DataSource APIs and Spark SQL discrepancies >

[jira] [Closed] (HUDI-2706) Refactor Spark-SQL to make consistent with DataFrame

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2706. > Refactor Spark-SQL to make consistent with DataFrame > >

[jira] [Closed] (HUDI-2505) [UMBRELLA] Spark DataSource APIs and Spark SQL discrepancies

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2505. > [UMBRELLA] Spark DataSource APIs and Spark SQL discrepancies >

[jira] [Resolved] (HUDI-2706) Refactor Spark-SQL to make consistent with DataFrame

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2706. -- > Refactor Spark-SQL to make consistent with DataFrame >

[jira] [Closed] (HUDI-2495) Difference in behavior between GenericRecord based key gen and Row based key gen

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2495. > Difference in behavior between GenericRecord based key gen and Row based key > gen >

[jira] [Resolved] (HUDI-2495) Difference in behavior between GenericRecord based key gen and Row based key gen

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2495. -- > Difference in behavior between GenericRecord based key gen and Row based key > gen >

[jira] [Reopened] (HUDI-2495) Difference in behavior between GenericRecord based key gen and Row based key gen

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-2495: -- > Difference in behavior between GenericRecord based key gen and Row based key > gen >

[jira] [Updated] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2759: - Fix Version/s: 0.10.0 (was: 0.11.0) > extract HoodieCatalogTable as a bridge

[jira] [Closed] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2759. > extract HoodieCatalogTable as a bridge between spark catalog table and hoodie > table >

[jira] [Resolved] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2759. -- > extract HoodieCatalogTable as a bridge between spark catalog table and hoodie > table >

[jira] [Updated] (HUDI-53) Implement Record level Index to map a record key to a pair #90

2021-11-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-53?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-53: --- Description: [https://github.com/uber/hudi/issues/90]    feature-enquiry *

[jira] [Updated] (HUDI-2844) Archived Metadata Timeline is crashing if timeline contains REPLACE_COMMIT

2021-11-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2844: - Status: Resolved (was: Patch Available) > Archived Metadata Timeline is crashing if timeline contains

[jira] [Closed] (HUDI-2844) Archived Metadata Timeline is crashing if timeline contains REPLACE_COMMIT

2021-11-24 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2844. > Archived Metadata Timeline is crashing if timeline contains REPLACE_COMMIT >

[jira] [Created] (HUDI-2868) Fix skipped HoodieSparkSqlWriterSuite

2021-11-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2868: Summary: Fix skipped HoodieSparkSqlWriterSuite Key: HUDI-2868 URL: https://issues.apache.org/jira/browse/HUDI-2868 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-2834) Validate against supported hive versions

2021-11-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2834: - Priority: Critical (was: Blocker) > Validate against supported hive versions >

[jira] [Assigned] (HUDI-2868) Fix skipped HoodieSparkSqlWriterSuite

2021-11-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2868: Assignee: Raymond Xu > Fix skipped HoodieSparkSqlWriterSuite >

[jira] [Updated] (HUDI-2834) Validate against supported hive versions

2021-11-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2834: - Fix Version/s: (was: 0.10.0) > Validate against supported hive versions >

[jira] [Resolved] (HUDI-2868) Fix skipped HoodieSparkSqlWriterSuite

2021-11-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2868. -- > Fix skipped HoodieSparkSqlWriterSuite > - > > Key:

[jira] [Closed] (HUDI-2868) Fix skipped HoodieSparkSqlWriterSuite

2021-11-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2868. > Fix skipped HoodieSparkSqlWriterSuite > - > > Key:

[jira] [Created] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-22 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2818: Summary: 2to3 upgrade only checks hoodie.table.keygenerator.class Key: HUDI-2818 URL: https://issues.apache.org/jira/browse/HUDI-2818 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-2818) 2to3 upgrade only checks hoodie.table.keygenerator.class

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2818: - Description: {noformat} 21/11/22 05:26:10 INFO UpgradeDowngrade: Attempting to move table from version

[jira] [Closed] (HUDI-2242) Add inference logic to few Hudi configs

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2242. > Add inference logic to few Hudi configs > --- > > Key:

[jira] [Resolved] (HUDI-2242) Add inference logic to few Hudi configs

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2242. -- > Add inference logic to few Hudi configs > --- > >

[jira] [Assigned] (HUDI-2187) [RFC-31] Add shim layer to support multiple hive version

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2187: Assignee: Raymond Xu (was: zhangminglei) > [RFC-31] Add shim layer to support multiple hive

[jira] [Closed] (HUDI-2455) Fail to build Spark caused by spark_avro dependency

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2455. > Fail to build Spark caused by spark_avro dependency > --- > >

[jira] [Resolved] (HUDI-2455) Fail to build Spark caused by spark_avro dependency

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2455. -- > Fail to build Spark caused by spark_avro dependency > ---

[jira] [Resolved] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1870. -- > Move spark avro serialization class into hudi repo > -- >

[jira] [Closed] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1870. > Move spark avro serialization class into hudi repo > -- > >

[jira] [Updated] (HUDI-2559) Ensure unique timestamps are generated for commit times with concurrent writers

2021-11-22 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2559: - Reviewers: Raymond Xu > Ensure unique timestamps are generated for commit times with concurrent >

[jira] [Resolved] (HUDI-1491) Support partition pruning for MOR snapshot query

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1491. -- > Support partition pruning for MOR snapshot query > > >

[jira] [Closed] (HUDI-1491) Support partition pruning for MOR snapshot query

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1491. > Support partition pruning for MOR snapshot query > > >

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1885: - Fix Version/s: 0.11.0 (was: 0.10.0) > Support Delete/Update Non-Pk Table >

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

2021-11-14 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1885: - Priority: Critical (was: Blocker) > Support Delete/Update Non-Pk Table >

[jira] [Closed] (HUDI-2495) Difference in behavior between GenericRecord based key gen and Row based key gen

2021-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2495. > Difference in behavior between GenericRecord based key gen and Row based key > gen >

[jira] [Resolved] (HUDI-2495) Difference in behavior between GenericRecord based key gen and Row based key gen

2021-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2495. -- > Difference in behavior between GenericRecord based key gen and Row based key > gen >

[jira] [Updated] (HUDI-2681) Make hoodie record_key and preCombine_key optional

2021-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2681: - Labels: (was: 0.10_blocker) > Make hoodie record_key and preCombine_key optional >

[jira] [Assigned] (HUDI-2681) Make hoodie record_key and preCombine_key optional

2021-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2681: Assignee: Yann Byron (was: Alexey Kudinkin) > Make hoodie record_key and preCombine_key optional

[jira] [Updated] (HUDI-2681) Make hoodie record_key and preCombine_key optional

2021-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2681: - Reviewers: Raymond Xu > Make hoodie record_key and preCombine_key optional >

[jira] [Closed] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2234. > MERGE INTO works only ON primary key > > > Key:

[jira] [Resolved] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2234. -- > MERGE INTO works only ON primary key > > > Key:

[jira] [Comment Edited] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445622#comment-17445622 ] Raymond Xu edited comment on HUDI-2234 at 11/18/21, 4:39 AM: -   {code:java}

[jira] [Commented] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445622#comment-17445622 ] Raymond Xu commented on HUDI-2234: --   {code:java} create table if not exists h1 (id int, name string,

[jira] [Created] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-16 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2781: Summary: Test 0.10 RC for Spark 3.x Key: HUDI-2781 URL: https://issues.apache.org/jira/browse/HUDI-2781 Project: Apache Hudi Issue Type: Test Components:

[jira] [Commented] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444991#comment-17444991 ] Raymond Xu commented on HUDI-2781: -- [~rmahindra] do we only start to test this once RC is cut? > Test

[jira] [Comment Edited] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444991#comment-17444991 ] Raymond Xu edited comment on HUDI-2781 at 11/17/21, 7:58 AM: - [~rmahindra] is

[jira] [Commented] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444994#comment-17444994 ] Raymond Xu commented on HUDI-2781: -- Be aware of the known issue mentioned in HUDI-1711 > Test 0.10 RC

[jira] [Comment Edited] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444991#comment-17444991 ] Raymond Xu edited comment on HUDI-2781 at 11/17/21, 8:08 AM: - [~rmahindra] a

[jira] [Updated] (HUDI-2781) Test 0.10 RC for Spark 3.x

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2781: - Labels: sev:high (was: ) > Test 0.10 RC for Spark 3.x > -- > >

[jira] [Updated] (HUDI-2362) Hudi external configuration file support

2021-11-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2362: - Status: Closed (was: Patch Available) > Hudi external configuration file support >

[jira] [Updated] (HUDI-2755) Schema validation should be compatible on different write paths

2021-11-12 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2755: - Description: Details in [https://github.com/apache/hudi/issues/3953]   It's possible to add alias in

[jira] [Created] (HUDI-2755) Schema validation should be compatible on different write paths

2021-11-12 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2755: Summary: Schema validation should be compatible on different write paths Key: HUDI-2755 URL: https://issues.apache.org/jira/browse/HUDI-2755 Project: Apache Hudi

[jira] [Updated] (HUDI-2615) Decouple HoodieRecordPayload with Hoodie table, table services, and index

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2615: - Priority: Major (was: Blocker) > Decouple HoodieRecordPayload with Hoodie table, table services, and

[jira] [Updated] (HUDI-1430) Implement SparkDataFrameWriteClient with SimpleIndex

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1430: - Priority: Major (was: Blocker) > Implement SparkDataFrameWriteClient with SimpleIndex >

[jira] [Updated] (HUDI-1430) Implement SparkDataFrameWriteClient with SimpleIndex

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1430: - Fix Version/s: (was: 0.10.0) > Implement SparkDataFrameWriteClient with SimpleIndex >

[jira] [Updated] (HUDI-2615) Decouple HoodieRecordPayload with Hoodie table, table services, and index

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2615: - Fix Version/s: (was: 0.10.0) > Decouple HoodieRecordPayload with Hoodie table, table services, and

[jira] [Updated] (HUDI-2617) Implement HBase Index for Dataset

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2617: - Fix Version/s: (was: 0.10.0) > Implement HBase Index for Dataset >

[jira] [Updated] (HUDI-2621) Enhance DataFrameWriter with small file handling

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2621: - Fix Version/s: (was: 0.10.0) > Enhance DataFrameWriter with small file handling >

[jira] [Updated] (HUDI-2622) Enhance DataFrameWriter with LazyIterator and SpillableMap

2021-11-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2622: - Fix Version/s: (was: 0.10.0) > Enhance DataFrameWriter with LazyIterator and SpillableMap >

<    6   7   8   9   10   11   12   13   14   15   >