[jira] [Updated] (HUDI-3112) KafkaConnect can not sync to Hive

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3112: - Fix Version/s: 0.11.0 > KafkaConnect can not sync to Hive > - > >

[jira] [Updated] (HUDI-3104) Hudi-kafka-connect can not scan hadoop config files by HADOOP_CONF_DIR

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3104: - Fix Version/s: 0.11.0 > Hudi-kafka-connect can not scan hadoop config files by HADOOP_CONF_DIR >

[jira] [Assigned] (HUDI-3125) Spark SQL writing timestamp type don't need to disable `spark.sql.datetime.java8API.enabled` manually

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3125: Assignee: Yann Byron > Spark SQL writing timestamp type don't need to disable >

[jira] [Updated] (HUDI-3125) Spark SQL writing timestamp type don't need to disable `spark.sql.datetime.java8API.enabled` manually

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3125: - Reviewers: Raymond Xu > Spark SQL writing timestamp type don't need to disable >

[jira] [Assigned] (HUDI-281) HiveSync failure through Spark when useJdbc is set to false

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-281: --- Assignee: Raymond Xu > HiveSync failure through Spark when useJdbc is set to false >

[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC

2021-12-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Fix Version/s: 0.11.0 0.10.1 > Fix HiveSyncTool drop partitions using JDBC >

[jira] [Updated] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC

2021-12-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3107: - Component/s: Hive Integration > Fix HiveSyncTool drop partitions using JDBC >

[jira] [Assigned] (HUDI-3107) Fix HiveSyncTool drop partitions using JDBC

2021-12-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3107: Assignee: Yue Zhang > Fix HiveSyncTool drop partitions using JDBC >

[jira] [Updated] (HUDI-2611) `create table if not exists` should print message instead of throwing error

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2611: - Fix Version/s: 0.10.1 > `create table if not exists` should print message instead of throwing error >

[jira] [Updated] (HUDI-2661) java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.catalog.CatalogTable.copy

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2661: - Fix Version/s: 0.10.1 > java.lang.NoSuchMethodError: >

[jira] [Updated] (HUDI-3052) Flaky TestJsonKafkaSource in CI runs

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3052: - Fix Version/s: 0.11.0 > Flaky TestJsonKafkaSource in CI runs > - > >

[jira] [Updated] (HUDI-2426) spark sql extensions breaks read.table from metastore

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2426: - Fix Version/s: 0.10.1 > spark sql extensions breaks read.table from metastore >

[jira] [Updated] (HUDI-2837) The original hoodie.table.name should be maintained in Spark SQL

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2837: - Reviewers: Raymond Xu, Yann Byron (was: Raymond Xu) > The original hoodie.table.name should be

[jira] [Updated] (HUDI-3093) spark-sql query error when use TimestampBasedKeyGenerator

2021-12-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3093: - Priority: Critical (was: Major) > spark-sql query error when use TimestampBasedKeyGenerator >

[jira] [Updated] (HUDI-3093) spark-sql query error when use TimestampBasedKeyGenerator

2021-12-28 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3093: - Reporter: Raymond Xu (was: Yann Byron) > spark-sql query error when use TimestampBasedKeyGenerator >

[jira] [Updated] (HUDI-3099) Purge drop partition for spark sql

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3099: - Fix Version/s: 0.11.0 > Purge drop partition for spark sql > -- > >

[jira] [Updated] (HUDI-3106) Fix HiveSyncTool not sync schema

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3106: - Fix Version/s: 0.11.0 0.10.1 > Fix HiveSyncTool not sync schema >

[jira] [Updated] (HUDI-3106) Fix HiveSyncTool not sync schema

2021-12-29 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3106: - Reporter: Raymond Xu (was: Forward Xu) > Fix HiveSyncTool not sync schema >

[jira] [Updated] (HUDI-2324) [UMBRELLA] Implement Hudi Transaction writes for Kafka Connect platform

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2324: - Epic Name: Hudi Kafka Connect > [UMBRELLA] Implement Hudi Transaction writes for Kafka Connect platform >

[jira] [Updated] (HUDI-3129) Test Hudi Subtask

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3129: - Parent Issue: HUDI-3145 (was: HUDI-3128) > Test Hudi Subtask > - > >

[jira] [Updated] (HUDI-3128) [UMBRELLA] Test Hudi Epic

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3128: - Fix Version/s: 0.10.1 > [UMBRELLA] Test Hudi Epic > - > > Key:

[jira] [Updated] (HUDI-3129) Test Hudi Subtask

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3129: - Fix Version/s: 0.10.1 > Test Hudi Subtask > - > > Key: HUDI-3129 >

[jira] [Updated] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3145: - Fix Version/s: 0.10.1 > test > > > Key: HUDI-3145 > URL:

[jira] [Created] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3145: Summary: test Key: HUDI-3145 URL: https://issues.apache.org/jira/browse/HUDI-3145 Project: Apache Hudi Issue Type: Task Reporter: Raymond Xu --

[jira] [Updated] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3145: - Sprint: Hudi 0.10.1 test sprint > test > > > Key: HUDI-3145 > URL:

[jira] [Created] (HUDI-3146) test sub task

2022-01-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3146: Summary: test sub task Key: HUDI-3146 URL: https://issues.apache.org/jira/browse/HUDI-3146 Project: Apache Hudi Issue Type: Sub-task Reporter: Raymond

[jira] [Updated] (HUDI-3146) test sub task

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3146: - Story Points: 1 > test sub task > - > > Key: HUDI-3146 > URL:

[jira] [Updated] (HUDI-3128) [UMBRELLA] Test Hudi Epic

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3128: - Epic Name: test > [UMBRELLA] Test Hudi Epic > - > > Key:

[jira] [Updated] (HUDI-3146) test sub task

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3146: - Fix Version/s: 0.10.1 > test sub task > - > > Key: HUDI-3146 >

[jira] [Updated] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3145: - Story Points: 1 > test > > > Key: HUDI-3145 > URL:

[jira] [Updated] (HUDI-2749) Improve the streaming read for hudi

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2749: - Issue Type: Improvement (was: Task) > Improve the streaming read for hudi >

[jira] [Updated] (HUDI-2749) Improve the streaming read for hudi

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2749: - Issue Type: Epic (was: Improvement) > Improve the streaming read for hudi >

[jira] [Updated] (HUDI-3073) 0.10.0 Missing Docs

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3073: - Epic Name: 0.10.0 Missing Docs > 0.10.0 Missing Docs > --- > > Key:

[jira] [Updated] (HUDI-3073) 0.10.0 Missing Docs

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3073: - Issue Type: Epic (was: Improvement) > 0.10.0 Missing Docs > --- > > Key:

[jira] [Updated] (HUDI-2948) [UMBRELLA] Hudi Clustering Performance

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2948: - Epic Name: Clustering Performance > [UMBRELLA] Hudi Clustering Performance >

[jira] [Updated] (HUDI-3129) Test Hudi Subtask

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3129: - Story Points: 1 > Test Hudi Subtask > - > > Key: HUDI-3129 >

[jira] [Updated] (HUDI-2749) Improve the streaming read for hudi

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2749: - Epic Name: Streaming Read > Improve the streaming read for hudi > --- > >

[jira] [Updated] (HUDI-3007) Address minor feedbacks on the repair utility

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3007: - Parent: (was: HUDI-2906) Issue Type: Task (was: Sub-task) > Address minor feedbacks on the

[jira] [Updated] (HUDI-1658) [UMBRELLA] Spark Sql Support For Hudi

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1658: - Epic Name: Hudi Spark SQL > [UMBRELLA] Spark Sql Support For Hudi > -

[jira] [Updated] (HUDI-1292) [Umbrella] RFC-15 : File Listing and Query Planning Optimizations

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1292: - Epic Name: RFC-15 > [Umbrella] RFC-15 : File Listing and Query Planning Optimizations >

[jira] [Updated] (HUDI-1297) [Umbrella] Spark Datasource Support

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1297: - Epic Name: Hudi Spark Datasource > [Umbrella] Spark Datasource Support >

[jira] [Updated] (HUDI-2703) [RFC-37] Metadata based bloom index

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2703: - Issue Type: Epic (was: Improvement) > [RFC-37] Metadata based bloom index >

[jira] [Updated] (HUDI-2574) [UMBRELLA] Support for Hudi tables in presto-hive connector

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2574: - Issue Type: Epic (was: New Feature) > [UMBRELLA] Support for Hudi tables in presto-hive connector >

[jira] [Updated] (HUDI-2668) [UMBRELLA] upgrade libraries or dependency versions

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2668: - Issue Type: Epic (was: Improvement) > [UMBRELLA] upgrade libraries or dependency versions >

[jira] [Updated] (HUDI-1265) Followup Tasks for Bootstrap

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1265: - Issue Type: Epic (was: Improvement) > Followup Tasks for Bootstrap > > >

[jira] [Updated] (HUDI-1456) [UMBRELLA] Concurrent Writing (multiwriter) to Hudi tables

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1456: - Issue Type: Epic (was: New Feature) > [UMBRELLA] Concurrent Writing (multiwriter) to Hudi tables >

[jira] [Updated] (HUDI-1978) [UMBRELLA] Support for Hudi tables in trino-hive connector

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1978: - Issue Type: Epic (was: New Feature) > [UMBRELLA] Support for Hudi tables in trino-hive connector >

[jira] [Updated] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3054: - Parent: (was: HUDI-3053) Issue Type: Task (was: Sub-task) > Fix flaky

[jira] [Updated] (HUDI-3043) Test failure with TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3043: - Parent: (was: HUDI-3053) Issue Type: Task (was: Sub-task) > Test failure with >

[jira] [Updated] (HUDI-3052) Flaky TestJsonKafkaSource in CI runs

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3052: - Parent: (was: HUDI-3053) Issue Type: Task (was: Sub-task) > Flaky TestJsonKafkaSource in CI

[jira] [Updated] (HUDI-3052) Flaky TestJsonKafkaSource in CI runs

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3052: - Labels: pull-request-available sev:critical (was: hudi-subtask pull-request-available sev:critical) >

[jira] [Updated] (HUDI-1822) [Umbrella] Multi Modal Indexing

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1822: - Epic Name: RFC-27 > [Umbrella] Multi Modal Indexing > --- > >

[jira] [Deleted] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-3145: - > test > > > Key: HUDI-3145 > URL:

[jira] [Updated] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3145: - > test > > > Key: HUDI-3145 > URL:

[jira] [Deleted] (HUDI-3146) test sub task

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-3146: - > test sub task > - > > Key: HUDI-3146 > URL:

[jira] [Deleted] (HUDI-3128) [UMBRELLA] Test Hudi Epic

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-3128: - > [UMBRELLA] Test Hudi Epic > - > > Key: HUDI-3128 >

[jira] [Deleted] (HUDI-3129) Test Hudi Subtask

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-3129: - > Test Hudi Subtask > - > > Key: HUDI-3129 > URL:

[jira] [Updated] (HUDI-3145) test

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3145: - > test > > > Key: HUDI-3145 > URL:

[jira] [Updated] (HUDI-1292) [Umbrella] RFC-15 : File Listing and Query Planning Optimizations

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1292: - Epic Name: RFC-15 File Listing & Query Planning (was: RFC-15) > [Umbrella] RFC-15 : File Listing and

[jira] [Updated] (HUDI-1822) [Umbrella] Multi Modal Indexing

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1822: - Epic Name: RFC-27 Data Skipping (was: RFC-27) > [Umbrella] Multi Modal Indexing >

[jira] [Updated] (HUDI-2675) Not an Avro data file

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2675: - Priority: Critical (was: Blocker) > Not an Avro data file > - > >

[jira] [Created] (HUDI-3151) Docs for Spark SQL type support

2022-01-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3151: Summary: Docs for Spark SQL type support Key: HUDI-3151 URL: https://issues.apache.org/jira/browse/HUDI-3151 Project: Apache Hudi Issue Type: Task

[jira] [Commented] (HUDI-3151) Docs for Spark SQL type support

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468293#comment-17468293 ] Raymond Xu commented on HUDI-3151: --

[jira] [Updated] (HUDI-3139) Shade htrace and parquet-avro

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3139: - Priority: Critical (was: Blocker) > Shade htrace and parquet-avro > - > >

[jira] [Updated] (HUDI-2780) Mor reads the log file and skips the complete block as a bad block, resulting in data loss

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2780: - Priority: Critical (was: Blocker) > Mor reads the log file and skips the complete block as a bad block,

[jira] [Updated] (HUDI-3157) Shade aws-dependencies to avoid class conflicts

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3157: - Labels: sev:critical user-support-issues (was: user-support-issues) > Shade aws-dependencies to avoid

[jira] [Created] (HUDI-3157) Shade aws-dependencies to avoid class conflicts

2022-01-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3157: Summary: Shade aws-dependencies to avoid class conflicts Key: HUDI-3157 URL: https://issues.apache.org/jira/browse/HUDI-3157 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-3157) Shade aws-dependencies to avoid class conflicts

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3157: - Labels: user-support-issues (was: ) > Shade aws-dependencies to avoid class conflicts >

[jira] [Updated] (HUDI-3157) Shade aws-dependencies to avoid class conflicts

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3157: - Fix Version/s: 0.11.0 0.10.1 > Shade aws-dependencies to avoid class conflicts >

[jira] [Updated] (HUDI-3157) Shade aws-dependencies to avoid class conflicts

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3157: - Priority: Critical (was: Major) > Shade aws-dependencies to avoid class conflicts >

[jira] [Updated] (HUDI-3158) Reduce warn logs in Spark SQL INSERT OVERWRITE

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3158: - Epic Link: HUDI-1658 > Reduce warn logs in Spark SQL INSERT OVERWRITE >

[jira] [Updated] (HUDI-3158) Reduce warn logs in Spark SQL INSERT OVERWRITE

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3158: - Description: {code:java} 22/01/03 19:35:12 WARN ClusteringUtils: No content found in requested file for

[jira] [Updated] (HUDI-2519) [UMBRELLA] Seamless Hudi Hive Sync

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2519: - Epic Name: Improve Hive Sync > [UMBRELLA] Seamless Hudi Hive Sync > -- >

[jira] [Updated] (HUDI-3150) Refactor hive sync tool to optimize requests sent to HMS

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3150: - Description: (was: {quote}there are actually many requests to hms for check& sync: db/table exists,

[jira] [Commented] (HUDI-3150) Refactor hive sync tool to optimize requests sent to HMS

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468284#comment-17468284 ] Raymond Xu commented on HUDI-3150: -- {quote}there are actually many requests to hms for check& sync:

[jira] [Updated] (HUDI-3150) Refactor hive sync tool to optimize requests sent to HMS

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3150: - Description: {quote}there are actually many requests to hms for check& sync: db/table exists, table

[jira] [Updated] (HUDI-1456) [UMBRELLA] Concurrent Writing (multiwriter) to Hudi tables

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1456: - Epic Name: Multi-writer > [UMBRELLA] Concurrent Writing (multiwriter) to Hudi tables >

[jira] [Assigned] (HUDI-2711) Fallback to full table scan for IncrementalRelation and HoodieIncrSource when data file is missing.

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2711: Assignee: Jagmeet Bali > Fallback to full table scan for IncrementalRelation and HoodieIncrSource

[jira] [Updated] (HUDI-2100) [UMBRELLA] Support Space curve for hudi

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2100: - Epic Name: Space Curve > [UMBRELLA] Support Space curve for hudi >

[jira] [Created] (HUDI-3150) Refactor hive sync tool to optimize requests sent to HMS

2022-01-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3150: Summary: Refactor hive sync tool to optimize requests sent to HMS Key: HUDI-3150 URL: https://issues.apache.org/jira/browse/HUDI-3150 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-1859) [UMBRELLA] RFC - 14 : JDBC incremental puller

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1859: - Epic Name: RFC-14 > [UMBRELLA] RFC - 14 : JDBC incremental puller >

[jira] [Updated] (HUDI-1859) [UMBRELLA] RFC - 14 : JDBC incremental puller

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1859: - Epic Name: RFC-14 JDBC Incremental Puller (was: RFC-14) > [UMBRELLA] RFC - 14 : JDBC incremental puller

[jira] [Created] (HUDI-3158) Reduce warn logs in Spark SQL INSERT OVERWRITE

2022-01-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3158: Summary: Reduce warn logs in Spark SQL INSERT OVERWRITE Key: HUDI-3158 URL: https://issues.apache.org/jira/browse/HUDI-3158 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-3158) Reduce warn logs in Spark SQL INSERT OVERWRITE

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3158: - Component/s: Spark Integration > Reduce warn logs in Spark SQL INSERT OVERWRITE >

[jira] [Updated] (HUDI-3158) Reduce warn logs in Spark SQL INSERT OVERWRITE

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3158: - Labels: sev:normal (was: ) > Reduce warn logs in Spark SQL INSERT OVERWRITE >

[jira] [Updated] (HUDI-3158) Reduce warn logs in Spark SQL INSERT OVERWRITE

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3158: - Description: 22/01/03 19:35:12 WARN ClusteringUtils: No content found in requested file for instant

[jira] [Updated] (HUDI-2711) Fallback to full table scan for IncrementalRelation and HoodieIncrSource when data file is missing.

2022-01-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2711: - Reviewers: sivabalan narayanan > Fallback to full table scan for IncrementalRelation and HoodieIncrSource

[jira] [Updated] (HUDI-3135) Fix Show Partitions Command's Result after drop partition

2022-01-01 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3135: - Reviewers: Raymond Xu > Fix Show Partitions Command's Result after drop partition >

[jira] [Updated] (HUDI-3136) Fix merge/insert/show partitions error on Spark3.2

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3136: - Reviewers: Raymond Xu > Fix merge/insert/show partitions error on Spark3.2 >

[jira] [Updated] (HUDI-3136) Fix merge/insert/show partitions error on Spark3.2

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3136: - Status: In Progress (was: Open) > Fix merge/insert/show partitions error on Spark3.2 >

[jira] [Closed] (HUDI-3136) Fix merge/insert/show partitions error on Spark3.2

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3136. Resolution: Fixed > Fix merge/insert/show partitions error on Spark3.2 >

[jira] [Updated] (HUDI-3131) Spark3.1.1 CTAS error

2022-01-02 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3131: - Status: In Progress (was: Open) > Spark3.1.1 CTAS error > - > > Key:

[jira] [Updated] (HUDI-3135) Fix Show Partitions Command's Result after drop partition

2022-01-01 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3135: - Fix Version/s: 0.11.0 0.10.1 > Fix Show Partitions Command's Result after drop

[jira] [Commented] (HUDI-3131) Spark3.1.1 CTAS error

2022-01-01 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17467555#comment-17467555 ] Raymond Xu commented on HUDI-3131: -- Note: a separate PR against 0.10.1 branch is needed. > Spark3.1.1

[jira] [Updated] (HUDI-3136) Fix merge/insert/show partitions error on Spark3.2

2022-01-01 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3136: - Fix Version/s: (was: 0.10.1) > Fix merge/insert/show partitions error on Spark3.2 >

[jira] [Assigned] (HUDI-3136) Fix merge/insert/show partitions error on Spark3.2

2022-01-01 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3136: Assignee: Yann Byron > Fix merge/insert/show partitions error on Spark3.2 >

[jira] [Commented] (HUDI-2427) SQL stmt broken with spark 3.1.x

2021-12-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461963#comment-17461963 ] Raymond Xu commented on HUDI-2427: -- [~parisni] spark 3.1.x is not supported with hudi 0.9.0. closing

[jira] [Closed] (HUDI-2427) SQL stmt broken with spark 3.1.x

2021-12-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2427. Fix Version/s: 0.10.0 (was: 0.11.0) Reviewers: Raymond Xu Resolution:

[jira] [Commented] (HUDI-2426) spark sql extensions breaks read.table from metastore

2021-12-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461968#comment-17461968 ] Raymond Xu commented on HUDI-2426: -- [~parisni] can you share the create sql for that table? then we can

[jira] [Closed] (HUDI-3043) Test failure with TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters

2021-12-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3043. > Test failure with > TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters >

<    5   6   7   8   9   10   11   12   13   14   >