[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Labels: schema sev:high (was: AvroSchema sev:high) > Upsert of Case Class with single field causes

[jira] [Updated] (HUDI-1894) NULL values in timestamp column defaulted

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1894: - Labels: schema sev:high triaged (was: sev:high triaged) > NULL values in timestamp column defaulted >

[jira] [Updated] (HUDI-1689) Support Multipath query for HoodieFileIndex

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1689: - Labels: (was: sev:high) > Support Multipath query for HoodieFileIndex >

[jira] [Commented] (HUDI-1689) Support Multipath query for HoodieFileIndex

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417453#comment-17417453 ] Raymond Xu commented on HUDI-1689: -- [~pzw2018] to confirm, I think this is a feature enhancement to

[jira] [Updated] (HUDI-1271) Add utility scripts to perform Restores

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1271: - Parent: HUDI-1297 Issue Type: Sub-task (was: New Feature) > Add utility scripts to perform

[jira] [Updated] (HUDI-1272) Add utility scripts to manage Savepoints

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1272: - Parent: HUDI-1297 Issue Type: Sub-task (was: New Feature) > Add utility scripts to manage

[jira] [Updated] (HUDI-1491) Support partition pruning for MOR snapshot query

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1491: - Parent: HUDI-1297 Issue Type: Sub-task (was: Improvement) > Support partition pruning for MOR

[jira] [Updated] (HUDI-1278) Need a generic payload class which can skip late arriving data based on specific fields

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1278: - Component/s: (was: Spark Integration) > Need a generic payload class which can skip late arriving

[jira] [Updated] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1079: - Labels: schema sev:critical user-support-issues (was: sev:critical user-support-issues) > Cannot upsert

[jira] [Updated] (HUDI-893) Add spark datasource V2 reader support for Hudi tables

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-893: Parent Issue: HUDI-1297 (was: HUDI-30) > Add spark datasource V2 reader support for Hudi tables >

[jira] [Closed] (HUDI-1680) Add getPreferredLocations for RDD

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1680. Fix Version/s: (was: 0.10.0) Resolution: Won't Do Closing due to inactive > Add

[jira] [Updated] (HUDI-1608) MOR fetches all records for read optimized query w/ spark sql

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1608: - Labels: pull-request-available sev:critical (was: pull-request-available) > MOR fetches all records for

[jira] [Updated] (HUDI-1341) hudi cli command such as rollback 、bootstrap support spark sql implement

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1341: - Parent: HUDI-1297 Issue Type: Sub-task (was: New Feature) > hudi cli command such as rollback

[jira] [Updated] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1079: - Priority: Critical (was: Blocker) > Cannot upsert on schema with Array of Record with single field >

[jira] [Updated] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1079: - Priority: Blocker (was: Major) > Cannot upsert on schema with Array of Record with single field >

[jira] [Updated] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1079: - Labels: sev:critical user-support-issues (was: sev:high user-support-issues) > Cannot upsert on schema

[jira] [Updated] (HUDI-1608) MOR fetches all records for read optimized query w/ spark sql

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1608: - Priority: Critical (was: Major) > MOR fetches all records for read optimized query w/ spark sql >

[jira] [Updated] (HUDI-1297) [Umbrella] Revamp Spark Datasource support using Spark 3 APIs

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1297: - Priority: Critical (was: Major) > [Umbrella] Revamp Spark Datasource support using Spark 3 APIs >

[jira] [Updated] (HUDI-1292) [Umbrella] RFC-15 : File Listing and Query Planning Optimizations

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1292: - Priority: Critical (was: Major) > [Umbrella] RFC-15 : File Listing and Query Planning Optimizations >

[jira] [Updated] (HUDI-2390) Create table by hudisql,write data into table by datasource,hudi delete cmd can not delete data

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2390: - Priority: Critical (was: Major) > Create table by hudisql,write data into table by datasource,hudi

[jira] [Updated] (HUDI-2452) spark on hudi metadata key length < 0

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2452: - Labels: sev:critical (was: ) > spark on hudi metadata key length < 0 >

[jira] [Updated] (HUDI-2390) KeyGenerator discrepancy between DataFrame writer and Spark SQL

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2390: - Summary: KeyGenerator discrepancy between DataFrame writer and Spark SQL (was: Create table by

[jira] [Updated] (HUDI-2390) KeyGenerator discrepancy between DataFrame writer and Spark SQL

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2390: - Labels: (was: features) > KeyGenerator discrepancy between DataFrame writer and Spark SQL >

[jira] [Updated] (HUDI-1926) Concurrent write conflict when generating same instanttime

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1926: - Labels: sev:triage (was: ) > Concurrent write conflict when generating same instanttime >

[jira] [Updated] (HUDI-1368) Merge On Read Snapshot Reader not working for Databricks on ADLS Gen2

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1368: - Issue Type: Bug (was: New Feature) > Merge On Read Snapshot Reader not working for Databricks on ADLS

[jira] [Updated] (HUDI-1117) Add tdunning json library to spark and utilities bundle

2021-09-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1117: - Component/s: (was: Spark Integration) Hive Integration > Add tdunning json library

[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Labels: schema sev:high (was: schema sev sev:high) > Upsert of Case Class with single field causes

[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Priority: Critical (was: Major) > Upsert of Case Class with single field causes SchemaParseException >

[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Labels: schema sev sev:high (was: schema sev:high) > Upsert of Case Class with single field causes

[jira] [Updated] (HUDI-2071) Support Reading Bootstrap MOR RT Table In Spark DataSource Table

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2071: - Priority: Critical (was: Major) > Support Reading Bootstrap MOR RT Table In Spark DataSource Table >

[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Labels: schema sev:critical (was: schema sev:high) > Upsert of Case Class with single field causes

[jira] [Updated] (HUDI-1894) NULL values in timestamp column defaulted

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1894: - Priority: Critical (was: Major) > NULL values in timestamp column defaulted >

[jira] [Updated] (HUDI-1689) Support Multipath query for HoodieFileIndex

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1689: - Priority: Critical (was: Major) > Support Multipath query for HoodieFileIndex >

[jira] [Updated] (HUDI-1307) spark datasource load path format is confused for snapshot and increment read mode

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1307: - Priority: Critical (was: Major) > spark datasource load path format is confused for snapshot and

[jira] [Updated] (HUDI-1307) spark datasource load path format is confused for snapshot and increment read mode

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1307: - Labels: sev:high user-support-issues (was: sev:normal user-support-issues) > spark datasource load path

[jira] [Closed] (HUDI-30) Explore support for Spark Datasource V2

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-30. -- Resolution: Duplicate > Explore support for Spark Datasource V2 > --- > >

[jira] [Updated] (HUDI-1689) Support Multipath query for HoodieFileIndex

2021-09-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1689: - Parent: HUDI-1658 Issue Type: Sub-task (was: Improvement) > Support Multipath query for

[jira] [Updated] (HUDI-904) Segregate metrics configs by reporter type

2021-09-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-904: Labels: newbie (was: ) > Segregate metrics configs by reporter type >

[jira] [Updated] (HUDI-1071) Upgrade dropwizard metrics to make use of SettableGauge

2021-09-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1071: - Labels: newbie (was: ) > Upgrade dropwizard metrics to make use of SettableGauge >

[jira] [Resolved] (HUDI-1702) TestHoodieMergeOnReadTable.init fails randomly on Travis CI

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1702. -- Fix Version/s: 0.10.0 Resolution: Fixed Fixed in https://issues.apache.org/jira/browse/HUDI-1989

[jira] [Closed] (HUDI-1702) TestHoodieMergeOnReadTable.init fails randomly on Travis CI

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1702. > TestHoodieMergeOnReadTable.init fails randomly on Travis CI >

[jira] [Closed] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2357. > MERGE INTO doesn't work for tables created using CTAS > -

[jira] [Resolved] (HUDI-2357) MERGE INTO doesn't work for tables created using CTAS

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2357. -- Resolution: Fixed > MERGE INTO doesn't work for tables created using CTAS >

[jira] [Commented] (HUDI-2387) Too many HEAD requests from Hudi to S3

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413595#comment-17413595 ] Raymond Xu commented on HUDI-2387: -- [~uditme] would you raise this to AWS team please? > Too many HEAD

[jira] [Resolved] (HUDI-2408) Deprecate FunctionalTestHarness to avoid init DFS

2021-09-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2408. -- Resolution: Done > Deprecate FunctionalTestHarness to avoid init DFS >

[jira] [Closed] (HUDI-2408) Deprecate FunctionalTestHarness to avoid init DFS

2021-09-09 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2408. > Deprecate FunctionalTestHarness to avoid init DFS > - > >

[jira] [Closed] (HUDI-2398) Event Time not getting updated for inserts

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2398. > Event Time not getting updated for inserts > -- > >

[jira] [Resolved] (HUDI-2398) Event Time not getting updated for inserts

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2398. -- Resolution: Fixed > Event Time not getting updated for inserts >

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Component/s: Common Core > parquet schema conflict: optional binary (UTF8) is not a group >

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Labels: sev:high user-support-issues (was: sevv:high user-support-issues) > parquet schema conflict:

[jira] [Commented] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413648#comment-17413648 ] Raymond Xu commented on HUDI-864: - [~vinoth] the parquet version is upgraded in spark 3.2.0-rc2

[jira] [Closed] (HUDI-2190) Unnecessary exception catch in SparkBulkInsertPreppedCommitActionExecutor#execute

2021-09-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2190. Resolution: Won't Do > Unnecessary exception catch in > SparkBulkInsertPreppedCommitActionExecutor#execute

[jira] [Created] (HUDI-2280) Azure CI build and test different spark and scala versions

2021-08-05 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2280: Summary: Azure CI build and test different spark and scala versions Key: HUDI-2280 URL: https://issues.apache.org/jira/browse/HUDI-2280 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-2280) Azure CI build and test different spark and scala versions

2021-08-05 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2280: - Description: Migrate to test with Spark 3 + Scala 2.12 Additional build task for Spark 2 + Scala 2.11  

[jira] [Reopened] (HUDI-2081) Move TestHiveSyncTool to functional

2021-08-07 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-2081: -- Assignee: (was: Raymond Xu) > Move TestHiveSyncTool to functional >

[jira] [Resolved] (HUDI-393) Integrate with Azure Pipeline run the end to end tests

2021-08-07 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-393. - Resolution: Done > Integrate with Azure Pipeline run the end to end tests >

[jira] [Resolved] (HUDI-1985) Website re-design implementation

2021-08-07 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-1985. -- Resolution: Done > Website re-design implementation > > >

[jira] [Commented] (HUDI-2081) Move TestHiveSyncTool to functional

2021-08-07 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395455#comment-17395455 ] Raymond Xu commented on HUDI-2081: -- WIP half way then ran into conflicts. Pause the work now. > Move

[jira] [Commented] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable

2021-08-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395566#comment-17395566 ] Raymond Xu commented on HUDI-1989: --   {code:java} [ERROR] Errors: [ERROR]

[jira] [Comment Edited] (HUDI-1989) Flaky test : TestHoodieMergeOnReadTable

2021-08-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395566#comment-17395566 ] Raymond Xu edited comment on HUDI-1989 at 8/8/21, 7:10 PM: ---

[jira] [Updated] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2021-09-23 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-29: --- Description: [https://github.com/uber/hudi/issues/393]   Similar request 

[jira] [Updated] (HUDI-2582) Fix concurrent key generations for bulk insert row writer path

2021-10-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2582: - Status: In Progress (was: Open) > Fix concurrent key generations for bulk insert row writer path >

[jira] [Updated] (HUDI-2550) Add support to configure no of small files to consider with MOR

2021-10-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2550: - Description: Looks like in MOR, when an index is used which cannot index log files (which is the case

[jira] [Updated] (HUDI-2582) Fix concurrent key generations for bulk insert row writer path

2021-10-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2582: - Issue Type: Bug (was: Improvement) > Fix concurrent key generations for bulk insert row writer path >

[jira] [Updated] (HUDI-2582) Fix concurrent key generations for bulk insert row writer path

2021-10-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2582: - Fix Version/s: 0.10.0 > Fix concurrent key generations for bulk insert row writer path >

[jira] [Updated] (HUDI-2580) Ability to clean up dangling data files using hudi-cli

2021-10-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2580: - Labels: sev:normal user-support-issues (was: ) > Ability to clean up dangling data files using hudi-cli

[jira] [Updated] (HUDI-2259) [SQL]Support referencing subquery with column aliases by table alias in merge into

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2259: - Status: In Progress (was: Open) > [SQL]Support referencing subquery with column aliases by table alias

[jira] [Closed] (HUDI-2259) [SQL]Support referencing subquery with column aliases by table alias in merge into

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2259. > [SQL]Support referencing subquery with column aliases by table alias in merge > into >

[jira] [Updated] (HUDI-2482) Support drop partitions SQL

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2482: - Status: In Progress (was: Open) > Support drop partitions SQL > --- > >

[jira] [Resolved] (HUDI-2482) Support drop partitions SQL

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2482. -- Resolution: Implemented > Support drop partitions SQL > --- > >

[jira] [Closed] (HUDI-2482) Support drop partitions SQL

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2482. > Support drop partitions SQL > --- > > Key: HUDI-2482 >

[jira] [Resolved] (HUDI-2259) [SQL]Support referencing subquery with column aliases by table alias in merge into

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2259. -- Resolution: Done > [SQL]Support referencing subquery with column aliases by table alias in merge >

[jira] [Resolved] (HUDI-2343) Fix the exception for mergeInto when the primaryKey and preCombineField of source table and target table differ in case only

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2343. -- Resolution: Fixed > Fix the exception for mergeInto when the primaryKey and preCombineField of >

[jira] [Updated] (HUDI-2343) Fix the exception for mergeInto when the primaryKey and preCombineField of source table and target table differ in case only

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2343: - Status: In Progress (was: Open) > Fix the exception for mergeInto when the primaryKey and

[jira] [Closed] (HUDI-2343) Fix the exception for mergeInto when the primaryKey and preCombineField of source table and target table differ in case only

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2343. > Fix the exception for mergeInto when the primaryKey and preCombineField of > source table and target table

[jira] [Resolved] (HUDI-2456) Support show partitions SQL

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2456. -- Resolution: Implemented > Support show partitions SQL > --- > >

[jira] [Closed] (HUDI-2456) Support show partitions SQL

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2456. > Support show partitions SQL > --- > > Key: HUDI-2456 >

[jira] [Assigned] (HUDI-2339) Create Table If Not Exists Failed After Alter Table

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2339: Assignee: pengzhiwei > Create Table If Not Exists Failed After Alter Table >

[jira] [Updated] (HUDI-2339) Create Table If Not Exists Failed After Alter Table

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2339: - Status: In Progress (was: Open) > Create Table If Not Exists Failed After Alter Table >

[jira] [Resolved] (HUDI-2339) Create Table If Not Exists Failed After Alter Table

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2339. -- Resolution: Fixed > Create Table If Not Exists Failed After Alter Table >

[jira] [Closed] (HUDI-2339) Create Table If Not Exists Failed After Alter Table

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2339. > Create Table If Not Exists Failed After Alter Table > --- > >

[jira] [Commented] (HUDI-2470) use commit_time in the WHERE STATEMENT to optimize the incremental query

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432252#comment-17432252 ] Raymond Xu commented on HUDI-2470: -- [~David_Liang] any chance you could put up an early version of the PR

[jira] [Assigned] (HUDI-1885) Support Delete/Update Non-Pk Table

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1885: Assignee: (was: Raymond Xu) > Support Delete/Update Non-Pk Table >

[jira] [Updated] (HUDI-2234) MERGE INTO works only ON primary key

2021-10-21 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2234: - Component/s: Spark Integration > MERGE INTO works only ON primary key >

[jira] [Updated] (HUDI-2429) [UMBRELLA] Comprehensive Schema evolution in Hudi

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2429: - Summary: [UMBRELLA] Comprehensive Schema evolution in Hudi (was: Comprehensive Schema evolution in Hudi)

[jira] [Created] (HUDI-2577) Support schema evolution in Flink CDC writer

2021-10-19 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2577: Summary: Support schema evolution in Flink CDC writer Key: HUDI-2577 URL: https://issues.apache.org/jira/browse/HUDI-2577 Project: Apache Hudi Issue Type: New

[jira] [Assigned] (HUDI-2509) OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2509: Assignee: Adam Z CHEN > OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data

[jira] [Commented] (HUDI-2575) [UMBRELLA] Revamp CI bot

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17430593#comment-17430593 ] Raymond Xu commented on HUDI-2575: -- [~shivnarayan] Another point: if Jira components and labels aligned

[jira] [Assigned] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2077: Assignee: Raymond Xu (was: Sagar Sumit) > Flaky test: TestHoodieDeltaStreamer >

[jira] [Updated] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2077: - Description: {code:java} [INFO] Results:8520[INFO] 8521[ERROR] Errors: 8522[ERROR]

[jira] [Updated] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2077: - Status: In Progress (was: Open) > Flaky test: TestHoodieDeltaStreamer >

[jira] [Updated] (HUDI-2077) Flaky test: TestHoodieDeltaStreamer

2021-10-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2077: - Description: {code:java} [INFO] Results:8520[INFO] 8521[ERROR] Errors: 8522[ERROR]

[jira] [Assigned] (HUDI-2531) [UMBRELLA] Support Dataset APIs in writer paths

2021-10-08 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2531: Assignee: Raymond Xu > [UMBRELLA] Support Dataset APIs in writer paths >

[jira] [Created] (HUDI-2575) [UMBRELLA] Revamp CI bot

2021-10-18 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2575: Summary: [UMBRELLA] Revamp CI bot Key: HUDI-2575 URL: https://issues.apache.org/jira/browse/HUDI-2575 Project: Apache Hudi Issue Type: New Feature

[jira] [Updated] (HUDI-2575) [UMBRELLA] Revamp CI bot

2021-10-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2575: - Component/s: Testing > [UMBRELLA] Revamp CI bot > - > > Key:

[jira] [Commented] (HUDI-2575) [UMBRELLA] Revamp CI bot

2021-10-18 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17430073#comment-17430073 ] Raymond Xu commented on HUDI-2575: -- from [~codope] {quote}c) Apart from what you have already listed, may

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

2021-09-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Component/s: Spark Integration > parquet schema conflict: optional binary (UTF8) is not a group >

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

2021-09-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Labels: sev:critical user-support-issues (was: sev:high user-support-issues) > parquet schema conflict:

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

2021-09-26 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Priority: Blocker (was: Major) > parquet schema conflict: optional binary (UTF8) is not a group >

[jira] [Created] (HUDI-2492) Clean up components and GitHub labels

2021-09-26 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-2492: Summary: Clean up components and GitHub labels Key: HUDI-2492 URL: https://issues.apache.org/jira/browse/HUDI-2492 Project: Apache Hudi Issue Type: Task

<    1   2   3   4   5   6   7   8   9   10   >