[jira] [Created] (HUDI-3539) Flink bucket index bucketID bootstrap optimization

2022-02-28 Thread Gary Li (Jira)
Gary Li created HUDI-3539: - Summary: Flink bucket index bucketID bootstrap optimization Key: HUDI-3539 URL: https://issues.apache.org/jira/browse/HUDI-3539 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-3537) Upgrade Hudi version on Impala

2022-02-28 Thread Gary Li (Jira)
Gary Li created HUDI-3537: - Summary: Upgrade Hudi version on Impala Key: HUDI-3537 URL: https://issues.apache.org/jira/browse/HUDI-3537 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-3315) Make Flink MOR table writer in a streaming way

2022-01-24 Thread Gary Li (Jira)
Gary Li created HUDI-3315: - Summary: Make Flink MOR table writer in a streaming way Key: HUDI-3315 URL: https://issues.apache.org/jira/browse/HUDI-3315 Project: Apache Hudi Issue Type: New Feature

[jira] [Assigned] (HUDI-2816) Unify file listing method of Spark/Flink/Hive

2021-12-20 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li reassigned HUDI-2816: - Assignee: XiaoyuGeng (was: Gary Li) > Unify file listing method of Spark/Flink/Hive >

[jira] [Commented] (HUDI-2941) Show _hoodie_operation in spark sql results

2021-12-06 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454355#comment-17454355 ] Gary Li commented on HUDI-2941: --- [~lsy] just added you to the contributor list and assigned this ticket to

[jira] [Assigned] (HUDI-2941) Show _hoodie_operation in spark sql results

2021-12-06 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li reassigned HUDI-2941: - Assignee: dalongliu > Show _hoodie_operation in spark sql results >

[jira] [Updated] (HUDI-2816) Unify file listing method of Spark/Flink/Hive

2021-11-21 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-2816: -- Labels: help-wanted sev:high (was: sev:high) > Unify file listing method of Spark/Flink/Hive >

[jira] [Updated] (HUDI-2816) Unify file listing method of Spark/Flink/Hive

2021-11-21 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-2816: -- Labels: sev:high (was: ) > Unify file listing method of Spark/Flink/Hive >

[jira] [Updated] (HUDI-2816) Unify file listing method of Spark/Flink/Hive

2021-11-21 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-2816: -- Description: Currently, different engines are using different file listing methods, which might lead to

[jira] [Created] (HUDI-2816) Unify file listing method of Spark/Flink/Hive

2021-11-21 Thread Gary Li (Jira)
Gary Li created HUDI-2816: - Summary: Unify file listing method of Spark/Flink/Hive Key: HUDI-2816 URL: https://issues.apache.org/jira/browse/HUDI-2816 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-2450) Make Flink MOR table writer in a streaming way

2021-09-18 Thread Gary Li (Jira)
Gary Li created HUDI-2450: - Summary: Make Flink MOR table writer in a streaming way Key: HUDI-2450 URL: https://issues.apache.org/jira/browse/HUDI-2450 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-2302) Enable Async Compaction Scheduling for Flink

2021-08-12 Thread Gary Li (Jira)
Gary Li created HUDI-2302: - Summary: Enable Async Compaction Scheduling for Flink Key: HUDI-2302 URL: https://issues.apache.org/jira/browse/HUDI-2302 Project: Apache Hudi Issue Type: New Feature

[jira] [Closed] (HUDI-1777) Add SparkDatasource support for delete_partition API

2021-08-11 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1777. - > Add SparkDatasource support for delete_partition API > > >

[jira] [Resolved] (HUDI-1777) Add SparkDatasource support for delete_partition API

2021-08-11 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1777. --- Fix Version/s: 0.9.0 Assignee: sivabalan narayanan (was: Aditya Tiwari) Resolution: Fixed >

[jira] [Created] (HUDI-2295) Add Flink Support for delete partition

2021-08-11 Thread Gary Li (Jira)
Gary Li created HUDI-2295: - Summary: Add Flink Support for delete partition Key: HUDI-2295 URL: https://issues.apache.org/jira/browse/HUDI-2295 Project: Apache Hudi Issue Type: New Feature

[jira] [Updated] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-25 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-2218: -- Description: Some HoodieWriteStat being compute during the runtime was lost(e.g. compute min event time in the

[jira] [Created] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-25 Thread Gary Li (Jira)
Gary Li created HUDI-2218: - Summary: Fix missing HoodieWriteStat in HoodieCreateHandle Key: HUDI-2218 URL: https://issues.apache.org/jira/browse/HUDI-2218 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-2217) Fix no value present in incremental query on MOR

2021-07-25 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-2217: -- Fix Version/s: 0.9.0 > Fix no value present in incremental query on MOR >

[jira] [Updated] (HUDI-2217) Fix no value present in incremental query on MOR

2021-07-25 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-2217: -- Status: In Progress (was: Open) > Fix no value present in incremental query on MOR >

[jira] [Created] (HUDI-2217) Fix no value present in incremental query on MOR

2021-07-24 Thread Gary Li (Jira)
Gary Li created HUDI-2217: - Summary: Fix no value present in incremental query on MOR Key: HUDI-2217 URL: https://issues.apache.org/jira/browse/HUDI-2217 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-2130) Close HoodieMergedLogRecordScanner after scan

2021-07-05 Thread Gary Li (Jira)
Gary Li created HUDI-2130: - Summary: Close HoodieMergedLogRecordScanner after scan Key: HUDI-2130 URL: https://issues.apache.org/jira/browse/HUDI-2130 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-2128) Refactor Flink MOR write in a streaming way

2021-07-04 Thread Gary Li (Jira)
Gary Li created HUDI-2128: - Summary: Refactor Flink MOR write in a streaming way Key: HUDI-2128 URL: https://issues.apache.org/jira/browse/HUDI-2128 Project: Apache Hudi Issue Type: Improvement

[jira] [Resolved] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2021-07-03 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1010. --- Resolution: Fixed > Fix the memory leak for hudi-client unit tests >

[jira] [Closed] (HUDI-1010) Fix the memory leak for hudi-client unit tests

2021-07-03 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1010. - > Fix the memory leak for hudi-client unit tests > -- > >

[jira] [Created] (HUDI-2056) Spark speculation may produce dirty parquet files

2021-06-22 Thread Gary Li (Jira)
Gary Li created HUDI-2056: - Summary: Spark speculation may produce dirty parquet files Key: HUDI-2056 URL: https://issues.apache.org/jira/browse/HUDI-2056 Project: Apache Hudi Issue Type: Bug

[jira] [Closed] (HUDI-1943) Lose properties when hoodieWriteConfig initializtion

2021-06-04 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1943. - > Lose properties when hoodieWriteConfig initializtion > > >

[jira] [Updated] (HUDI-1943) Lose properties when hoodieWriteConfig initializtion

2021-06-04 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1943: -- Fix Version/s: 0.9.0 > Lose properties when hoodieWriteConfig initializtion >

[jira] [Resolved] (HUDI-1943) Lose properties when hoodieWriteConfig initializtion

2021-06-04 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1943. --- Resolution: Fixed > Lose properties when hoodieWriteConfig initializtion >

[jira] [Assigned] (HUDI-1943) Lose properties when hoodieWriteConfig initializtion

2021-06-04 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li reassigned HUDI-1943: - Assignee: haoke > Lose properties when hoodieWriteConfig initializtion >

[jira] [Closed] (HUDI-1901) Not an Avro data file during archive

2021-05-13 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1901. - Resolution: Fixed > Not an Avro data file during archive > > >

[jira] [Updated] (HUDI-1901) Not an Avro data file during archive

2021-05-13 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1901: -- Description: https://github.com/apache/hudi/issues/2944 > Not an Avro data file during archive >

[jira] [Created] (HUDI-1901) Not an Avro data file during archive

2021-05-13 Thread Gary Li (Jira)
Gary Li created HUDI-1901: - Summary: Not an Avro data file during archive Key: HUDI-1901 URL: https://issues.apache.org/jira/browse/HUDI-1901 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-04-29 Thread Gary Li (Jira)
Gary Li created HUDI-1870: - Summary: Move spark avro serialization class into hudi repo Key: HUDI-1870 URL: https://issues.apache.org/jira/browse/HUDI-1870 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-1760) Incorrect Documentation for HoodieWriteConfigs

2021-04-07 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li reassigned HUDI-1760: - Assignee: Gary Li > Incorrect Documentation for HoodieWriteConfigs >

[jira] [Updated] (HUDI-73) Support vanilla Avro Kafka Source in HoodieDeltaStreamer

2021-04-07 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-73: Fix Version/s: (was: 0.8.0) 0.9.0 > Support vanilla Avro Kafka Source in HoodieDeltaStreamer >

[jira] [Closed] (HUDI-1347) Hbase index partition changes cause data duplication problems

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1347. - > Hbase index partition changes cause data duplication problems >

[jira] [Closed] (HUDI-1429) NPE HoodieMultiTableDeltaStreamer when using parquet DFS source

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1429. - > NPE HoodieMultiTableDeltaStreamer when using parquet DFS source >

[jira] [Closed] (HUDI-1594) Add support for clustering node and validating async operations

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1594. - > Add support for clustering node and validating async operations >

[jira] [Closed] (HUDI-1734) Hive sync script (run_sync_tool.sh) fails w/ ClassNotFoundError : org/apache/log4j/LogManager

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1734. - > Hive sync script (run_sync_tool.sh) fails w/ ClassNotFoundError : > org/apache/log4j/LogManager >

[jira] [Closed] (HUDI-1708) Add HiveMetastore URL based configs to allow for using locks with custom metastore URI's

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1708. - > Add HiveMetastore URL based configs to allow for using locks with custom > metastore URI's >

[jira] [Closed] (HUDI-1650) Improve AvroKafkaSource that it can take into account the schema evolution

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1650. - > Improve AvroKafkaSource that it can take into account the schema evolution >

[jira] [Closed] (HUDI-1367) Make delastreamer transition from dfsSouce to kafkasouce

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1367. - > Make delastreamer transition from dfsSouce to kafkasouce >

[jira] [Closed] (HUDI-1709) Improve lock config naming convention and add hive metastore uri config

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1709. - > Improve lock config naming convention and add hive metastore uri config >

[jira] [Closed] (HUDI-837) Fix AvroKafkaSource to use the latest schema for reading

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-837. > Fix AvroKafkaSource to use the latest schema for reading > >

[jira] [Closed] (HUDI-1642) Add Links to Uber engineering blog and meet up slides

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1642. - > Add Links to Uber engineering blog and meet up slides > - > >

[jira] [Closed] (HUDI-1279) Update Apache Hudi website docs to clarify the property of record_keys

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1279. - > Update Apache Hudi website docs to clarify the property of record_keys >

[jira] [Closed] (HUDI-1672) packaging fails w/ scala 12 (due to flink)

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1672. - > packaging fails w/ scala 12 (due to flink) > -- > > Key:

[jira] [Closed] (HUDI-73) Support vanilla Avro Kafka Source in HoodieDeltaStreamer

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-73. --- > Support vanilla Avro Kafka Source in HoodieDeltaStreamer > > >

[jira] [Closed] (HUDI-1703) Fix kafka auto offset reset config param key

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1703. - > Fix kafka auto offset reset config param key > > >

[jira] [Closed] (HUDI-1713) Fix config name for concurrency

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1713. - > Fix config name for concurrency > --- > > Key: HUDI-1713 >

[jira] [Closed] (HUDI-1269) Make whether the failure of connect hive affects hudi ingest process configurable

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1269. - > Make whether the failure of connect hive affects hudi ingest process > configurable >

[jira] [Closed] (HUDI-1525) TestHbaseIndex fails due to double startCommit() used

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1525. - > TestHbaseIndex fails due to double startCommit() used > - > >

[jira] [Closed] (HUDI-1568) Issues w/ spark_bundle_2.12 : NoSuchMethodError: 'void org.apache.spark.sql.execution.datasources.InMemoryFileIndex.

2021-04-05 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1568. - > Issues w/ spark_bundle_2.12 : NoSuchMethodError: 'void >

[jira] [Resolved] (HUDI-1728) Addressing ClassNotFound when using HiveMetastoreBasedLockProvider

2021-03-29 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1728. --- Resolution: Fixed > Addressing ClassNotFound when using HiveMetastoreBasedLockProvider >

[jira] [Closed] (HUDI-1728) Addressing ClassNotFound when using HiveMetastoreBasedLockProvider

2021-03-29 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1728. - > Addressing ClassNotFound when using HiveMetastoreBasedLockProvider >

[jira] [Updated] (HUDI-1728) Addressing ClassNotFound when using HiveMetastoreBasedLockProvider

2021-03-29 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1728: -- Fix Version/s: 0.8.0 > Addressing ClassNotFound when using HiveMetastoreBasedLockProvider >

[jira] [Created] (HUDI-1733) Support scala2.12 integration test

2021-03-28 Thread Gary Li (Jira)
Gary Li created HUDI-1733: - Summary: Support scala2.12 integration test Key: HUDI-1733 URL: https://issues.apache.org/jira/browse/HUDI-1733 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-1732) Support Spark3 integration test

2021-03-28 Thread Gary Li (Jira)
Gary Li created HUDI-1732: - Summary: Support Spark3 integration test Key: HUDI-1732 URL: https://issues.apache.org/jira/browse/HUDI-1732 Project: Apache Hudi Issue Type: Improvement

[jira] [Closed] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1521. - > [UMBRELLA] RFC-24 HUDI Flink writer proposal > > >

[jira] [Resolved] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1521. --- Resolution: Implemented > [UMBRELLA] RFC-24 HUDI Flink writer proposal >

[jira] [Updated] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1715: -- Description: In order to adapt to the new Flink writer, the executor needs to support: 1. specify the bucket

[jira] [Closed] (HUDI-1581) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1581. - Resolution: Duplicate > Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer >

[jira] [Created] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
Gary Li created HUDI-1715: - Summary: Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer Key: HUDI-1715 URL: https://issues.apache.org/jira/browse/HUDI-1715 Project: Apache Hudi

[jira] [Updated] (HUDI-1715) Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1715: -- Component/s: Flink Integration > Refactor the BaseFlinkCommitActionExecutor to adapt to the new Flink writer >

[jira] [Updated] (HUDI-1521) [UMBRELLA]HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Fix Version/s: 0.8.0 > [UMBRELLA]HUDI Flink writer proposal > > >

[jira] [Updated] (HUDI-1521) [UMBRELLA] RFC-24 HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Summary: [UMBRELLA] RFC-24 HUDI Flink writer proposal (was: [UMBRELLA]HUDI Flink writer proposal) >

[jira] [Updated] (HUDI-1521) [UMBRELLA]HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Summary: [UMBRELLA]HUDI Flink writer proposal (was: HUDI Flink writer proposal) > [UMBRELLA]HUDI Flink writer

[jira] [Updated] (HUDI-1521) HUDI Flink writer proposal

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1521: -- Issue Type: New Feature (was: Improvement) > HUDI Flink writer proposal > -- > >

[jira] [Updated] (HUDI-909) [UMBRELLA]Integrate hudi with flink engine

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-909: - Summary: [UMBRELLA]Integrate hudi with flink engine (was: Integrate hudi with flink engine) >

[jira] [Updated] (HUDI-909) Integrate hudi with flink engine

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-909: - Issue Type: New Feature (was: Task) > Integrate hudi with flink engine > > >

[jira] [Closed] (HUDI-1712) Standardize prefix for hoodie lock configs

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1712. - > Standardize prefix for hoodie lock configs > -- > > Key:

[jira] [Resolved] (HUDI-1712) Standardize prefix for hoodie lock configs

2021-03-24 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1712. --- Resolution: Resolved > Standardize prefix for hoodie lock configs >

[jira] [Updated] (HUDI-1310) Corruption Block Handling too slow in S3

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1310: -- Affects Version/s: (was: 0.8.0) > Corruption Block Handling too slow in S3 >

[jira] [Updated] (HUDI-1310) Corruption Block Handling too slow in S3

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1310: -- Affects Version/s: (was: 0.9.0) 0.8.0 > Corruption Block Handling too slow in S3 >

[jira] [Closed] (HUDI-1310) Corruption Block Handling too slow in S3

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1310. - > Corruption Block Handling too slow in S3 > > > Key:

[jira] [Updated] (HUDI-1310) Corruption Block Handling too slow in S3

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1310: -- Fix Version/s: (was: 0.9.0) 0.8.0 > Corruption Block Handling too slow in S3 >

[jira] [Resolved] (HUDI-1710) Read optimized query type for Flink batch reader

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li resolved HUDI-1710. --- Resolution: Implemented > Read optimized query type for Flink batch reader >

[jira] [Closed] (HUDI-1710) Read optimized query type for Flink batch reader

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li closed HUDI-1710. - > Read optimized query type for Flink batch reader > > >

[jira] [Updated] (HUDI-304) Bring back spotless plugin

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-304: - Fix Version/s: (was: 0.8.0) 0.9.0 > Bring back spotless plugin >

[jira] [Updated] (HUDI-837) Fix AvroKafkaSource to use the latest schema for reading

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-837: - Fix Version/s: (was: 0.8.0) 0.9.0 > Fix AvroKafkaSource to use the latest schema for

[jira] [Updated] (HUDI-1616) Abstract out one off operations within dag

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1616: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Abstract out one off operations within dag >

[jira] [Updated] (HUDI-1333) Introduce FlinkHoodieGlobalBloomIndex to hudi-flink-client

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1333: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Introduce FlinkHoodieGlobalBloomIndex to

[jira] [Updated] (HUDI-1127) Handling late arriving Deletes

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1127: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Handling late arriving Deletes >

[jira] [Updated] (HUDI-1172) Use OverwriteWithLatestAvroPayload as default payload class everywhere

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1172: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Use OverwriteWithLatestAvroPayload as default

[jira] [Updated] (HUDI-1256) Follow on improvements to HFile tables

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1256: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Follow on improvements to HFile tables >

[jira] [Updated] (HUDI-1677) Support Clustering and Metatable for SQL performance

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1677: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Support Clustering and Metatable for SQL performance

[jira] [Updated] (HUDI-1261) CLI tools update to support REPLACE and insert overwrite

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1261: -- Fix Version/s: (was: 0.8.0) 0.9.0 > CLI tools update to support REPLACE and insert

[jira] [Updated] (HUDI-1710) Read optimized query type for Flink batch reader

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1710: -- Status: In Progress (was: Open) > Read optimized query type for Flink batch reader >

[jira] [Updated] (HUDI-1120) Support spotless for scala

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1120: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Support spotless for scala >

[jira] [Updated] (HUDI-1015) Audit all getAllPartitionPaths() calls and keep em out of fast path

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1015: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Audit all getAllPartitionPaths() calls and keep em

[jira] [Updated] (HUDI-956) Test COW : Presto Realtime Query with metadata bootstrap

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-956: - Fix Version/s: (was: 0.8.0) 0.9.0 > Test COW : Presto Realtime Query with metadata

[jira] [Updated] (HUDI-1284) preCombine all HoodieRecords and update all fields(which is not DefaultValue) according to orderingVal

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1284: -- Fix Version/s: (was: 0.8.0) 0.9.0 > preCombine all HoodieRecords and update all

[jira] [Updated] (HUDI-1363) Provide Option to drop columns after they are used to generate partition or record keys

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1363: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Provide Option to drop columns after they are used

[jira] [Updated] (HUDI-945) Cleanup spillable map files eagerly as part of close

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-945: - Fix Version/s: (was: 0.8.0) 0.9.0 > Cleanup spillable map files eagerly as part of close >

[jira] [Updated] (HUDI-1264) incremental read support with replace

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1264: -- Fix Version/s: (was: 0.8.0) 0.9.0 > incremental read support with replace >

[jira] [Updated] (HUDI-1401) Presto use of Metadata Table for file listings

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1401: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Presto use of Metadata Table for file listings >

[jira] [Updated] (HUDI-1651) Fix archival of requested replace instants

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1651: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Fix archival of requested replace instants >

[jira] [Updated] (HUDI-1353) Incremental timeline support for pending clustering operations

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1353: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Incremental timeline support for pending clustering

[jira] [Updated] (HUDI-651) Incremental Query on Hive via Spark SQL does not return expected results

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-651: - Fix Version/s: (was: 0.8.0) 0.9.0 > Incremental Query on Hive via Spark SQL does not return

[jira] [Updated] (HUDI-1214) Need ability to set deltastreamer checkpoints when doing Spark datasource writes

2021-03-23 Thread Gary Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Li updated HUDI-1214: -- Fix Version/s: (was: 0.8.0) 0.9.0 > Need ability to set deltastreamer checkpoints when

  1   2   3   4   5   6   7   8   9   >