[jira] [Updated] (HUDI-7358) Support more metadata services

2024-01-29 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-7358: Description: Currently, jdbc catalog is supported. We may need more catalog support. hivecatalog, rest

[jira] [Created] (HUDI-7358) Support more metadata services

2024-01-29 Thread liujinhui (Jira)
liujinhui created HUDI-7358: --- Summary: Support more metadata services Key: HUDI-7358 URL: https://issues.apache.org/jira/browse/HUDI-7358 Project: Apache Hudi Issue Type: New Feature

[jira] [Assigned] (HUDI-4451) Multiple writer using insert_overwrite loses some hive partitions

2022-07-22 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-4451: --- Assignee: liujinhui > Multiple writer using insert_overwrite loses some hive partitions >

[jira] [Updated] (HUDI-4451) Multiple writer using insert_overwrite loses some hive partitions

2022-07-22 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4451: Status: In Progress (was: Open) > Multiple writer using insert_overwrite loses some hive partitions >

[jira] [Updated] (HUDI-4451) Multiple writer using insert_overwrite loses some hive partitions

2022-07-22 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4451: Description: At that time, hudi was used to write concurrently, with multiple writers. Sync to hive, find

[jira] [Updated] (HUDI-4451) Multiple writer sync hive using insert_overwrite loses some partitions

2022-07-22 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4451: Summary: Multiple writer sync hive using insert_overwrite loses some partitions (was: Multiple writer hive

[jira] [Updated] (HUDI-4451) Multiple writer using insert_overwrite loses some hive partitions

2022-07-22 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4451: Summary: Multiple writer using insert_overwrite loses some hive partitions (was: Multiple writer sync hive

[jira] [Created] (HUDI-4451) Multiple writer hive using insert_overwrite loses some partitions

2022-07-22 Thread liujinhui (Jira)
liujinhui created HUDI-4451: --- Summary: Multiple writer hive using insert_overwrite loses some partitions Key: HUDI-4451 URL: https://issues.apache.org/jira/browse/HUDI-4451 Project: Apache Hudi

[jira] [Updated] (HUDI-4412) Multiple writers NPE when Insert_overwrite

2022-07-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4412: Summary: Multiple writers NPE when Insert_overwrite (was: Concurrent write Insert overwrite NPE) >

[jira] [Created] (HUDI-4412) Concurrent write Insert overwrite NPE

2022-07-18 Thread liujinhui (Jira)
liujinhui created HUDI-4412: --- Summary: Concurrent write Insert overwrite NPE Key: HUDI-4412 URL: https://issues.apache.org/jira/browse/HUDI-4412 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-4409) LockManager improve wait time logic

2022-07-17 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4409: Description: {code:java} //public void lock() { if

[jira] [Created] (HUDI-4409) LockManager improve wait time logic

2022-07-17 Thread liujinhui (Jira)
liujinhui created HUDI-4409: --- Summary: LockManager improve wait time logic Key: HUDI-4409 URL: https://issues.apache.org/jira/browse/HUDI-4409 Project: Apache Hudi Issue Type: Improvement

[jira] [Commented] (HUDI-2197) Replace ConfigOptions with ConfigProperty for FlinkOptions

2022-05-20 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17540001#comment-17540001 ] liujinhui commented on HUDI-2197: - Most of it has been done. Need to wait for the Config RFC to appear and

[jira] (HUDI-2197) Replace ConfigOptions with ConfigProperty for FlinkOptions

2022-05-20 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2197 ] liujinhui deleted comment on HUDI-2197: - was (Author: liujinhui): There are many places that need to be changed, and it may take a while. I have started modifying the content of a module today.

[jira] [Updated] (HUDI-3555) re-use spark config for parquet timestamp format instead of having our own config

2022-05-19 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3555: Status: In Progress (was: Open) > re-use spark config for parquet timestamp format instead of having our

[jira] [Commented] (HUDI-2197) Replace ConfigOptions with ConfigProperty for FlinkOptions

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17538704#comment-17538704 ] liujinhui commented on HUDI-2197: - There are many places that need to be changed, and it may take a while.

[jira] [Closed] (HUDI-4120) Split FlinkOptions to HiveConfigProperty

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui closed HUDI-4120. --- Resolution: Duplicate > Split FlinkOptions to HiveConfigProperty > >

[jira] [Updated] (HUDI-2197) Replace ConfigOptions with ConfigProperty for FlinkOptions

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2197: Status: In Progress (was: Open) > Replace ConfigOptions with ConfigProperty for FlinkOptions >

[jira] [Closed] (HUDI-4115) Replace Configuration in Flink with HoodieConfig

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui closed HUDI-4115. --- Resolution: Duplicate > Replace Configuration in Flink with HoodieConfig >

[jira] [Updated] (HUDI-4115) Replace Configuration in Flink with HoodieConfig

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4115: Summary: Replace Configuration in Flink with HoodieConfig (was: Split FlinkOptions to HiveConfigProperty

[jira] [Updated] (HUDI-4120) Split FlinkOptions to HiveConfigProperty

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4120: Description: (was: To complete HUDI-2197, we first need to replace Flink Configuration with

[jira] [Updated] (HUDI-4115) Replace Configuration in Flink with HoodieConfig

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4115: Description: To complete HUDI-2197, we first need to replace Flink Configuration with HoodieConfig. Here is

[jira] [Updated] (HUDI-4120) Split FlinkOptions to HiveConfigProperty

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4120: Summary: Split FlinkOptions to HiveConfigProperty (was: Replace Configuration in Flink with HoodieConfig)

[jira] [Updated] (HUDI-4120) Replace Configuration in Flink with HoodieConfig

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-4120: Description: To complete HUDI-2197, we first need to replace Flink Configuration with HoodieConfig. Here is

[jira] [Assigned] (HUDI-4120) Replace Configuration in Flink with HoodieConfig

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-4120: --- Assignee: liujinhui > Replace Configuration in Flink with HoodieConfig >

[jira] [Assigned] (HUDI-4115) Split FlinkOptions to HiveConfigProperty

2022-05-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-4115: --- Assignee: liujinhui > Split FlinkOptions to HiveConfigProperty >

[jira] [Created] (HUDI-4120) Replace Configuration in Flink with HoodieConfig

2022-05-18 Thread liujinhui (Jira)
liujinhui created HUDI-4120: --- Summary: Replace Configuration in Flink with HoodieConfig Key: HUDI-4120 URL: https://issues.apache.org/jira/browse/HUDI-4120 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-4115) Split FlinkOptions to HiveConfigProperty

2022-05-17 Thread liujinhui (Jira)
liujinhui created HUDI-4115: --- Summary: Split FlinkOptions to HiveConfigProperty Key: HUDI-4115 URL: https://issues.apache.org/jira/browse/HUDI-4115 Project: Apache Hudi Issue Type: Sub-task

[jira] [Reopened] (HUDI-2150) Rename/Restructure configs for better modularity

2022-05-17 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reopened HUDI-2150: - > Rename/Restructure configs for better modularity > > >

[jira] [Resolved] (HUDI-2150) Rename/Restructure configs for better modularity

2022-05-17 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui resolved HUDI-2150. - > Rename/Restructure configs for better modularity > > >

[jira] [Closed] (HUDI-3765) Structured streaming MOR/COW table can not asynchronous clean

2022-04-01 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui closed HUDI-3765. --- Resolution: Cannot Reproduce > Structured streaming MOR/COW table can not asynchronous clean >

[jira] [Updated] (HUDI-3765) Structured streaming MOR/COW table can not asynchronous clean

2022-04-01 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Summary: Structured streaming MOR/COW table can not asynchronous clean (was: Structured streaming MOR

[jira] [Updated] (HUDI-3765) Structured streaming MOR table can not asynchronous clean

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Affects Version/s: 0.11.0 > Structured streaming MOR table can not asynchronous clean >

[jira] [Updated] (HUDI-3765) structured streaming MOR table can not asynchronous clean

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Summary: structured streaming MOR table can not asynchronous clean (was: structured streaming MOR table

[jira] [Updated] (HUDI-3765) Structured streaming MOR table can not asynchronous clean

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Summary: Structured streaming MOR table can not asynchronous clean (was: structured streaming MOR table

[jira] [Updated] (HUDI-3765) structured streaming MOR table can not clean

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Summary: structured streaming MOR table can not clean (was: structured streaming MOR table) > structured

[jira] [Updated] (HUDI-3765) structured streaming MOR table

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Summary: structured streaming MOR table (was: Can not clean asynchronously) > structured streaming MOR

[jira] [Updated] (HUDI-3765) Can not clean asynchronously

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Description: When writing to the mor table using structured streaming, when the asynchronous clean service

[jira] [Updated] (HUDI-3765) Can not clean asynchronously

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Description: When writing to the mor table using structured streaming, when the asynchronous clean service

[jira] [Updated] (HUDI-3765) Can not clean asynchronously

2022-03-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3765: Description: When writing to the mor table using structured streaming, when the asynchronous clean service

[jira] [Created] (HUDI-3765) Can not clean asynchronously

2022-03-31 Thread liujinhui (Jira)
liujinhui created HUDI-3765: --- Summary: Can not clean asynchronously Key: HUDI-3765 URL: https://issues.apache.org/jira/browse/HUDI-3765 Project: Apache Hudi Issue Type: Bug Reporter:

[jira] [Updated] (HUDI-3615) Replace List with HoodieData in HoodieFlink/JavaTable and commit executors

2022-03-21 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3615: Summary: Replace List with HoodieData in HoodieFlink/JavaTable and commit executors (was: Replace RDD with

[jira] [Commented] (HUDI-3615) Replace RDD with HoodieData in HoodieFlink/JavaTable and commit executors

2022-03-14 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506050#comment-17506050 ] liujinhui commented on HUDI-3615: - I want to finish it, can you assign it to me [~xushiyan]  > Replace

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3583: Affects Version/s: (was: 0.11.0) > MarkerBasedRollbackStrategy NoSuchElementException >

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3583: Affects Version/s: 0.11.0 > MarkerBasedRollbackStrategy NoSuchElementException >

[jira] [Updated] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-3583: Priority: Blocker (was: Major) > MarkerBasedRollbackStrategy NoSuchElementException >

[jira] [Created] (HUDI-3583) MarkerBasedRollbackStrategy NoSuchElementException

2022-03-08 Thread liujinhui (Jira)
liujinhui created HUDI-3583: --- Summary: MarkerBasedRollbackStrategy NoSuchElementException Key: HUDI-3583 URL: https://issues.apache.org/jira/browse/HUDI-3583 Project: Apache Hudi Issue Type: Bug

[jira] [Closed] (HUDI-3182) Support parquet modular encryption

2022-01-05 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui closed HUDI-3182. --- Resolution: Duplicate > Support parquet modular encryption > -- > >

[jira] [Created] (HUDI-3182) Support parquet modular encryption

2022-01-05 Thread liujinhui (Jira)
liujinhui created HUDI-3182: --- Summary: Support parquet modular encryption Key: HUDI-3182 URL: https://issues.apache.org/jira/browse/HUDI-3182 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-3133) Add partition-level num groups control in PartitionAwareClusteringPlanStrategy

2021-12-31 Thread liujinhui (Jira)
liujinhui created HUDI-3133: --- Summary: Add partition-level num groups control in PartitionAwareClusteringPlanStrategy Key: HUDI-3133 URL: https://issues.apache.org/jira/browse/HUDI-3133 Project: Apache

[jira] [Updated] (HUDI-2594) Upgrade parquet version 1.12.1

2021-10-25 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2594: Summary: Upgrade parquet version 1.12.1 (was: Upgrade parquet version 1.12.0) > Upgrade parquet version

[jira] [Created] (HUDI-2594) Upgrade parquet version 1.12.0

2021-10-21 Thread liujinhui (Jira)
liujinhui created HUDI-2594: --- Summary: Upgrade parquet version 1.12.0 Key: HUDI-2594 URL: https://issues.apache.org/jira/browse/HUDI-2594 Project: Apache Hudi Issue Type: Improvement

[jira] [Assigned] (HUDI-2137) Make hudi examples runnable locally

2021-10-19 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2137: --- Assignee: (was: liujinhui) > Make hudi examples runnable locally >

[jira] [Created] (HUDI-2504) Add configuration to make HoodieBootstrap support ignoring file suffix

2021-09-30 Thread liujinhui (Jira)
liujinhui created HUDI-2504: --- Summary: Add configuration to make HoodieBootstrap support ignoring file suffix Key: HUDI-2504 URL: https://issues.apache.org/jira/browse/HUDI-2504 Project: Apache Hudi

[jira] [Assigned] (HUDI-2434) Add GraphiteReporter reporter periodSeconds config

2021-09-15 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2434: --- Assignee: liujinhui > Add GraphiteReporter reporter periodSeconds config >

[jira] [Comment Edited] (HUDI-2434) Add GraphiteReporter reporter periodSeconds config

2021-09-15 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415356#comment-17415356 ] liujinhui edited comment on HUDI-2434 at 9/15/21, 7:36 AM: ---

[jira] [Commented] (HUDI-2434) Add GraphiteReporter reporter periodSeconds config

2021-09-15 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415356#comment-17415356 ] liujinhui commented on HUDI-2434: - [https://github.com/apache/hudi/issues/3665 If a user asks a question,

[jira] [Created] (HUDI-2434) Add GraphiteReporter reporter periodSeconds config

2021-09-15 Thread liujinhui (Jira)
liujinhui created HUDI-2434: --- Summary: Add GraphiteReporter reporter periodSeconds config Key: HUDI-2434 URL: https://issues.apache.org/jira/browse/HUDI-2434 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-2423) Breakdown HoodieMetricsConfig into HoodieMetricsGraphiteConfig、HoodieMetricsJmxConfig...

2021-09-15 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2423: Summary: Breakdown HoodieMetricsConfig into HoodieMetricsGraphiteConfig、HoodieMetricsJmxConfig... (was:

[jira] [Commented] (HUDI-2425) TestHoodieMultiTableDeltaStreamer CI failed due to exception

2021-09-14 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415301#comment-17415301 ] liujinhui commented on HUDI-2425: - 35a04c43a5c750d265e855b313a84a5135075225    merge into master  >

[jira] [Resolved] (HUDI-2425) TestHoodieMultiTableDeltaStreamer CI failed due to exception

2021-09-14 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui resolved HUDI-2425. - Resolution: Fixed > TestHoodieMultiTableDeltaStreamer CI failed due to exception >

[jira] [Assigned] (HUDI-2425) TestHoodieMultiTableDeltaStreamer CI failed due to exception

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2425: --- Assignee: liujinhui > TestHoodieMultiTableDeltaStreamer CI failed due to exception >

[jira] [Updated] (HUDI-2425) TestHoodieMultiTableDeltaStreamer CI failed due to exception

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2425: Description: CI . ERROR [ERROR] Failures: [ERROR]

[jira] [Created] (HUDI-2425) TestHoodieMultiTableDeltaStreamer CI failed due to exception

2021-09-13 Thread liujinhui (Jira)
liujinhui created HUDI-2425: --- Summary: TestHoodieMultiTableDeltaStreamer CI failed due to exception Key: HUDI-2425 URL: https://issues.apache.org/jira/browse/HUDI-2425 Project: Apache Hudi Issue

[jira] [Commented] (HUDI-1362) Make deltastreamer support full overwrite

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414068#comment-17414068 ] liujinhui commented on HUDI-1362: - [~Pratyaksh] sure thanks. > Make deltastreamer support full overwrite

[jira] [Updated] (HUDI-1362) Make deltastreamer support insert_overwrite

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1362: Summary: Make deltastreamer support insert_overwrite (was: Make deltastreamer support full overwrite) >

[jira] [Commented] (HUDI-1239) [UMBRELLA] Config clean up

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414039#comment-17414039 ] liujinhui commented on HUDI-1239: - https://issues.apache.org/jira/browse/HUDI-2423 This issue should also

[jira] [Commented] (HUDI-1239) [UMBRELLA] Config clean up

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414037#comment-17414037 ] liujinhui commented on HUDI-1239: - Categorized here > [UMBRELLA] Config clean up >

[jira] [Issue Comment Deleted] (HUDI-1239) [UMBRELLA] Config clean up

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1239: Comment: was deleted (was: Categorized here) > [UMBRELLA] Config clean up > -- > >

[jira] [Assigned] (HUDI-2423) Breakdown HoodieMetricsConfig into HoodieMetricsGraphiteConfig...

2021-09-13 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2423: --- Assignee: liujinhui > Breakdown HoodieMetricsConfig into HoodieMetricsGraphiteConfig... >

[jira] [Created] (HUDI-2423) Breakdown HoodieMetricsConfig into HoodieMetricsGraphiteConfig...

2021-09-13 Thread liujinhui (Jira)
liujinhui created HUDI-2423: --- Summary: Breakdown HoodieMetricsConfig into HoodieMetricsGraphiteConfig... Key: HUDI-2423 URL: https://issues.apache.org/jira/browse/HUDI-2423 Project: Apache Hudi

[jira] [Commented] (HUDI-2414) enable Hot and cold data separate when ingest data

2021-09-12 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413875#comment-17413875 ] liujinhui commented on HUDI-2414: - Will MOR be better [~fengjian_428] > enable Hot and cold data separate

[jira] [Updated] (HUDI-2410) Fix getDefaultBootstrapIndexClass logical error

2021-09-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2410: Description: public static String getDefaultBootstrapIndexClass(Properties props) { String defaultClass =

[jira] [Updated] (HUDI-2410) Fix getDefaultBootstrapIndexClass logical error

2021-09-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2410: Description: public static String getDefaultBootstrapIndexClass(Properties props) { String defaultClass =

[jira] [Created] (HUDI-2410) Fix getDefaultBootstrapIndexClass logical error

2021-09-09 Thread liujinhui (Jira)
liujinhui created HUDI-2410: --- Summary: Fix getDefaultBootstrapIndexClass logical error Key: HUDI-2410 URL: https://issues.apache.org/jira/browse/HUDI-2410 Project: Apache Hudi Issue Type: Bug

[jira] [Assigned] (HUDI-2196) Breakdown FlinkOptions into FlinkReadOptions, FlinkWriteOptions...

2021-09-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2196: --- Assignee: (was: liujinhui) > Breakdown FlinkOptions into FlinkReadOptions, FlinkWriteOptions...

[jira] [Assigned] (HUDI-2196) Breakdown FlinkOptions into FlinkReadOptions, FlinkWriteOptions...

2021-09-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2196: --- Assignee: liujinhui > Breakdown FlinkOptions into FlinkReadOptions, FlinkWriteOptions... >

[jira] [Created] (HUDI-2386) Remove joda time in Hudi

2021-09-01 Thread liujinhui (Jira)
liujinhui created HUDI-2386: --- Summary: Remove joda time in Hudi Key: HUDI-2386 URL: https://issues.apache.org/jira/browse/HUDI-2386 Project: Apache Hudi Issue Type: Improvement

[jira] [Commented] (HUDI-2370) Supports data encryption

2021-08-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407766#comment-17407766 ] liujinhui commented on HUDI-2370: - Yes, I tested the COW table in the local environment, and the snapshot

[jira] [Commented] (HUDI-2370) Supports data encryption

2021-08-31 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407765#comment-17407765 ] liujinhui commented on HUDI-2370: - 1. Need to upgrade the parquet version to 1.12.0 2. Add examples to

[jira] [Assigned] (HUDI-1556) Add App Id and App name to HoodieDeltaStreamerMetrics

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-1556: --- Assignee: (was: liujinhui) > Add App Id and App name to HoodieDeltaStreamerMetrics >

[jira] [Assigned] (HUDI-1086) hudi support metric Influxdb

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-1086: --- Assignee: (was: liujinhui) > hudi support metric Influxdb > - > >

[jira] [Comment Edited] (HUDI-2370) Supports data encryption

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406650#comment-17406650 ] liujinhui edited comment on HUDI-2370 at 8/30/21, 10:54 AM: {code:java} public

[jira] [Comment Edited] (HUDI-2370) Supports data encryption

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406656#comment-17406656 ] liujinhui edited comment on HUDI-2370 at 8/30/21, 9:44 AM: --- Hello , we can use

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Status: In Progress (was: Open) > Supports data encryption > > >

[jira] [Commented] (HUDI-2370) Supports data encryption

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406656#comment-17406656 ] liujinhui commented on HUDI-2370: - Hello , we can use parquet-mr 1.12.0 to support hudi-parquet

[jira] [Commented] (HUDI-2370) Supports data encryption

2021-08-30 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406650#comment-17406650 ] liujinhui commented on HUDI-2370: - {code:java} public static void writeParquet(SparkSession spark,

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Description: Data security is becoming more and more important, if hudi can support encryption, it is very

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Status: In Progress (was: Open) > Supports data encryption > > >

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Description: Data security is becoming more and more important, if hudi can support encryption, it is very

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Status: In Progress (was: Open) > Supports data encryption > > >

[jira] [Assigned] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-2370: --- Assignee: liujinhui > Supports data encryption > > > Key:

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Description: 1. Specify column encryption 2. Custom encrypted client (Provide memory-based encryption

[jira] [Updated] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-2370: Description: 1. Specify column encryption 2. Custom encrypted client 3. Custom encryption algorithm

[jira] [Created] (HUDI-2370) Supports data encryption

2021-08-27 Thread liujinhui (Jira)
liujinhui created HUDI-2370: --- Summary: Supports data encryption Key: HUDI-2370 URL: https://issues.apache.org/jira/browse/HUDI-2370 Project: Apache Hudi Issue Type: New Feature

[jira] [Commented] (HUDI-2197) Replace ConfigOptions with ConfigProperty for FlinkOptions

2021-08-24 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403586#comment-17403586 ] liujinhui commented on HUDI-2197: - [~shivnarayan] [~rmahindra] I would like to complete this work, is it

[jira] [Resolved] (HUDI-1674) add partition level delete DOC or example

2021-08-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui resolved HUDI-1674. - Resolution: Fixed > add partition level delete DOC or example > -

[jira] [Updated] (HUDI-1366) Make deltasteamer support exporting data from hdfs to hudi

2021-08-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui updated HUDI-1366: Status: Closed (was: Patch Available) > Make deltasteamer support exporting data from hdfs to hudi >

[jira] [Assigned] (HUDI-1438) Move DataSourceOptions to hudi-client-common to reuse more code

2021-08-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujinhui reassigned HUDI-1438: --- Assignee: (was: liujinhui) > Move DataSourceOptions to hudi-client-common to reuse more code >

[jira] [Commented] (HUDI-1674) add partition level delete DOC or example

2021-08-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400855#comment-17400855 ] liujinhui commented on HUDI-1674: - 5670c5bcdde29b1d4ae04e61ccc691662aa71264 > add partition level delete

  1   2   3   4   >