[GitHub] [hudi] hudi-bot commented on pull request #6445: [HUDI-4644] Change default flink profile to 1.15.x

2022-08-19 Thread GitBox
hudi-bot commented on PR #6445: URL: https://github.com/apache/hudi/pull/6445#issuecomment-1221231565 ## CI report: * e514498183f4c4346ff9be966daae5afd906fb6f Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6445: [HUDI-4644] Change default flink profile to 1.15.x

2022-08-19 Thread GitBox
hudi-bot commented on PR #6445: URL: https://github.com/apache/hudi/pull/6445#issuecomment-1221231108 ## CI report: * e514498183f4c4346ff9be966daae5afd906fb6f Azure:

[GitHub] [hudi] XuQianJin-Stars merged pull request #6443: [HUDI-4643] MergeInto syntax WHEN MATCHED is optional but must be set

2022-08-19 Thread GitBox
XuQianJin-Stars merged PR #6443: URL: https://github.com/apache/hudi/pull/6443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated: [HUDI-4643] MergeInto syntax WHEN MATCHED is optional but must be set (#6443)

2022-08-19 Thread forwardxu
This is an automated email from the ASF dual-hosted git repository. forwardxu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 419f881167 [HUDI-4643] MergeInto syntax WHEN

[GitHub] [hudi] hudi-bot commented on pull request #6445: [HUDI-4644] Change default flink profile to 1.15.x

2022-08-19 Thread GitBox
hudi-bot commented on PR #6445: URL: https://github.com/apache/hudi/pull/6445#issuecomment-1221222023 ## CI report: * e514498183f4c4346ff9be966daae5afd906fb6f Azure:

[jira] [Updated] (HUDI-3304) support partial update on mor table

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3304: - Sprint: 2022/09/05 (was: 2022/08/22) > support partial update on mor table >

[jira] [Updated] (HUDI-2786) Failed to connect to namenode in Docker Demo on Apple M1 chip

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2786: - Sprint: 2022/09/05 (was: 2022/08/22) > Failed to connect to namenode in Docker Demo on Apple M1 chip >

[jira] [Updated] (HUDI-3517) Unicode in partition path causes it to be resolved wrongly

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3517: - Priority: Critical (was: Blocker) > Unicode in partition path causes it to be resolved wrongly >

[jira] [Updated] (HUDI-3517) Unicode in partition path causes it to be resolved wrongly

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3517: - Story Points: 3 > Unicode in partition path causes it to be resolved wrongly >

[jira] [Updated] (HUDI-3214) Optimize auto partition in spark

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3214: - Story Points: 1 > Optimize auto partition in spark > > >

[jira] [Updated] (HUDI-3216) Support timestamp with microseconds precision

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3216: - Story Points: 2 > Support timestamp with microseconds precision >

[jira] [Updated] (HUDI-4112) Relax constraint in metadata table that rollback of a commit that got archived in MDT throws exception

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4112: - Story Points: 2 > Relax constraint in metadata table that rollback of a commit that got > archived in

[jira] [Updated] (HUDI-3965) Spark sql dml w/ spark2 and scala12 fails w/ ClassNotFoundException for SparkSQLCLIDriver

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3965: - Sprint: (was: 2022/08/22) > Spark sql dml w/ spark2 and scala12 fails w/ ClassNotFoundException for >

[jira] [Updated] (HUDI-3601) Support multi-arch builds in docker setup

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3601: - Sprint: 2022/09/05 (was: 2022/08/22) > Support multi-arch builds in docker setup >

[jira] [Updated] (HUDI-3965) Spark sql dml w/ spark2 and scala12 fails w/ ClassNotFoundException for SparkSQLCLIDriver

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3965: - Fix Version/s: 0.13.0 (was: 0.12.1) > Spark sql dml w/ spark2 and scala12 fails w/

[jira] [Updated] (HUDI-4136) Run snapshot query in hive throw ' IOException: java.lang.IllegalArgumentException: HoodieRealtimeRecordReader can only work on RealtimeSplit and not with a empty file'.

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4136: - Sprint: 2022/09/05 (was: 2022/08/22) > Run snapshot query in hive throw ' IOException: >

[jira] [Updated] (HUDI-3892) Add HoodieReadClient with java

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3892: - Sprint: 2022/09/05 (was: 2022/08/22) > Add HoodieReadClient with java > -- >

[jira] [Updated] (HUDI-4542) Flink streaming query fails with ClassNotFoundException

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4542: - Priority: Critical (was: Major) > Flink streaming query fails with ClassNotFoundException >

[jira] [Updated] (HUDI-3734) Add savepoint restore nodes and yamls to integ test suite

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3734: - Sprint: 2022/09/19 (was: 2022/08/22) > Add savepoint restore nodes and yamls to integ test suite >

[GitHub] [hudi] hudi-bot commented on pull request #6361: [HUDI-4503] Cleaning up Hudi custom Spark `Rule`s

2022-08-19 Thread GitBox
hudi-bot commented on PR #6361: URL: https://github.com/apache/hudi/pull/6361#issuecomment-1221207317 ## CI report: * 61b9cdf535b511d02dcc35c3f4b3518ee3329813 Azure:

[jira] [Updated] (HUDI-3742) Enable parquet enableVectorizedReader for spark incremental read to prevent pef regression

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3742: - Status: Patch Available (was: In Progress) > Enable parquet enableVectorizedReader for spark

[jira] [Updated] (HUDI-3742) Enable parquet enableVectorizedReader for spark incremental read to prevent pef regression

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3742: - Status: In Progress (was: Open) > Enable parquet enableVectorizedReader for spark incremental read to

[jira] [Updated] (HUDI-4185) Evaluate alternatives to using "hoodie.properties" as state store for Metadata Table

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4185: - Fix Version/s: 0.13.0 > Evaluate alternatives to using "hoodie.properties" as state store for > Metadata

[jira] [Updated] (HUDI-4185) Evaluate alternatives to using "hoodie.properties" as state store for Metadata Table

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4185: - Fix Version/s: (was: 0.12.1) > Evaluate alternatives to using "hoodie.properties" as state store for

[jira] [Updated] (HUDI-3954) Don't keep the last commit before the earliest commit to retain

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3954: - Status: Patch Available (was: In Progress) > Don't keep the last commit before the earliest commit to

[jira] [Updated] (HUDI-3954) Don't keep the last commit before the earliest commit to retain

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3954: - Status: In Progress (was: Open) > Don't keep the last commit before the earliest commit to retain >

[jira] [Closed] (HUDI-3996) Revisit default key gen logic with spark-sql

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3996. Assignee: (was: Raymond Xu) Resolution: Won't Do > Revisit default key gen logic with spark-sql

[jira] [Updated] (HUDI-3996) Revisit default key gen logic with spark-sql

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3996: - Fix Version/s: (was: 0.12.1) > Revisit default key gen logic with spark-sql >

[jira] [Updated] (HUDI-3959) Rename class name for spark rdd reader

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3959: - Status: Patch Available (was: In Progress) > Rename class name for spark rdd reader >

[jira] [Assigned] (HUDI-3994) HoodieDeltaStreamer - Spark master shouldn't have a default

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3994: Assignee: Angel Conde > HoodieDeltaStreamer - Spark master shouldn't have a default >

[jira] [Closed] (HUDI-4283) The memory cost in HoodieMergeHandle is increasing as the size of base file

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4283. Resolution: Abandoned > The memory cost in HoodieMergeHandle is increasing as the size of base file >

[jira] [Updated] (HUDI-3780) improve drop partitions

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3780: - Status: Patch Available (was: In Progress) > improve drop partitions > --- > >

[jira] [Updated] (HUDI-4283) The memory cost in HoodieMergeHandle is increasing as the size of base file

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4283: - Fix Version/s: (was: 0.12.1) > The memory cost in HoodieMergeHandle is increasing as the size of base

[jira] [Updated] (HUDI-3780) improve drop partitions

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3780: - Status: In Progress (was: Open) > improve drop partitions > --- > >

[jira] [Assigned] (HUDI-4281) Using hudi to build a large number of tables in spark on hive causes OOM

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4281: Assignee: zhangrenhua (was: sivabalan narayanan) > Using hudi to build a large number of tables

[jira] [Updated] (HUDI-4281) Using hudi to build a large number of tables in spark on hive causes OOM

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4281: - Status: Patch Available (was: In Progress) > Using hudi to build a large number of tables in spark on

[jira] [Updated] (HUDI-4282) Throws IOException in method HoodieLogFileReader.isBlockCorrupted()

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4282: - Status: In Progress (was: Open) > Throws IOException in method HoodieLogFileReader.isBlockCorrupted() >

[jira] [Updated] (HUDI-4281) Using hudi to build a large number of tables in spark on hive causes OOM

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4281: - Status: In Progress (was: Open) > Using hudi to build a large number of tables in spark on hive causes

[jira] [Updated] (HUDI-4242) Follow up on getAllPartitionPaths perf enhancement

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4242: - Component/s: performance > Follow up on getAllPartitionPaths perf enhancement >

[jira] [Updated] (HUDI-4282) Throws IOException in method HoodieLogFileReader.isBlockCorrupted()

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4282: - Status: Patch Available (was: In Progress) > Throws IOException in method

[jira] [Updated] (HUDI-4242) Follow up on getAllPartitionPaths perf enhancement

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4242: - Priority: Blocker (was: Critical) > Follow up on getAllPartitionPaths perf enhancement >

[jira] [Closed] (HUDI-4226) CLI unable to rollback complete instants

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4226. Fix Version/s: (was: 0.12.1) Resolution: Abandoned > CLI unable to rollback complete instants >

[jira] [Updated] (HUDI-4201) Add tooling to delete empty non-completed instants from timeline

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4201: - Component/s: cli > Add tooling to delete empty non-completed instants from timeline >

[jira] [Closed] (HUDI-4062) Only rollback the failed writes pre upgrade under optimistic concurrency

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4062. Fix Version/s: (was: 0.12.1) Resolution: Won't Do > Only rollback the failed writes pre upgrade

[jira] [Updated] (HUDI-4021) Support deferring compaction when there is an inflight delta commit

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4021: - Priority: Blocker (was: Critical) > Support deferring compaction when there is an inflight delta commit

[jira] [Updated] (HUDI-4066) HiveMetastoreBasedLockProvider can not release lock when writer fails

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4066: - Fix Version/s: 0.13.0 (was: 0.12.1) > HiveMetastoreBasedLockProvider can not

[jira] [Updated] (HUDI-3786) how to deduce what MDT partitions to update on the write path w/ async indeing

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3786: - Component/s: code-quality > how to deduce what MDT partitions to update on the write path w/ async

[jira] [Closed] (HUDI-3419) Load class through reflection in a thread-safe way

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3419. Resolution: Won't Fix > Load class through reflection in a thread-safe way >

[jira] [Updated] (HUDI-3419) Load class through reflection in a thread-safe way

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3419: - Fix Version/s: (was: 0.12.1) > Load class through reflection in a thread-safe way >

[jira] [Updated] (HUDI-3786) how to deduce what MDT partitions to update on the write path w/ async indeing

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3786: - Status: Open (was: In Progress) > how to deduce what MDT partitions to update on the write path w/ async

[jira] [Updated] (HUDI-3403) Manage immutable hudi Configurations

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3403: - Priority: Blocker (was: Critical) > Manage immutable hudi Configurations >

[jira] [Updated] (HUDI-3649) Add HoodieTableConfig defaults to HoodieWriteConfig

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3649: - Priority: Blocker (was: Critical) > Add HoodieTableConfig defaults to HoodieWriteConfig >

[jira] [Updated] (HUDI-3769) Optimize the logs of HoodieMergeHandle and BufferedConnectWriter

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3769: - Status: Patch Available (was: In Progress) > Optimize the logs of HoodieMergeHandle and

[jira] [Updated] (HUDI-4526) improve spillableMapBasePath disk directory is full

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4526: - Status: Patch Available (was: In Progress) > improve spillableMapBasePath disk directory is full >

[jira] [Updated] (HUDI-3769) Optimize the logs of HoodieMergeHandle and BufferedConnectWriter

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3769: - Status: In Progress (was: Open) > Optimize the logs of HoodieMergeHandle and BufferedConnectWriter >

[jira] [Updated] (HUDI-3617) MOR compact improve

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3617: - Status: In Progress (was: Open) > MOR compact improve > --- > > Key:

[jira] [Assigned] (HUDI-3617) MOR compact improve

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3617: Assignee: scx > MOR compact improve > --- > > Key: HUDI-3617 >

[jira] [Updated] (HUDI-4526) improve spillableMapBasePath disk directory is full

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4526: - Status: In Progress (was: Open) > improve spillableMapBasePath disk directory is full >

[jira] [Updated] (HUDI-3617) MOR compact improve

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3617: - Status: Patch Available (was: In Progress) > MOR compact improve > --- > >

[jira] [Updated] (HUDI-3517) Unicode in partition path causes it to be resolved wrongly

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3517: - Priority: Blocker (was: Critical) > Unicode in partition path causes it to be resolved wrongly >

[jira] [Updated] (HUDI-4613) Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4613: - Status: In Progress (was: Open) > Avoid the use of regex expressions when call

[jira] [Updated] (HUDI-3615) Replace List with HoodieData in HoodieFlink/JavaTable and commit executors

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3615: - Fix Version/s: 0.13.0 (was: 0.12.1) > Replace List with HoodieData in

[jira] [Updated] (HUDI-3615) Replace List with HoodieData in HoodieFlink/JavaTable and commit executors

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3615: - Priority: Major (was: Critical) > Replace List with HoodieData in HoodieFlink/JavaTable and commit

[jira] [Updated] (HUDI-4613) Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4613: - Status: Patch Available (was: In Progress) > Avoid the use of regex expressions when call

[jira] [Assigned] (HUDI-4613) Avoid the use of regex expressions when call hoodieFileGroup#addLogFile function

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4613: Assignee: lei w > Avoid the use of regex expressions when call hoodieFileGroup#addLogFile >

[jira] [Updated] (HUDI-4631) Enhance retries for failed writes w/ write conflicts in a multi writer scenarios

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4631: - Priority: Blocker (was: Critical) > Enhance retries for failed writes w/ write conflicts in a multi

[jira] [Updated] (HUDI-3152) Add support to generate updates in HoodieTestDataGenerator for TimestampBasedKeyGen

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3152: - Fix Version/s: 0.13.0 (was: 0.12.1) > Add support to generate updates in

[jira] [Closed] (HUDI-3184) hudi-flink support timestamp-micros

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3184. Resolution: Done > hudi-flink support timestamp-micros > --- > >

[jira] [Updated] (HUDI-3216) Support timestamp with microseconds precision

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3216: - Priority: Blocker (was: Critical) > Support timestamp with microseconds precision >

[jira] [Updated] (HUDI-3232) support reload timeline Incrementally

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3232: - Fix Version/s: 0.13.0 (was: 0.12.1) > support reload timeline Incrementally >

[GitHub] [hudi] vamshigv closed pull request #6451: Hudi delta sync

2022-08-19 Thread GitBox
vamshigv closed pull request #6451: Hudi delta sync URL: https://github.com/apache/hudi/pull/6451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vamshigv opened a new pull request, #6451: Hudi delta sync

2022-08-19 Thread GitBox
vamshigv opened a new pull request, #6451: URL: https://github.com/apache/hudi/pull/6451 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any

[jira] [Updated] (HUDI-3463) Make user-defined BulkInsertPartitioner fit write path API

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3463: - Fix Version/s: 0.13.0 (was: 0.12.1) > Make user-defined BulkInsertPartitioner fit

[jira] [Updated] (HUDI-3391) presto and hive beeline fails to read MOR table w/ 2 or more array fields

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3391: - Priority: Blocker (was: Critical) > presto and hive beeline fails to read MOR table w/ 2 or more array

[jira] [Updated] (HUDI-3819) upgrade spring cve-2022-22965

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3819: - Status: Patch Available (was: In Progress) > upgrade spring cve-2022-22965 >

[jira] [Updated] (HUDI-4396) Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4396: - Status: Patch Available (was: In Progress) > Add a boolean parameter to decide whether the partition is

[jira] [Updated] (HUDI-3579) Add timeline commands in hudi-cli

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3579: - Status: Patch Available (was: In Progress) > Add timeline commands in hudi-cli >

[jira] [Updated] (HUDI-4431) Fix log file will not roll over to a new file

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4431: - Status: Patch Available (was: In Progress) > Fix log file will not roll over to a new file >

[jira] [Updated] (HUDI-4482) Remove guava from codebase

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4482: - Status: Patch Available (was: In Progress) > Remove guava from codebase > -- > >

[jira] [Updated] (HUDI-4396) Add a boolean parameter to decide whether the partition is cascade or not when hive table columns changes

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4396: - Status: In Progress (was: Open) > Add a boolean parameter to decide whether the partition is cascade or

[jira] [Updated] (HUDI-4482) Remove guava from codebase

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4482: - Status: In Progress (was: Open) > Remove guava from codebase > -- > >

[jira] [Assigned] (HUDI-4482) Remove guava from codebase

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4482: Assignee: KnightChess > Remove guava from codebase > -- > >

[jira] [Updated] (HUDI-4340) DeltaStreamer bootstrap failed when metrics on caused by DateTimeParseException: Text '00000000000001999' could not be parsed

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4340: - Status: In Progress (was: Open) > DeltaStreamer bootstrap failed when metrics on caused by >

[jira] [Updated] (HUDI-4340) DeltaStreamer bootstrap failed when metrics on caused by DateTimeParseException: Text '00000000000001999' could not be parsed

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4340: - Status: Patch Available (was: In Progress) > DeltaStreamer bootstrap failed when metrics on caused by >

[GitHub] [hudi] hudi-bot commented on pull request #6445: [HUDI-4644] Change default flink profile to 1.15.x

2022-08-19 Thread GitBox
hudi-bot commented on PR #6445: URL: https://github.com/apache/hudi/pull/6445#issuecomment-1221195226 ## CI report: * 8c7665961bdfba50a4b6d6c5480c9d76ae54796b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6445: [HUDI-4644] Change default flink profile to 1.15.x

2022-08-19 Thread GitBox
hudi-bot commented on PR #6445: URL: https://github.com/apache/hudi/pull/6445#issuecomment-1221194262 ## CI report: * 8c7665961bdfba50a4b6d6c5480c9d76ae54796b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6170: [HUDI-4441] Log4j2 configuration fixes and removal of log4j1 dependencies

2022-08-19 Thread GitBox
hudi-bot commented on PR #6170: URL: https://github.com/apache/hudi/pull/6170#issuecomment-1221193262 ## CI report: * 1de72127453499b362801d6e912f2be1fd566775 UNKNOWN * e9a0d9065b5d7af14e9bc969284842391a34ef62 UNKNOWN * 53c4195ab7d36e4b369b368584ec1cca55d2c2e7 UNKNOWN *

[jira] [Updated] (HUDI-4515) savepoints will be clean in keeping latest versions policy

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4515: - Status: In Progress (was: Open) > savepoints will be clean in keeping latest versions policy >

[jira] [Updated] (HUDI-4475) fix create table with not exists hoodie properties file

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4475: - Status: In Progress (was: Open) > fix create table with not exists hoodie properties file >

[jira] [Updated] (HUDI-4515) savepoints will be clean in keeping latest versions policy

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4515: - Status: Patch Available (was: In Progress) > savepoints will be clean in keeping latest versions policy

[jira] [Updated] (HUDI-4475) fix create table with not exists hoodie properties file

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4475: - Status: Patch Available (was: In Progress) > fix create table with not exists hoodie properties file >

[jira] [Updated] (HUDI-4582) Sync 11w partitions to hive by using HiveSyncTool with(--sync-mode="hms" and use-jdbc=false) with timeout

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4582: - Status: Patch Available (was: In Progress) > Sync 11w partitions to hive by using HiveSyncTool

[jira] [Assigned] (HUDI-4582) Sync 11w partitions to hive by using HiveSyncTool with(--sync-mode="hms" and use-jdbc=false) with timeout

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4582: Assignee: XixiHua > Sync 11w partitions to hive by using HiveSyncTool with(--sync-mode="hms" and

[jira] [Updated] (HUDI-4582) Sync 11w partitions to hive by using HiveSyncTool with(--sync-mode="hms" and use-jdbc=false) with timeout

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4582: - Status: In Progress (was: Open) > Sync 11w partitions to hive by using HiveSyncTool

[jira] [Updated] (HUDI-3614) Fix Flink/JavaDeleteHelper deduplication logic

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3614: - Component/s: code-quality > Fix Flink/JavaDeleteHelper deduplication logic >

[jira] [Commented] (HUDI-3614) Fix Flink/JavaDeleteHelper deduplication logic

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582087#comment-17582087 ] Raymond Xu commented on HUDI-3614: -- This was put on-hold due to perf concern from the refactoring. > Fix

[jira] [Closed] (HUDI-4609) Improve usability of upgrade/downgrade commands in Hudi CLI

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4609. Resolution: Fixed > Improve usability of upgrade/downgrade commands in Hudi CLI >

[jira] [Updated] (HUDI-3614) Fix Flink/JavaDeleteHelper deduplication logic

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3614: - Priority: Major (was: Blocker) > Fix Flink/JavaDeleteHelper deduplication logic >

[jira] [Updated] (HUDI-3614) Fix Flink/JavaDeleteHelper deduplication logic

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3614: - Fix Version/s: 0.13.0 (was: 0.12.1) > Fix Flink/JavaDeleteHelper deduplication

[jira] [Updated] (HUDI-4609) Improve usability of upgrade/downgrade commands in Hudi CLI

2022-08-19 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4609: - Status: In Progress (was: Open) > Improve usability of upgrade/downgrade commands in Hudi CLI >

  1   2   3   4   >