[jira] [Updated] (HUDI-3601) Support multi-arch builds in docker setup

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3601: - Fix Version/s: 0.12.1 (was: 0.13.0) > Support multi-arch builds in docker setup > -

[jira] [Updated] (HUDI-762) modify the pom.xml to support maven 3.x

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-762: Epic Link: HUDI-2261 > modify the pom.xml to support maven 3.x > --- > >

[jira] [Updated] (HUDI-762) modify the pom.xml to support maven 3.x

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-762: Component/s: dev-experience > modify the pom.xml to support maven 3.x > -

[jira] [Updated] (HUDI-2919) Migrate Hudi to proper Incremental Build System (Bazel)

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2919: - Epic Link: HUDI-2261 > Migrate Hudi to proper Incremental Build System (Bazel) > -

[jira] [Updated] (HUDI-2664) Investigate: Dependency library sources are pulled during maven build

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2664: - Epic Link: HUDI-2261 > Investigate: Dependency library sources are pulled during maven build > ---

[jira] [Updated] (HUDI-2786) Failed to connect to namenode in Docker Demo on Apple M1 chip

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2786: - Priority: Critical (was: Major) > Failed to connect to namenode in Docker Demo on Apple M1 chip > ---

[jira] [Closed] (HUDI-4646) mvn package fails w/ flink streaming java maven aartifact not found

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4646. Resolution: Cannot Reproduce > mvn package fails w/ flink streaming java maven aartifact not found > ---

[jira] [Updated] (HUDI-4646) mvn package fails w/ flink streaming java maven aartifact not found

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4646: - Fix Version/s: (was: 0.12.1) > mvn package fails w/ flink streaming java maven aartifact not found > -

[jira] [Updated] (HUDI-4646) mvn package fails w/ flink streaming java maven aartifact not found

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4646: - Fix Version/s: 0.12.1 > mvn package fails w/ flink streaming java maven aartifact not found >

[jira] (HUDI-4338) resolve the data skew when using flink datastream write hudi

2022-08-20 Thread chenfengLiu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4338 ] chenfengLiu deleted comment on HUDI-4338: --- was (Author: liufangqi): [~wangxianghu] Could you help to take a glance and review this PR ( [GitHub Pull Request #5997|https://github.com/apache/hudi/

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221477861 ## CI report: * 51628385c214d692a7a0923c63a82810eaffb8ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Deleted] (HUDI-4673) test

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-4673: - > test > > > Key: HUDI-4673 > URL: https://issues.apache.org/jira/browse

[jira] [Created] (HUDI-4673) test

2022-08-20 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-4673: Summary: test Key: HUDI-4673 URL: https://issues.apache.org/jira/browse/HUDI-4673 Project: Apache Hudi Issue Type: Task Reporter: Raymond Xu -- Thi

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221477338 ## CI report: * 51628385c214d692a7a0923c63a82810eaffb8ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Assigned] (HUDI-4605) Upgrade hudi-presto-bundle version to 0.12.0

2022-08-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-4605: --- Assignee: Ethan Guo > Upgrade hudi-presto-bundle version to 0.12.0 >

[jira] [Updated] (HUDI-4605) Upgrade hudi-presto-bundle version to 0.12.0

2022-08-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4605: Status: Patch Available (was: In Progress) > Upgrade hudi-presto-bundle version to 0.12.0 > ---

[jira] [Updated] (HUDI-4605) Upgrade hudi-presto-bundle version to 0.12.0

2022-08-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4605: Status: In Progress (was: Open) > Upgrade hudi-presto-bundle version to 0.12.0 > --

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221476759 ## CI report: * 51628385c214d692a7a0923c63a82810eaffb8ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Closed] (HUDI-4672) presto

2022-08-20 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-4672. --- Resolution: Invalid > presto > -- > > Key: HUDI-4672 > URL: https://issues

[jira] [Created] (HUDI-4672) presto

2022-08-20 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-4672: --- Summary: presto Key: HUDI-4672 URL: https://issues.apache.org/jira/browse/HUDI-4672 Project: Apache Hudi Issue Type: Improvement Reporter: Ethan Guo

[jira] [Updated] (HUDI-2261) [UMBRELLA] Dev Hygiene Issues

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2261: - Component/s: dev-experience > [UMBRELLA] Dev Hygiene Issues > - > >

[jira] [Updated] (HUDI-2261) [UMBRELLA] Dev Hygiene Issues

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2261: - Component/s: code-quality > [UMBRELLA] Dev Hygiene Issues > - > >

[jira] [Updated] (HUDI-3242) Checkpoint 0 is ignored -Partial parquet file discovery after the first commit

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3242: - Component/s: deltastreamer (was: spark) (was: writer-core) > Che

[jira] [Updated] (HUDI-4184) Creating external table in Spark SQL modifies "hoodie.properties"

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4184: - Fix Version/s: 0.12.1 > Creating external table in Spark SQL modifies "hoodie.properties" > --

[jira] [Updated] (HUDI-4184) Creating external table in Spark SQL modifies "hoodie.properties"

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4184: - Component/s: spark-sql > Creating external table in Spark SQL modifies "hoodie.properties" > -

[jira] [Updated] (HUDI-3414) Table data encryption

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3414: - Component/s: storage-management > Table data encryption > - > > Key: H

[jira] [Commented] (HUDI-2370) Supports data encryption (COW tables)

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17582471#comment-17582471 ] Raymond Xu commented on HUDI-2370: -- [~wuleiflink] for MOR, if log files in parquet, sure

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221469230 ## CI report: * 730e59884e03eaa460d5561851a51b5f1c6d2694 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Created] (HUDI-4671) Compaction and Clean work unexpected when enable metadata feature

2022-08-20 Thread suheng.cloud (Jira)
suheng.cloud created HUDI-4671: -- Summary: Compaction and Clean work unexpected when enable metadata feature Key: HUDI-4671 URL: https://issues.apache.org/jira/browse/HUDI-4671 Project: Apache Hudi

[jira] [Updated] (HUDI-3991) Provide bundle jar options in each e2e test pipeline

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3991: - Epic Link: HUDI-3303 > Provide bundle jar options in each e2e test pipeline >

[jira] [Updated] (HUDI-3991) Provide bundle jar options in each e2e test pipeline

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3991: - Sprint: 2022/05/02, 2022/05/16, 2022/05/31 (was: 2022/05/02, 2022/05/16, 2022/05/31, 2022/08/08) > Provi

[jira] [Closed] (HUDI-4563) Docs writing for 0.12.0: key gen API change and perf improvements

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4563. Resolution: Fixed > Docs writing for 0.12.0: key gen API change and perf improvements >

[jira] [Updated] (HUDI-4633) Add command to trace partition through a range of commits

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4633: - Sprint: 2022/08/22 (was: 2022/08/08) > Add command to trace partition through a range of commits > --

[jira] [Updated] (HUDI-4033) Aggregated cols stats at partition level in col stats partition in MDT

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4033: - Sprint: (was: 2022/08/08) > Aggregated cols stats at partition level in col stats partition in MDT > ---

[jira] [Updated] (HUDI-4033) Aggregated cols stats at partition level in col stats partition in MDT

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4033: - Epic Link: HUDI-1822 (was: HUDI-3249) > Aggregated cols stats at partition level in col stats partition i

[jira] [Updated] (HUDI-4417) Update Hudi Storage docs

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4417: - Component/s: docs > Update Hudi Storage docs > > > Key: HUDI-4417

[jira] [Updated] (HUDI-2669) Upgrade Java toolset/runtime to JDK11

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2669: - Sprint: (was: 2022/08/08) > Upgrade Java toolset/runtime to JDK11 >

[jira] [Updated] (HUDI-3495) Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3495: - Sprint: 2022/09/19 (was: 2022/08/22) > Reading keys in parallel from HoodieMetadataMergedLogRecordReader

[jira] [Updated] (HUDI-4364) integrate column stats index with presto engine

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4364: - Epic Link: HUDI-4552 (was: HUDI-1822) > integrate column stats index with presto engine > ---

[jira] [Updated] (HUDI-4364) integrate column stats index with presto engine

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4364: - Sprint: 2022/08/22 > integrate column stats index with presto engine > ---

[jira] [Updated] (HUDI-3317) Partition specific pointed lookup/reading strategy for metadata table

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3317: - Sprint: (was: 2022/08/22) > Partition specific pointed lookup/reading strategy for metadata table >

[jira] [Updated] (HUDI-4182) HoodieIndexer failing when trying to invoke it as Single Writer

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4182: - Sprint: (was: 2022/08/22) > HoodieIndexer failing when trying to invoke it as Single Writer > --

[jira] [Updated] (HUDI-3259) Code Refactor: Common prep records commit util for Spark and Flink

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3259: - Sprint: (was: 2022/08/22) > Code Refactor: Common prep records commit util for Spark and Flink > ---

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221463047 ## CI report: * f0de1341db083aed17caf4364e45c543ec5e20e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Updated] (HUDI-4650) Commits Command: Include both active and archive timeline for a given range of intants

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4650: - Story Points: 3 > Commits Command: Include both active and archive timeline for a given range > of intant

[jira] [Updated] (HUDI-4649) Add command to trace file group through a range of commits

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4649: - Story Points: 3 > Add command to trace file group through a range of commits > ---

[jira] [Updated] (HUDI-4648) Add command to rename partition

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4648: - Story Points: 2 > Add command to rename partition > --- > > Ke

[jira] [Updated] (HUDI-4648) Add command to rename partition

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4648: - Story Points: 3 (was: 2) > Add command to rename partition > --- > >

[jira] [Updated] (HUDI-4642) Add hudi-cli support to repair deprecated partition

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4642: - Story Points: 1 > Add hudi-cli support to repair deprecated partition > --

[jira] [Updated] (HUDI-3777) Optimize column stats storage

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3777: - Sprint: 2022/09/19 (was: 2022/08/22) > Optimize column stats storage > - > >

[jira] [Updated] (HUDI-2928) Evaluate rebasing Hudi's default compression from Gzip to Zstd

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2928: - Sprint: 2022/09/19 (was: 2022/08/22) > Evaluate rebasing Hudi's default compression from Gzip to Zstd > -

[jira] [Updated] (HUDI-4503) Support table identifier with explicit catalog

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4503: - Story Points: 1 > Support table identifier with explicit catalog > ---

[jira] [Updated] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3054: - Story Points: 3 (was: 2) > Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter >

[jira] [Updated] (HUDI-1623) Support start_commit_time & end_commit_times for serializable incremental pull

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1623: - Sprint: (was: 2022/08/22) > Support start_commit_time & end_commit_times for serializable incremental pu

[jira] [Updated] (HUDI-3786) how to deduce what MDT partitions to update on the write path w/ async indeing

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3786: - Sprint: 2022/09/19 (was: 2022/08/22) > how to deduce what MDT partitions to update on the write path w/ a

[jira] [Updated] (HUDI-4528) Diff tool to compare metadata across snapshots in a given time range

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4528: - Story Points: 3 > Diff tool to compare metadata across snapshots in a given time range > -

[jira] [Updated] (HUDI-3057) Instants should be generated strictly under locks

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3057: - Story Points: 3 > Instants should be generated strictly under locks >

[jira] [Updated] (HUDI-2695) [DOCS] Trino Hudi connector on Hudi website

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2695: - Story Points: 0.25 (was: 0) > [DOCS] Trino Hudi connector on Hudi website > -

[jira] [Updated] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-83: --- Sprint: Cont' improve - 2021/01/24, Cont' improve - 2021/01/31, 2022/09/05 (was: Cont' improve - 2021/01/24,

[jira] [Updated] (HUDI-4342) Improve handling of 5xx in timeline server

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4342: - Sprint: 2022/09/05 (was: 2022/08/22) > Improve handling of 5xx in timeline server > -

[jira] [Updated] (HUDI-4608) Fix upgrade command in Hudi CLI

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4608: - Epic Link: HUDI-1388 > Fix upgrade command in Hudi CLI > > >

[jira] [Updated] (HUDI-3216) Support timestamp with microseconds precision

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3216: - Sprint: 2022/09/19 (was: 2022/08/22) > Support timestamp with microseconds precision > --

[jira] [Updated] (HUDI-4549) hive sync bundle causes class loader issue

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4549: - Story Points: 3 > hive sync bundle causes class loader issue > --

[jira] [Updated] (HUDI-3019) Upserts with Dataype promotion only to a subset of partition fails

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3019: - Story Points: 5 > Upserts with Dataype promotion only to a subset of partition fails > ---

[jira] [Updated] (HUDI-4342) Improve handling of 5xx in timeline server

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4342: - Story Points: 3 > Improve handling of 5xx in timeline server > --

[jira] [Updated] (HUDI-2873) Support optimize data layout by sql and make the build more fast

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2873: - Sprint: 2022/09/19 (was: 2022/08/22) > Support optimize data layout by sql and make the build more fast >

[jira] [Updated] (HUDI-3654) Support basic actions based on hudi metastore server

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3654: - Sprint: 2022/09/05 (was: 2022/08/22) > Support basic actions based on hudi metastore server > --

[jira] [Assigned] (HUDI-4297) Test TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters* is flaky

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4297: Assignee: Zhaojing Yu > Test > TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWit

[jira] [Updated] (HUDI-4297) Test TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters* is flaky

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4297: - Story Points: 1 > Test > TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWrit

[jira] [Updated] (HUDI-4297) Test TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultipleWriters* is flaky

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4297: - Reviewers: Raymond Xu > Test > TestHoodieDeltaStreamerWithMultiWriter.testUpsertsContinuousModeWithMultip

[jira] [Updated] (HUDI-4588) Ingestion failing if source column is dropped

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4588: - Story Points: 2 > Ingestion failing if source column is dropped >

[jira] [Updated] (HUDI-4441) Disbale INFO level logs from tests

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4441: - Story Points: 0.5 > Disbale INFO level logs from tests > -- > >

[jira] [Updated] (HUDI-4635) Update roadmap page based on H2 2022 plan

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4635: - Story Points: 1 > Update roadmap page based on H2 2022 plan > - >

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221456189 ## CI report: * f0de1341db083aed17caf4364e45c543ec5e20e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1574: - Story Points: 5 > Trim existing unit tests to finish in much shorter amount of time >

[jira] [Updated] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-83: --- Story Points: 1 > Map Timestamp type in spark to corresponding Timestamp type in Hive during > Hive sync >

[jira] [Updated] (HUDI-3973) Implement GENERATE manifest command for Snowflake integration

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3973: - Sprint: 2022/09/05 (was: 2022/08/22) > Implement GENERATE manifest command for Snowflake integration > --

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221455787 ## CI report: * f0de1341db083aed17caf4364e45c543ec5e20e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Updated] (HUDI-2733) Adding Thrift support in HiveSyncTool

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2733: - Sprint: Cont' improve - 2021/01/24, Cont' improve - 2021/01/31, Cont' improve - 2022/02/07, Cont' impro

[jira] [Updated] (HUDI-3967) Automatic savepoint in Hudi

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3967: - Fix Version/s: 1.0.0 (was: 0.13.0) > Automatic savepoint in Hudi >

[GitHub] [hudi] hudi-bot commented on pull request #6432: [HUDI-4586] Improve metadata fetching in bloom index

2022-08-20 Thread GitBox
hudi-bot commented on PR #6432: URL: https://github.com/apache/hudi/pull/6432#issuecomment-1221455322 ## CI report: * f0de1341db083aed17caf4364e45c543ec5e20e1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=1085

[jira] [Updated] (HUDI-2733) Adding Thrift support in HiveSyncTool

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2733: - Epic Link: HUDI-2519 > Adding Thrift support in HiveSyncTool > - > >

[jira] [Updated] (HUDI-2733) Adding Thrift support in HiveSyncTool

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2733: - Story Points: 2 > Adding Thrift support in HiveSyncTool > - > >

[jira] [Updated] (HUDI-2733) Adding Thrift support in HiveSyncTool

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2733: - Component/s: meta-sync > Adding Thrift support in HiveSyncTool > - > >

[jira] [Updated] (HUDI-2733) Adding Thrift support in HiveSyncTool

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2733: - Reviewers: Raymond Xu, sivabalan narayanan (was: sivabalan narayanan) > Adding Thrift support in HiveSync

[jira] [Assigned] (HUDI-2733) Adding Thrift support in HiveSyncTool

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2733: Assignee: Satyam Raj > Adding Thrift support in HiveSyncTool >

[jira] [Updated] (HUDI-2531) [UMBRELLA] Support Dataset APIs in writer paths

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2531: - Epic Status: Done > [UMBRELLA] Support Dataset APIs in writer paths >

[jira] [Closed] (HUDI-2620) Benchmark SparkDataFrameWriteClient

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2620. Resolution: Duplicate > Benchmark SparkDataFrameWriteClient > --- > >

[jira] [Closed] (HUDI-2615) Decouple HoodieRecordPayload with Hoodie table, table services, and index

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2615. Resolution: Duplicate > Decouple HoodieRecordPayload with Hoodie table, table services, and index >

[jira] [Closed] (HUDI-2618) Implement write operations other than upsert in SparkDataFrameWriteClient

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2618. Resolution: Duplicate > Implement write operations other than upsert in SparkDataFrameWriteClient >

[jira] [Closed] (HUDI-2619) Make table services work with Dataset

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2619. Resolution: Duplicate > Make table services work with Dataset > -- >

[jira] [Closed] (HUDI-2622) Enhance DataFrameWriter with LazyIterator and SpillableMap

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2622. Resolution: Duplicate > Enhance DataFrameWriter with LazyIterator and SpillableMap > ---

[jira] [Closed] (HUDI-1430) Implement SparkDataFrameWriteClient with SimpleIndex

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1430. Resolution: Duplicate > Implement SparkDataFrameWriteClient with SimpleIndex > -

[jira] [Closed] (HUDI-2616) Implement BloomIndex for Dataset

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2616. Resolution: Duplicate > Implement BloomIndex for Dataset > - > >

[jira] [Closed] (HUDI-2617) Implement HBase Index for Dataset

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2617. Resolution: Duplicate > Implement HBase Index for Dataset > -- > >

[jira] [Closed] (HUDI-2621) Enhance DataFrameWriter with small file handling

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2621. Resolution: Duplicate > Enhance DataFrameWriter with small file handling > -

[jira] [Closed] (HUDI-2531) [UMBRELLA] Support Dataset APIs in writer paths

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2531. Resolution: Duplicate > [UMBRELLA] Support Dataset APIs in writer paths > --

[jira] [Updated] (HUDI-2531) [UMBRELLA] Support Dataset APIs in writer paths

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2531: - Status: Open (was: In Progress) > [UMBRELLA] Support Dataset APIs in writer paths > -

[jira] [Updated] (HUDI-4295) Test TestHoodieActiveTimeline.testCreateNewInstantTime is flaky

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4295: - Component/s: tests-ci (was: core) > Test TestHoodieActiveTimeline.testCreateNewInstan

[jira] [Updated] (HUDI-4291) Test TestCleanPlanExecutor.testKeepLatestFileVersions is flaky

2022-08-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4291: - Component/s: tests-ci (was: core) > Test TestCleanPlanExecutor.testKeepLatestFileVers

  1   2   3   4   5   >