[hudi] branch master updated: [HOTFIX] Fix source release validate script (#6865)

2022-10-04 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 48e5bb0fed [HOTFIX] Fix source release validate

[jira] [Updated] (HUDI-4975) datahub sync bundle causes class loading issue

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4975: - Status: In Progress (was: Open) > datahub sync bundle causes class loading issue > --

[jira] [Updated] (HUDI-4971) aws bundle causes class loading issue

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4971: - Status: In Progress (was: Open) > aws bundle causes class loading issue > ---

[jira] [Updated] (HUDI-4982) Make bundle combination testing covered in CI

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4982: - Status: In Progress (was: Open) > Make bundle combination testing covered in CI > ---

[jira] [Updated] (HUDI-4954) Shade avro in all bundles where it is included

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4954: - Reviewers: Raymond Xu > Shade avro in all bundles where it is included >

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4970: - Reviewers: Raymond Xu > hudi-kafka-connect-bundle: Could not initialize class > org.apache.hadoop.securit

[jira] [Updated] (HUDI-4982) Make bundle combination testing covered in CI

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4982: - Reviewers: Raymond Xu > Make bundle combination testing covered in CI > --

[jira] [Updated] (HUDI-4959) Serializing objects using Kryo fails to deserialize data back w/o prior registration

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4959: - Reviewers: Raymond Xu > Serializing objects using Kryo fails to deserialize data back w/o prior > registr

[jira] [Updated] (HUDI-4855) Bootstrap table from Deltastreamer cannot be read in Spark

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4855: - Priority: Blocker (was: Major) > Bootstrap table from Deltastreamer cannot be read in Spark > ---

[jira] [Updated] (HUDI-3654) Support basic actions based on hudi metastore server

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3654: - Priority: Blocker (was: Major) > Support basic actions based on hudi metastore server >

[jira] [Updated] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4986: - Component/s: docs > Enhance hudi integ test readme for multi-writer tests > --

[jira] [Updated] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4986: - Story Points: 0.5 (was: 1) > Enhance hudi integ test readme for multi-writer tests >

[jira] [Updated] (HUDI-4981) Add bundle testing in regular integration testing w/ azure CI

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4981: - Story Points: 0 (was: 12) > Add bundle testing in regular integration testing w/ azure CI >

[jira] [Updated] (HUDI-4981) Add bundle testing in regular integration testing w/ azure CI

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4981: - Fix Version/s: (was: 0.13.0) > Add bundle testing in regular integration testing w/ azure CI > --

[jira] [Updated] (HUDI-3259) Code Refactor: Common prep records commit util for Spark and Flink

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3259: - Story Points: 0 (was: 4) > Code Refactor: Common prep records commit util for Spark and Flink > -

[jira] [Updated] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-83: --- Reviewers: Raymond Xu > Map Timestamp type in spark to corresponding Timestamp type in Hive during > Hive sync

[jira] [Updated] (HUDI-4716) Avoid bundle parquet in hadoop-mr

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4716: - Epic Link: HUDI-3529 > Avoid bundle parquet in hadoop-mr > - > >

[jira] [Created] (HUDI-4988) Add Docs regarding Hudi RecordMerger

2022-10-04 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-4988: - Summary: Add Docs regarding Hudi RecordMerger Key: HUDI-4988 URL: https://issues.apache.org/jira/browse/HUDI-4988 Project: Apache Hudi Issue Type: Improvem

[jira] [Updated] (HUDI-4925) Should Force to use ExpressionPayload in MergeIntoTableCommand

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4925: -- Status: In Progress (was: Open) > Should Force to use ExpressionPayload in MergeIntoTableComman

[jira] [Closed] (HUDI-4925) Should Force to use ExpressionPayload in MergeIntoTableCommand

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin closed HUDI-4925. - Resolution: Fixed > Should Force to use ExpressionPayload in MergeIntoTableCommand > -

[jira] [Updated] (HUDI-4925) Should Force to use ExpressionPayload in MergeIntoTableCommand

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4925: -- Fix Version/s: 0.12.1 > Should Force to use ExpressionPayload in MergeIntoTableCommand > ---

[jira] [Assigned] (HUDI-4925) Should Force to use ExpressionPayload in MergeIntoTableCommand

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reassigned HUDI-4925: - Assignee: Jian Feng > Should Force to use ExpressionPayload in MergeIntoTableCommand > --

[jira] [Updated] (HUDI-4937) Fix HoodieTable injecting HoodieBackedTableMetadat not reusing underlying MT readers

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4937: -- Sprint: 2022/10/04 > Fix HoodieTable injecting HoodieBackedTableMetadat not reusing underlying M

[hudi] branch dependabot/maven/com.google.protobuf-protobuf-java-3.21.7 created (now 050ce213e4)

2022-10-04 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/com.google.protobuf-protobuf-java-3.21.7 in repository https://gitbox.apache.org/repos/asf/hudi.git at 050ce213e4 Bump protobuf-java from 3.21.5 to 3.21.7 No new revi

[jira] [Updated] (HUDI-4987) Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer still backward compatible

2022-10-04 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4987: Description: We want to rename HoodieDeltastreamer to HoodieStreamer to be concise.  Users on HoodieDeltastr

[jira] [Updated] (HUDI-4987) Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer still backward compatible

2022-10-04 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4987: Description: We want to rename HoodieDeltastreamer to HoodieStreamer to be concise.  Users on HoodieDeltastr

[jira] [Updated] (HUDI-4987) Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer still backward compatible

2022-10-04 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4987: Description: We want to rename  > Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer

[jira] [Updated] (HUDI-4987) Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer still backward compatible

2022-10-04 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4987: Fix Version/s: 0.13.0 > Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer > still b

[jira] [Created] (HUDI-4987) Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer still backward compatible

2022-10-04 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-4987: --- Summary: Rename HoodieDeltastreamer to HoodieStreamer and make HoodieDeltastreamer still backward compatible Key: HUDI-4987 URL: https://issues.apache.org/jira/browse/HUDI-4987

[jira] [Updated] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4986: -- Story Points: 1 > Enhance hudi integ test readme for multi-writer tests > --

[jira] [Updated] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4986: -- Sprint: 2022/10/04 > Enhance hudi integ test readme for multi-writer tests > ---

[jira] [Updated] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4986: -- Fix Version/s: 0.13.0 > Enhance hudi integ test readme for multi-writer tests >

[jira] [Assigned] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4986: - Assignee: sivabalan narayanan > Enhance hudi integ test readme for multi-writer t

[jira] [Created] (HUDI-4986) Enhance hudi integ test readme for multi-writer tests

2022-10-04 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-4986: - Summary: Enhance hudi integ test readme for multi-writer tests Key: HUDI-4986 URL: https://issues.apache.org/jira/browse/HUDI-4986 Project: Apache Hudi

[jira] [Created] (HUDI-4985) Update the arm64 images in docker demo to the latest hudi version

2022-10-04 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-4985: - Summary: Update the arm64 images in docker demo to the latest hudi version Key: HUDI-4985 URL: https://issues.apache.org/jira/browse/HUDI-4985 Project: Apache Hudi

[jira] [Created] (HUDI-4984) Presto and Trino don't work in Docker Demo M1 mac

2022-10-04 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-4984: - Summary: Presto and Trino don't work in Docker Demo M1 mac Key: HUDI-4984 URL: https://issues.apache.org/jira/browse/HUDI-4984 Project: Apache Hudi Issue T

[jira] [Closed] (HUDI-3259) Code Refactor: Common prep records commit util for Spark and Flink

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3259. - Fix Version/s: 0.12.0 (was: 0.13.0) Resolution: Fixed > Code

[jira] [Commented] (HUDI-3259) Code Refactor: Common prep records commit util for Spark and Flink

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612713#comment-17612713 ] sivabalan narayanan commented on HUDI-3259: --- looks like this is already taken ca

[jira] [Updated] (HUDI-3217) RFC-46: Optimize Record Payload handling

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3217: -- Epic Name: RFC-46: Engine Native Record Payloads (was: Record-Payload-Handling-Rewrite) > RFC-

[jira] [Updated] (HUDI-3963) [RFC-53] Use Lock-Free Message Queue Improving Hoodie Writing Efficiency

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3963: - Story Points: 3 > [RFC-53] Use Lock-Free Message Queue Improving Hoodie Writing Efficiency > -

[jira] [Updated] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4983: - Story Points: 3 > Integrate hudi-examples to be tested with azure CI test run > --

[jira] [Updated] (HUDI-4812) Lazy partition listing and file groups fetching in Spark Query

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4812: - Story Points: 2 > Lazy partition listing and file groups fetching in Spark Query > ---

[jira] [Updated] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4983: -- Sprint: 2022/10/04 > Integrate hudi-examples to be tested with azure CI test run > -

[jira] [Updated] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4983: -- Fix Version/s: 0.13.0 > Integrate hudi-examples to be tested with azure CI test run > --

[jira] [Assigned] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-4983: - Assignee: Jonathan Vexler > Integrate hudi-examples to be tested with azure CI te

[jira] [Updated] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4983: -- Epic Link: HUDI-3303 > Integrate hudi-examples to be tested with azure CI test run > ---

[jira] [Updated] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4983: -- Priority: Critical (was: Major) > Integrate hudi-examples to be tested with azure CI te

[jira] [Created] (HUDI-4983) Integrate hudi-examples to be tested with azure CI test run

2022-10-04 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-4983: - Summary: Integrate hudi-examples to be tested with azure CI test run Key: HUDI-4983 URL: https://issues.apache.org/jira/browse/HUDI-4983 Project: Apache Hud

[hudi] annotated tag release-0.12.1-rc1 updated (290fc65272 -> 6dc6311be1)

2022-10-04 Thread yuzhaojing
This is an automated email from the ASF dual-hosted git repository. yuzhaojing pushed a change to annotated tag release-0.12.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git *** WARNING: tag release-0.12.1-rc1 was modified! *** from 290fc65272 (commit) to 6dc6311be1 (t

[hudi] branch release-0.12.1 updated: [HOTFIX] Fix source release validate script

2022-10-04 Thread yuzhaojing
This is an automated email from the ASF dual-hosted git repository. yuzhaojing pushed a commit to branch release-0.12.1 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.12.1 by this push: new 290fc65272 [HOTFIX] Fix source

[jira] [Updated] (HUDI-4588) Ingestion failing if source column is dropped

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4588: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Ingestion failing if source column

[jira] [Updated] (HUDI-4468) Simplify TimeTravel logic for Spark 3.3

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4468: - Sprint: (was: 2022/10/04) > Simplify TimeTravel logic for Spark 3.3 > --

[jira] [Updated] (HUDI-4976) Update docker demo website page to explain how to run on m1 macs

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4976: - Story Points: 1 > Update docker demo website page to explain how to run on m1 macs > -

[jira] [Updated] (HUDI-4847) hive sync fails w/ utilities bundle in 0.13-snapshot, but succeeds w/ 0.11

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4847: - Story Points: 2 > hive sync fails w/ utilities bundle in 0.13-snapshot, but succeeds w/ 0.11 > ---

[jira] [Closed] (HUDI-4981) Add bundle testing in regular integration testing w/ azure CI

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4981. - Resolution: Duplicate > Add bundle testing in regular integration testing w/ azure CI > -

[jira] [Closed] (HUDI-4792) Speed up cleaning with metadata table enabled

2022-10-04 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin closed HUDI-4792. - Resolution: Duplicate > Speed up cleaning with metadata table enabled > -

[jira] [Updated] (HUDI-4969) Invalid partition value for Hudi table

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4969: - Story Points: 1 (was: 2) > Invalid partition value for Hudi table > -

[jira] [Updated] (HUDI-4974) Avoid creating Configuration copies in Hudi

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4974: - Story Points: 3 > Avoid creating Configuration copies in Hudi > --

[jira] [Updated] (HUDI-2871) Decouple metrics dependencies from hudi-client-common

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2871: - Priority: Critical (was: Blocker) > Decouple metrics dependencies from hudi-client-common > -

[jira] [Updated] (HUDI-4982) Make bundle combination testing covered in CI

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4982: - Story Points: 5 > Make bundle combination testing covered in CI >

[jira] [Assigned] (HUDI-4982) Make bundle combination testing covered in CI

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4982: Assignee: Jonathan Vexler > Make bundle combination testing covered in CI > ---

[jira] [Commented] (HUDI-4981) Add bundle testing in regular integration testing w/ azure CI

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612648#comment-17612648 ] sivabalan narayanan commented on HUDI-4981: --- closing in favor of https://issues.

[jira] [Updated] (HUDI-4975) datahub sync bundle causes class loading issue

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4975: - Story Points: 1 > datahub sync bundle causes class loading issue > ---

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4970: - Story Points: 2 > hudi-kafka-connect-bundle: Could not initialize class > org.apache.hadoop.security.User

[jira] [Updated] (HUDI-4971) aws bundle causes class loading issue

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4971: - Story Points: 1 > aws bundle causes class loading issue > - > >

[jira] [Updated] (HUDI-4954) Shade avro in all bundles where it is included

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4954: - Story Points: 2 > Shade avro in all bundles where it is included > --

[jira] [Assigned] (HUDI-4954) Shade avro in all bundles where it is included

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4954: Assignee: Sagar Sumit > Shade avro in all bundles where it is included > -

[jira] [Assigned] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4970: Assignee: Sagar Sumit > hudi-kafka-connect-bundle: Could not initialize class > org.apache.hadoop.

[jira] [Assigned] (HUDI-4975) datahub sync bundle causes class loading issue

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4975: Assignee: Raymond Xu > datahub sync bundle causes class loading issue > ---

[jira] [Assigned] (HUDI-4971) aws bundle causes class loading issue

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-4971: Assignee: Raymond Xu > aws bundle causes class loading issue >

[jira] [Updated] (HUDI-3636) Clustering fails due to marker creation failure

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3636: - Sprint: 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/22, 2022/09/05, 2022/09/19) > Clust

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1574: - Sprint: 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/22, 2022/09/05, 2022/09/19) > Trim

[jira] [Updated] (HUDI-4921) Fix last completed commit in CleanPlanner

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4921: - Sprint: 2022/09/19, 2022/10/04 (was: 2022/09/19) > Fix last completed commit in CleanPlanner > --

[jira] [Updated] (HUDI-4855) Bootstrap table from Deltastreamer cannot be read in Spark

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4855: - Sprint: 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/09/05, 2022/09/19) > Bootstrap table from Deltastre

[jira] [Updated] (HUDI-3967) Automatic savepoint in Hudi

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3967: - Sprint: 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/22, 2022/09/05, 2022/09/19) > Autom

[jira] [Updated] (HUDI-4754) Add compliance check in GH actions

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4754: - Sprint: 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/22, 2022/09/05, 2022/09/19) > Add c

[jira] [Updated] (HUDI-3529) Improve dependency management and bundling

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3529: - Sprint: 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/22, 2022/09/05, 2022/09/19) > Impro

[jira] [Updated] (HUDI-4952) Reading from metadata table could fail when there are no completed commits

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4952: - Sprint: 2022/09/19, 2022/10/04 (was: 2022/09/19) > Reading from metadata table could fail when there are

[jira] [Updated] (HUDI-4959) Serializing objects using Kryo fails to deserialize data back w/o prior registration

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4959: - Sprint: 2022/09/19, 2022/10/04 (was: 2022/09/19) > Serializing objects using Kryo fails to deserialize da

[jira] [Updated] (HUDI-3249) Performance Improvements

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3249: - Sprint: 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/22, 2022/09/05, 2022/09/19) > Perfo

[jira] [Updated] (HUDI-3601) Support multi-arch builds in docker setup

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3601: - Sprint: 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/09/05, 2022/09/19) > Support multi-arch builds in d

[jira] [Updated] (HUDI-4585) Optimize query performance on Presto Hudi connector

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4585: - Sprint: 2022/08/08, 2022/08/22, 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/08/08, 2022/08/22, 2022/09/

[jira] [Updated] (HUDI-3287) Remove unnecessary deps in hudi-kafka-connect

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3287: - Sprint: Hudi-Sprint-Mar-01, 2022/09/19, 2022/10/04 (was: Hudi-Sprint-Mar-01, 2022/09/19) > Remove unnece

[jira] [Updated] (HUDI-2786) Failed to connect to namenode in Docker Demo on Apple M1 chip

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2786: - Sprint: 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/09/05, 2022/09/19) > Failed to connect to namenode

[jira] [Updated] (HUDI-4847) hive sync fails w/ utilities bundle in 0.13-snapshot, but succeeds w/ 0.11

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4847: - Sprint: 2022/09/19, 2022/10/04 (was: 2022/09/19) > hive sync fails w/ utilities bundle in 0.13-snapshot,

[jira] [Updated] (HUDI-4792) Speed up cleaning with metadata table enabled

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4792: - Sprint: 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/09/05, 2022/09/19) > Speed up cleaning with metadat

[jira] [Updated] (HUDI-4201) Add tooling to delete empty non-completed instants from timeline

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4201: - Sprint: 2022/09/05, 2022/09/19, 2022/10/04 (was: 2022/09/05, 2022/09/19) > Add tooling to delete empty no

[jira] [Updated] (HUDI-2786) Failed to connect to namenode in Docker Demo on Apple M1 chip

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2786: - Status: Patch Available (was: In Progress) > Failed to connect to namenode in Docker Demo on Apple M1 chi

[jira] [Updated] (HUDI-4952) Reading from metadata table could fail when there are no completed commits

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4952: - Status: Patch Available (was: In Progress) > Reading from metadata table could fail when there are no com

[jira] [Commented] (HUDI-2786) Failed to connect to namenode in Docker Demo on Apple M1 chip

2022-10-04 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17612642#comment-17612642 ] Raymond Xu commented on HUDI-2786: -- [~jonvex] to create follow up tasks and link from her

[jira] [Updated] (HUDI-4952) Reading from metadata table could fail when there are no completed commits

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4952: -- Story Points: 2 > Reading from metadata table could fail when there are no completed com

[jira] [Updated] (HUDI-2613) Fix usages of RealtimeSplit to use the new getDeltaLogFileStatus

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2613: -- Sprint: 2022/10/04 > Fix usages of RealtimeSplit to use the new getDeltaLogFileStatus >

[jira] [Updated] (HUDI-2613) Fix usages of RealtimeSplit to use the new getDeltaLogFileStatus

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2613: -- Priority: Critical (was: Blocker) > Fix usages of RealtimeSplit to use the new getDelta

[jira] [Updated] (HUDI-3954) Don't keep the last commit before the earliest commit to retain

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3954: -- Sprint: 2022/10/04 > Don't keep the last commit before the earliest commit to retain > -

[jira] [Assigned] (HUDI-2613) Fix usages of RealtimeSplit to use the new getDeltaLogFileStatus

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2613: - Assignee: Jonathan Vexler (was: sivabalan narayanan) > Fix usages of RealtimeSpl

[jira] [Updated] (HUDI-3397) Make sure Spark RDDs triggering actual FS activity are only dereferenced once

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3397: -- Sprint: 2022/09/05, 2022/10/04 (was: 2022/09/05) > Make sure Spark RDDs triggering actu

[jira] [Updated] (HUDI-4631) Enhance retries for failed writes w/ write conflicts in a multi writer scenarios

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4631: -- Story Points: 3 > Enhance retries for failed writes w/ write conflicts in a multi writer

[jira] [Closed] (HUDI-4722) Add support for metrics for locking infra

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-4722. - Resolution: Fixed > Add support for metrics for locking infra > --

[jira] [Updated] (HUDI-4722) Add support for metrics for locking infra

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4722: -- Sprint: 2022/09/05, 2022/09/19 (was: 2022/09/05, 2022/10/04) > Add support for metrics

[jira] [Updated] (HUDI-4878) Fix incremental cleaning for clean based on LATEST_FILE_VERSIONS

2022-10-04 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-4878: -- Sprint: 2022/09/05, 2022/10/04 (was: 2022/09/05) > Fix incremental cleaning for clean b

  1   2   >