[jira] [Updated] (HUDI-4954) Shade avro in all bundles where it is included

2022-10-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4954: - Epic Link: HUDI-3529 > Shade avro in all bundles where it is included >

[jira] [Updated] (HUDI-83) Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync

2022-10-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-83: --- Sprint: Cont' improve - 2021/01/24, Cont' improve - 2021/01/31, 2022/09/05, 2022/10/04 (was: Cont' improve -

[jira] [Created] (HUDI-4977) Flink docs links are broken

2022-10-03 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-4977: - Summary: Flink docs links are broken Key: HUDI-4977 URL: https://issues.apache.org/jira/browse/HUDI-4977 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-4977) Flink docs links are broken

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4977: -- Labels: docs (was: ) > Flink docs links are broken > --- > >

[jira] [Created] (HUDI-4978) Keeping Documentation up to date

2022-10-03 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-4978: - Summary: Keeping Documentation up to date Key: HUDI-4978 URL: https://issues.apache.org/jira/browse/HUDI-4978 Project: Apache Hudi Issue Type: Epic

[jira] [Updated] (HUDI-4977) Flink docs links are broken

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4977: -- Epic Link: HUDI-4978 > Flink docs links are broken > --- > >

[jira] [Updated] (HUDI-4472) Revisit schema handling in HoodieSparkSqlWriter

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4472: -- Sprint: 2022/10/04 > Revisit schema handling in HoodieSparkSqlWriter >

[jira] [Updated] (HUDI-4489) Break down HoodieAnalysis rules into Spark-specific components

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4489: -- Sprint: 2022/10/04 > Break down HoodieAnalysis rules into Spark-specific components >

[jira] [Updated] (HUDI-4690) Remove code duplicated over from Spark

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4690: -- Sprint: 2022/10/04 > Remove code duplicated over from Spark >

[jira] [Updated] (HUDI-4468) Simplify TimeTravel logic for Spark 3.3

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4468: -- Sprint: 2022/10/04 > Simplify TimeTravel logic for Spark 3.3 >

[jira] [Updated] (HUDI-4503) Support table identifier with explicit catalog

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4503: -- Sprint: 2022/08/08, 2022/10/04 (was: 2022/08/08) > Support table identifier with explicit

[jira] [Updated] (HUDI-4588) Ingestion failing if source column is dropped

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4588: -- Sprint: 2022/08/08, 2022/08/22, 2022/09/05, 2022/10/04 (was: 2022/08/08, 2022/08/22,

[jira] [Updated] (HUDI-4496) ORC fails w/ Spark 3.1

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4496: -- Sprint: 2022/10/04 > ORC fails w/ Spark 3.1 > -- > > Key:

[jira] [Updated] (HUDI-4812) Lazy partition listing and file groups fetching in Spark Query

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-4812: -- Sprint: 2022/10/04 > Lazy partition listing and file groups fetching in Spark Query >

[jira] [Updated] (HUDI-3963) [RFC-53] Use Lock-Free Message Queue Improving Hoodie Writing Efficiency

2022-10-03 Thread Alexey Kudinkin (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3963: -- Sprint: 2022/10/04 > [RFC-53] Use Lock-Free Message Queue Improving Hoodie Writing Efficiency >

[jira] [Created] (HUDI-4976) Update docker demo website page to explain how to run on m1 macs

2022-10-03 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-4976: - Summary: Update docker demo website page to explain how to run on m1 macs Key: HUDI-4976 URL: https://issues.apache.org/jira/browse/HUDI-4976 Project: Apache Hudi

[jira] [Updated] (HUDI-4975) datahub sync bundle causes class loading issue

2022-10-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4975: - Fix Version/s: 0.12.2 > datahub sync bundle causes class loading issue >

[jira] [Created] (HUDI-4975) datahub sync bundle causes class loading issue

2022-10-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-4975: Summary: datahub sync bundle causes class loading issue Key: HUDI-4975 URL: https://issues.apache.org/jira/browse/HUDI-4975 Project: Apache Hudi Issue Type: Bug

[jira] [Commented] (HUDI-4974) Avoid creating Configuration copies in Hudi

2022-10-03 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612377#comment-17612377 ] Pratyaksh Sharma commented on HUDI-4974: [https://github.com/prestodb/presto/pull/18441] fixes

[jira] [Created] (HUDI-4974) Avoid creating Configuration copies in Hudi

2022-10-03 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-4974: - Summary: Avoid creating Configuration copies in Hudi Key: HUDI-4974 URL: https://issues.apache.org/jira/browse/HUDI-4974 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-4973) Support for JSONSchema

2022-10-03 Thread Atharva Inamdar (Jira)
Atharva Inamdar created HUDI-4973: - Summary: Support for JSONSchema Key: HUDI-4973 URL: https://issues.apache.org/jira/browse/HUDI-4973 Project: Apache Hudi Issue Type: New Feature

[jira] [Assigned] (HUDI-4964) Refactor HoodieWriteConfig to make sure we have a uniform and better way to access config value

2022-10-03 Thread Jian Feng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian Feng reassigned HUDI-4964: --- Assignee: Jian Feng > Refactor HoodieWriteConfig to make sure we have a uniform and better way to >

[jira] [Created] (HUDI-4972) Some unit tests cannot run on mac m1

2022-10-03 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-4972: - Summary: Some unit tests cannot run on mac m1 Key: HUDI-4972 URL: https://issues.apache.org/jira/browse/HUDI-4972 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4970: -- Fix Version/s: 0.12.2 (was: 0.13.0) > hudi-kafka-connect-bundle: Could not

[jira] [Updated] (HUDI-4971) aws bundle causes class loading issue

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4971: -- Epic Link: HUDI-3529 > aws bundle causes class loading issue > - >

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4970: -- Epic Link: HUDI-3529 > hudi-kafka-connect-bundle: Could not initialize class >

[jira] [Updated] (HUDI-4971) aws bundle causes class loading issue

2022-10-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4971: - Description: Putting aws bundle first before spark bundle will cause class loading issue {code} Caused

[jira] [Updated] (HUDI-4971) aws bundle causes class loading issue

2022-10-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4971: - Description: Putting aws bundle first before spark bundle will cause class loading issue {code} Caused

[jira] [Created] (HUDI-4971) aws bundle causes class loading issue

2022-10-03 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-4971: Summary: aws bundle causes class loading issue Key: HUDI-4971 URL: https://issues.apache.org/jira/browse/HUDI-4971 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-4971) aws bundle causes class loading issue

2022-10-03 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-4971: - Description: Putting aws bundle first before spark bundle will cause class loading issue {code} Caused

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4970: -- Priority: Critical (was: Blocker) > hudi-kafka-connect-bundle: Could not initialize class >

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4970: -- Fix Version/s: 0.12.2 (was: 0.12.1) > hudi-kafka-connect-bundle: Could not

[jira] [Updated] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-4970: -- Fix Version/s: 0.13.0 (was: 0.12.2) > hudi-kafka-connect-bundle: Could not

[jira] [Commented] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612254#comment-17612254 ] Sagar Sumit commented on HUDI-4970: --- The issue happens because of a conflict between Hdfs-common version

[hudi] branch master updated: [HUDI-4962] Move cloud dependencies to cloud modules (#6846)

2022-10-03 Thread codope
This is an automated email from the ASF dual-hosted git repository. codope pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 48715d54c1 [HUDI-4962] Move cloud dependencies to

[jira] [Created] (HUDI-4970) hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation

2022-10-03 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-4970: - Summary: hudi-kafka-connect-bundle: Could not initialize class org.apache.hadoop.security.UserGroupInformation Key: HUDI-4970 URL: https://issues.apache.org/jira/browse/HUDI-4970