[jira] [Commented] (HUDI-7595) Investigate and fix flaky tests in ITTestHoodieDataSource

2024-09-23 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884114#comment-17884114 ] Shiyan Xu commented on HUDI-7595: - [~shubhamgondane]  not seeing any PR linked to this jir

[jira] [Commented] (HUDI-7960) Support more partitioner in Hudi Flink integration

2024-08-22 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876068#comment-17876068 ] Shiyan Xu commented on HUDI-7960: - this is mainly about supporting more implementation in

[jira] [Commented] (HUDI-8066) Cherrypick Flink 1.18 into hudi 0.14 branch

2024-08-12 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873085#comment-17873085 ] Shiyan Xu commented on HUDI-8066: - a branch named `release-0.14.2` should be created based

[jira] [Created] (HUDI-8028) Make hudi-common jar to support some newer spark/flink versions

2024-07-26 Thread Shiyan Xu (Jira)
Shiyan Xu created HUDI-8028: --- Summary: Make hudi-common jar to support some newer spark/flink versions Key: HUDI-8028 URL: https://issues.apache.org/jira/browse/HUDI-8028 Project: Apache Hudi Issu

[jira] [Created] (HUDI-7984) Spark SQL should allow type promotion without using schema on read

2024-07-12 Thread Shiyan Xu (Jira)
Shiyan Xu created HUDI-7984: --- Summary: Spark SQL should allow type promotion without using schema on read Key: HUDI-7984 URL: https://issues.apache.org/jira/browse/HUDI-7984 Project: Apache Hudi I

[jira] [Assigned] (HUDI-7960) Support more partitioner in Hudi Flink integration

2024-07-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu reassigned HUDI-7960: --- Assignee: Zhenqiu Huang > Support more partitioner in Hudi Flink integration > -

[jira] [Updated] (HUDI-7929) Add Flink Hudi Example for K8s

2024-06-24 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-7929: Component/s: flink > Add Flink Hudi Example for K8s > -- > > Key

[jira] [Updated] (HUDI-7929) Add Flink Hudi Example for K8s

2024-06-24 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-7929: Fix Version/s: 1.0.0 > Add Flink Hudi Example for K8s > -- > > K

[jira] [Assigned] (HUDI-7929) Add Flink Hudi Example for K8s

2024-06-24 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu reassigned HUDI-7929: --- Assignee: Zhenqiu Huang > Add Flink Hudi Example for K8s > -- > >

[jira] [Closed] (HUDI-7376) Cancel running test instances in Azure CI when the PR is updated

2024-06-15 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-7376. --- Assignee: Shiyan Xu (was: Raymond Xu) Resolution: Cannot Reproduce > Cancel running test instances in A

[jira] [Commented] (HUDI-4705) Support Write-on-compaction mode when query cdc on MOR tables

2024-06-07 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17853214#comment-17853214 ] Shiyan Xu commented on HUDI-4705: - [~lizhiqiang] [~biyan900...@gmail.com] to clarify, CDC

[jira] [Closed] (HUDI-6633) Add hms based sync to hudi website

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-6633. --- Resolution: Fixed > Add hms based sync to hudi website > -- > >

[jira] [Updated] (HUDI-4967) Improve docs for meta sync with TimestampBasedKeyGenerator

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-4967: Status: Open (was: Patch Available) > Improve docs for meta sync with TimestampBasedKeyGenerator >

[jira] [Closed] (HUDI-4834) Update AWSGlueCatalog syncing oage to add spark datasource example

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-4834. --- Fix Version/s: 1.0.0 Resolution: Fixed > Update AWSGlueCatalog syncing oage to add spark datasource exa

[jira] [Closed] (HUDI-4967) Improve docs for meta sync with TimestampBasedKeyGenerator

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-4967. --- Fix Version/s: 1.0.0 Resolution: Fixed > Improve docs for meta sync with TimestampBasedKeyGenerator > -

[jira] [Updated] (HUDI-6230) Make hive sync aws support partition indexes

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-6230: Fix Version/s: 0.15.0 > Make hive sync aws support partition indexes > -

[jira] [Closed] (HUDI-1964) Update guide around hive metastore and hive sync for hudi tables

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-1964. --- Resolution: Duplicate > Update guide around hive metastore and hive sync for hudi tables > ---

[jira] [Updated] (HUDI-1964) Update guide around hive metastore and hive sync for hudi tables

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-1964: Fix Version/s: 1.0.0 > Update guide around hive metastore and hive sync for hudi tables > --

[jira] [Updated] (HUDI-6633) Add hms based sync to hudi website

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-6633: Fix Version/s: 1.0.0 > Add hms based sync to hudi website > -- > >

[jira] [Closed] (HUDI-851) Add Documentation on partitioning data with examples and details on how to sync to Hive

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-851. -- Fix Version/s: 1.0.0 (was: 0.15.0) Resolution: Duplicate > Add Documentation on par

[jira] [Closed] (HUDI-7414) Remove hoodie.gcp.bigquery.sync.base_path reference in the gcp docs

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-7414. --- Resolution: Fixed > Remove hoodie.gcp.bigquery.sync.base_path reference in the gcp docs >

[jira] [Updated] (HUDI-7414) Remove hoodie.gcp.bigquery.sync.base_path reference in the gcp docs

2024-06-05 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-7414: Fix Version/s: 1.0.0 (was: 0.15.0) > Remove hoodie.gcp.bigquery.sync.base_path refere

[jira] [Closed] (HUDI-7289) Fix parameters for Big Query Sync

2024-06-04 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-7289. --- Resolution: Fixed > Fix parameters for Big Query Sync > - > >

[jira] [Assigned] (HUDI-7289) Fix parameters for Big Query Sync

2024-06-04 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu reassigned HUDI-7289: --- Assignee: nadine (was: Shiyan Xu) > Fix parameters for Big Query Sync >

[jira] [Updated] (HUDI-7383) CDC query failed due to dependency issue

2024-05-15 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-7383: Fix Version/s: 0.15.0 > CDC query failed due to dependency issue >

[jira] [Closed] (HUDI-7383) CDC query failed due to dependency issue

2024-05-15 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-7383. --- Resolution: Fixed > CDC query failed due to dependency issue > > >

[jira] [Commented] (HUDI-5616) Docs update for specifying org.apache.spark.HoodieSparkKryoRegistrar

2024-05-09 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845134#comment-17845134 ] Shiyan Xu commented on HUDI-5616: - fixed [https://github.com/apache/hudi/pull/11184] > Do

[jira] [Closed] (HUDI-5616) Docs update for specifying org.apache.spark.HoodieSparkKryoRegistrar

2024-05-09 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-5616. --- Resolution: Fixed > Docs update for specifying org.apache.spark.HoodieSparkKryoRegistrar > ---

[jira] [Closed] (HUDI-5382) hoodie.datasource.write.partitionpath.field is inconsistent in the document

2024-05-09 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu closed HUDI-5382. --- Fix Version/s: (was: 0.15.0) Resolution: Not A Problem > hoodie.datasource.write.partitionpath.fiel

[jira] [Commented] (HUDI-5382) hoodie.datasource.write.partitionpath.field is inconsistent in the document

2024-05-09 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845133#comment-17845133 ] Shiyan Xu commented on HUDI-5382: - already fixed in the latest docs [https://hudi.apache.

[jira] [Updated] (HUDI-5710) Load all partitions in advance for clean when MDT is enabled

2024-05-07 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu updated HUDI-5710: Fix Version/s: 0.14.0 > Load all partitions in advance for clean when MDT is enabled > -

[jira] [Assigned] (HUDI-5710) Load all partitions in advance for clean when MDT is enabled

2024-05-07 Thread Shiyan Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiyan Xu reassigned HUDI-5710: --- Assignee: Yue Zhang > Load all partitions in advance for clean when MDT is enabled >