[jira] [Commented] (HUDI-5708) Make docker not a requirement for building metaserver

2023-02-07 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685345#comment-17685345 ] XiaoyuGeng commented on HUDI-5708: -- Thanks Raymond for reporting and processing this issu

[jira] [Created] (HUDI-5621) Decouple hive from bundle test

2023-01-25 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-5621: Summary: Decouple hive from bundle test Key: HUDI-5621 URL: https://issues.apache.org/jira/browse/HUDI-5621 Project: Apache Hudi Issue Type: Improvement Co

[jira] [Created] (HUDI-5594) Add metasever bundle validation

2023-01-20 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-5594: Summary: Add metasever bundle validation Key: HUDI-5594 URL: https://issues.apache.org/jira/browse/HUDI-5594 Project: Apache Hudi Issue Type: New Feature C

[jira] [Created] (HUDI-5483) Make RetryHelper more suitable for common use

2022-12-28 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-5483: Summary: Make RetryHelper more suitable for common use Key: HUDI-5483 URL: https://issues.apache.org/jira/browse/HUDI-5483 Project: Apache Hudi Issue Type: Improveme

[jira] [Closed] (HUDI-5129) ByteDance Weekly Sync

2022-11-01 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng closed HUDI-5129. Resolution: Fixed > ByteDance Weekly Sync > - > > Key: HUDI-5129 >

[jira] [Closed] (HUDI-5130) RFC-46 Landing

2022-11-01 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng closed HUDI-5130. Resolution: Fixed > RFC-46 Landing > -- > > Key: HUDI-5130 > URL

[jira] [Updated] (HUDI-5130) RFC-46 Landing

2022-11-01 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-5130: - Issue Type: New Feature (was: Task) > RFC-46 Landing > -- > > Key: HUDI-5130

[jira] [Created] (HUDI-5130) RFC-46 Landing

2022-11-01 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-5130: Summary: RFC-46 Landing Key: HUDI-5130 URL: https://issues.apache.org/jira/browse/HUDI-5130 Project: Apache Hudi Issue Type: Task Reporter: XiaoyuGeng

[jira] [Created] (HUDI-5129) ByteDance Weekly Sync

2022-11-01 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-5129: Summary: ByteDance Weekly Sync Key: HUDI-5129 URL: https://issues.apache.org/jira/browse/HUDI-5129 Project: Apache Hudi Issue Type: Epic Reporter: Xiaoyu

[jira] [Comment Edited] (HUDI-4415) Support spark writer running on thrift server

2022-07-25 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570714#comment-17570714 ] XiaoyuGeng edited comment on HUDI-4415 at 7/25/22 7:54 AM: --- [~rm

[jira] [Commented] (HUDI-4415) Support spark writer running on thrift server

2022-07-25 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570714#comment-17570714 ] XiaoyuGeng commented on HUDI-4415: -- [~rmahindra] If the problem is high priority accordin

[jira] [Created] (HUDI-4428) Make the meta server configurable when starting

2022-07-20 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-4428: Summary: Make the meta server configurable when starting Key: HUDI-4428 URL: https://issues.apache.org/jira/browse/HUDI-4428 Project: Apache Hudi Issue Type: New Fea

[jira] [Created] (HUDI-4415) Support spark writer running on thrift server

2022-07-18 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-4415: Summary: Support spark writer running on thrift server Key: HUDI-4415 URL: https://issues.apache.org/jira/browse/HUDI-4415 Project: Apache Hudi Issue Type: New Featu

[jira] [Resolved] (HUDI-4102) Optimization of bucket index in Flink

2022-05-18 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng resolved HUDI-4102. -- > Optimization of bucket index in Flink > - > > Key: HUD

[jira] [Commented] (HUDI-4102) Optimization of bucket index in Flink

2022-05-18 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17538908#comment-17538908 ] XiaoyuGeng commented on HUDI-4102: -- fixed by https://issues.apache.org/jira/browse/HUDI-4

[jira] [Assigned] (HUDI-3654) Support basic actions based on hudi metastore server

2022-03-17 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng reassigned HUDI-3654: Component/s: metadata Epic Link: HUDI-3345 Assignee: XiaoyuGeng Summary: Suppor

[jira] [Updated] (HUDI-3345) [Umbrella] Hudi metastore server

2022-03-17 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-3345: - Issue Type: Epic (was: New Feature) > [Umbrella] Hudi metastore server >

[jira] [Created] (HUDI-3654) Support

2022-03-17 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-3654: Summary: Support Key: HUDI-3654 URL: https://issues.apache.org/jira/browse/HUDI-3654 Project: Apache Hudi Issue Type: New Feature Reporter: XiaoyuGeng

[jira] [Updated] (HUDI-3345) [Umbrella] Hudi metastore server

2022-03-17 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-3345: - Summary: [Umbrella] Hudi metastore server (was: Hudi metastore server) > [Umbrella] Hudi metastore server

[jira] [Created] (HUDI-3419) Load class through reflection in a thread-safe way

2022-02-13 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-3419: Summary: Load class through reflection in a thread-safe way Key: HUDI-3419 URL: https://issues.apache.org/jira/browse/HUDI-3419 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-3345) Hudi metastore server

2022-01-29 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-3345: Summary: Hudi metastore server Key: HUDI-3345 URL: https://issues.apache.org/jira/browse/HUDI-3345 Project: Apache Hudi Issue Type: New Feature Reporter:

[jira] [Updated] (HUDI-3121) Spark datasource with bucket index unit test reuse

2021-12-28 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-3121: - Issue Type: Improvement (was: New Feature) > Spark datasource with bucket index unit test reuse > ---

[jira] [Created] (HUDI-3121) Spark datasource with bucket index unit test reuse

2021-12-28 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-3121: Summary: Spark datasource with bucket index unit test reuse Key: HUDI-3121 URL: https://issues.apache.org/jira/browse/HUDI-3121 Project: Apache Hudi Issue Type: New

[jira] [Updated] (HUDI-3039) [Umbrella] Bucket Index

2021-12-16 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-3039: - Description: RFC-29 umbrella ticket. Labels: hudi-umbrellas (was: ) > [Umbrella] Bucket Index >

[jira] [Created] (HUDI-3039) [Umbrella] Bucket Index

2021-12-16 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-3039: Summary: [Umbrella] Bucket Index Key: HUDI-3039 URL: https://issues.apache.org/jira/browse/HUDI-3039 Project: Apache Hudi Issue Type: New Feature Component

[jira] [Created] (HUDI-2881) Compact the file group with larger log files to reduce write amplification

2021-11-29 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2881: Summary: Compact the file group with larger log files to reduce write amplification Key: HUDI-2881 URL: https://issues.apache.org/jira/browse/HUDI-2881 Project: Apache Hudi

[jira] [Created] (HUDI-2679) TestMergeIntoLogOnlyTable typo

2021-11-03 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2679: Summary: TestMergeIntoLogOnlyTable typo Key: HUDI-2679 URL: https://issues.apache.org/jira/browse/HUDI-2679 Project: Apache Hudi Issue Type: Test Reporte

[jira] [Assigned] (HUDI-2628) Fix Chinese Docs

2021-10-28 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng reassigned HUDI-2628: Assignee: XiaoyuGeng (was: Kyle Weller) > Fix Chinese Docs > > >

[jira] [Commented] (HUDI-2628) Fix Chinese Docs

2021-10-28 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17435393#comment-17435393 ] XiaoyuGeng commented on HUDI-2628: -- Thanks to report the issue, i will follow this and do

[jira] [Assigned] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-09-09 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng reassigned HUDI-1870: Assignee: XiaoyuGeng I will take this > Move spark avro serialization class into hudi repo > -

[jira] [Created] (HUDI-2385) Make parquet dictionary encoding configurable

2021-08-31 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2385: Summary: Make parquet dictionary encoding configurable Key: HUDI-2385 URL: https://issues.apache.org/jira/browse/HUDI-2385 Project: Apache Hudi Issue Type: Improveme

[jira] [Created] (HUDI-2384) Allow log file size more than 2GB

2021-08-31 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2384: Summary: Allow log file size more than 2GB Key: HUDI-2384 URL: https://issues.apache.org/jira/browse/HUDI-2384 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-2383) Clean marker files after compaction and clustering

2021-08-31 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-2383: - Component/s: Common Core > Clean marker files after compaction and clustering > --

[jira] [Created] (HUDI-2383) Clean marker files after compaction and clustering

2021-08-31 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2383: Summary: Clean marker files after compaction and clustering Key: HUDI-2383 URL: https://issues.apache.org/jira/browse/HUDI-2383 Project: Apache Hudi Issue Type: Impr

[jira] [Created] (HUDI-2297) Estimate available memory size for spillable map accurately

2021-08-11 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2297: Summary: Estimate available memory size for spillable map accurately Key: HUDI-2297 URL: https://issues.apache.org/jira/browse/HUDI-2297 Project: Apache Hudi Issue

[jira] [Closed] (HUDI-2291) Delete redundancy record key generator factory function

2021-08-10 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng closed HUDI-2291. Resolution: Abandoned > Delete redundancy record key generator factory function > --

[jira] [Created] (HUDI-2292) MOR not support predicate pushdown when reading with payload_combine type

2021-08-10 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2292: Summary: MOR not support predicate pushdown when reading with payload_combine type Key: HUDI-2292 URL: https://issues.apache.org/jira/browse/HUDI-2292 Project: Apache Hudi

[jira] [Created] (HUDI-2291) Delete redundancy record key generator factory function

2021-08-09 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2291: Summary: Delete redundancy record key generator factory function Key: HUDI-2291 URL: https://issues.apache.org/jira/browse/HUDI-2291 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-2157) Spark write the bucket index table

2021-07-09 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2157: Summary: Spark write the bucket index table Key: HUDI-2157 URL: https://issues.apache.org/jira/browse/HUDI-2157 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-2156) Cluster the table with bucket index

2021-07-09 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2156: Summary: Cluster the table with bucket index Key: HUDI-2156 URL: https://issues.apache.org/jira/browse/HUDI-2156 Project: Apache Hudi Issue Type: New Feature

[jira] [Updated] (HUDI-2155) Bulk insert support bucket index

2021-07-09 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-2155: - Summary: Bulk insert support bucket index (was: Bulk insert support Hive index) > Bulk insert support bu

[jira] [Created] (HUDI-2155) Bulk insert support Hive index

2021-07-09 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2155: Summary: Bulk insert support Hive index Key: HUDI-2155 URL: https://issues.apache.org/jira/browse/HUDI-2155 Project: Apache Hudi Issue Type: New Feature Co

[jira] [Created] (HUDI-2154) Add index key field into HoodieKey

2021-07-09 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2154: Summary: Add index key field into HoodieKey Key: HUDI-2154 URL: https://issues.apache.org/jira/browse/HUDI-2154 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-2127) `maxMemorySizeInBytes` in log scanner is not initialized

2021-07-04 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2127: Summary: `maxMemorySizeInBytes` in log scanner is not initialized Key: HUDI-2127 URL: https://issues.apache.org/jira/browse/HUDI-2127 Project: Apache Hudi Issue Type

[jira] [Created] (HUDI-2117) Unpersist the input rdd after the commit is completed

2021-07-01 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2117: Summary: Unpersist the input rdd after the commit is completed Key: HUDI-2117 URL: https://issues.apache.org/jira/browse/HUDI-2117 Project: Apache Hudi Issue Type: I

[jira] [Created] (HUDI-2115) FileSlices in the filegroup is not descending by timestamp

2021-07-01 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2115: Summary: FileSlices in the filegroup is not descending by timestamp Key: HUDI-2115 URL: https://issues.apache.org/jira/browse/HUDI-2115 Project: Apache Hudi Issue Ty

[jira] [Created] (HUDI-2113) Fix integration testing failure caused by sql results out of order

2021-07-01 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2113: Summary: Fix integration testing failure caused by sql results out of order Key: HUDI-2113 URL: https://issues.apache.org/jira/browse/HUDI-2113 Project: Apache Hudi

[jira] [Created] (HUDI-2042) Compare the field object directly in OverwriteWithLatestAvroPayload

2021-06-18 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2042: Summary: Compare the field object directly in OverwriteWithLatestAvroPayload Key: HUDI-2042 URL: https://issues.apache.org/jira/browse/HUDI-2042 Project: Apache Hudi

[jira] [Closed] (HUDI-2041) Code reuse in schduling the compaction plan when using Flink

2021-06-18 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng closed HUDI-2041. Resolution: Fixed > Code reuse in schduling the compaction plan when using Flink > -

[jira] [Created] (HUDI-2041) Code reuse in schduling the compaction plan when using Flink

2021-06-18 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-2041: Summary: Code reuse in schduling the compaction plan when using Flink Key: HUDI-2041 URL: https://issues.apache.org/jira/browse/HUDI-2041 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-1951) Hash Index for HUDI

2021-06-01 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-1951: - Priority: Major (was: Blocker) > Hash Index for HUDI > --- > > Key: HUDI-

[jira] [Created] (HUDI-1951) Hash Index for HUDI

2021-06-01 Thread XiaoyuGeng (Jira)
XiaoyuGeng created HUDI-1951: Summary: Hash Index for HUDI Key: HUDI-1951 URL: https://issues.apache.org/jira/browse/HUDI-1951 Project: Apache Hudi Issue Type: New Feature Reporter: X

[jira] [Updated] (HUDI-1951) Hash Index for HUDI

2021-06-01 Thread XiaoyuGeng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiaoyuGeng updated HUDI-1951: - Status: In Progress (was: Open) > Hash Index for HUDI > --- > > Key: HUDI