[jira] [Resolved] (HUDI-4769) Option read.streaming.skip_compaction skips delta commit

[ https://issues.apache.org/jira/browse/HUDI-4769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-4769. -- > Option read.streaming.skip_compaction skips delta commit >

[jira] [Commented] (HUDI-4769) Option read.streaming.skip_compaction skips delta commit

[ https://issues.apache.org/jira/browse/HUDI-4769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612004#comment-17612004 ] Danny Chen commented on HUDI-4769: -- Fixed via master branch: f171496de244992958fd3fd22fbcd2a7dc62c7a2 >

[hudi] branch master updated: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit (#6848)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new f171496de2 [HUDI-4769] Option

[GitHub] [hudi] danny0405 merged pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

danny0405 merged PR #6848: URL: https://github.com/apache/hudi/pull/6848 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot commented on pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

hudi-bot commented on PR #6848: URL: https://github.com/apache/hudi/pull/6848#issuecomment-1264507836 ## CI report: * fcfc1baee8aa5394c4472135f6ceb0d280cf8c16 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

hudi-bot commented on PR #6848: URL: https://github.com/apache/hudi/pull/6848#issuecomment-1264507171 ## CI report: * fcfc1baee8aa5394c4472135f6ceb0d280cf8c16 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5958: [HUDI-3900] [UBER] Support log compaction action for MOR tables

hudi-bot commented on PR #5958: URL: https://github.com/apache/hudi/pull/5958#issuecomment-1264506981 ## CI report: * c7a7b3a42376116bbeaa09c1f0f07a4f80d788b6 Azure:

[GitHub] [hudi] danny0405 commented on pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

danny0405 commented on PR #6848: URL: https://github.com/apache/hudi/pull/6848#issuecomment-1264499469 The failed test `ITTestDataStreamWrite.testWriteCopyOnWriteWithClustering` is flaky, it should not affected by this pr, would merge it soon and fire another PR to fix the tests

[GitHub] [hudi] hudi-bot commented on pull request #5958: [HUDI-3900] [UBER] Support log compaction action for MOR tables

hudi-bot commented on PR #5958: URL: https://github.com/apache/hudi/pull/5958#issuecomment-1264478333 ## CI report: * 4590a5c3ccb91255a3abb0b9f478325cecfad59b Azure:

[GitHub] [hudi] hudi-bot commented on pull request #5958: [HUDI-3900] [UBER] Support log compaction action for MOR tables

hudi-bot commented on PR #5958: URL: https://github.com/apache/hudi/pull/5958#issuecomment-1264477514 ## CI report: * 4590a5c3ccb91255a3abb0b9f478325cecfad59b Azure:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5958: [HUDI-3900] [UBER] Support log compaction action for MOR tables

nsivabalan commented on code in PR #5958: URL: https://github.com/apache/hudi/pull/5958#discussion_r985130392 ## hudi-common/src/main/java/org/apache/hudi/common/config/HoodieMetadataConfig.java: ## @@ -234,6 +234,13 @@ public final class HoodieMetadataConfig extends

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5958: [HUDI-3900] [UBER] Support log compaction action for MOR tables

nsivabalan commented on code in PR #5958: URL: https://github.com/apache/hudi/pull/5958#discussion_r985130069 ## hudi-common/src/main/java/org/apache/hudi/common/table/log/AbstractHoodieLogRecordReader.java: ## @@ -362,6 +381,228 @@ protected synchronized void

[GitHub] [hudi] hudi-bot commented on pull request #6805: [HUDI-4949] optimize cdc read to avoid the problem of reusing buffer underlying the Row

hudi-bot commented on PR #6805: URL: https://github.com/apache/hudi/pull/6805#issuecomment-1264423605 ## CI report: * 8b5baf6007d88f619ca2838c507c93d48e3c7f45 Azure:

[jira] [Created] (HUDI-4965) automatically adapt COMMITS_ARCHIVAL_BATCH_SIZE

ZiyueGuan created HUDI-4965: --- Summary: automatically adapt COMMITS_ARCHIVAL_BATCH_SIZE Key: HUDI-4965 URL: https://issues.apache.org/jira/browse/HUDI-4965 Project: Apache Hudi Issue Type:

[GitHub] [hudi] hudi-bot commented on pull request #6745: Fix comment in RFC46

hudi-bot commented on PR #6745: URL: https://github.com/apache/hudi/pull/6745#issuecomment-1264403083 ## CI report: * a21ec4c91ba3d353082411e46239c9c81912cc1f Azure:

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5416: [HUDI-3963] Use Lock-Free Message Queue Disruptor Improving Hoodie Writing Efficiency

nsivabalan commented on code in PR #5416: URL: https://github.com/apache/hudi/pull/5416#discussion_r985104403 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java: ## @@ -129,6 +131,14 @@ public class HoodieWriteConfig extends

[GitHub] [hudi] melin commented on pull request #4309: [HUDI-3016][RFC-43] Proposal to implement Table Management Service

melin commented on PR #4309: URL: https://github.com/apache/hudi/pull/4309#issuecomment-1264388044 Support multi catalog? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #6805: [HUDI-4949] optimize cdc read to avoid the problem of reusing buffer underlying the Row

hudi-bot commented on PR #6805: URL: https://github.com/apache/hudi/pull/6805#issuecomment-1264387150 ## CI report: * be8c12ec97231e1dd549cb3ece42a388e2976563 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6805: [HUDI-4949] optimize cdc read to avoid the problem of reusing buffer underlying the Row

hudi-bot commented on PR #6805: URL: https://github.com/apache/hudi/pull/6805#issuecomment-1264386089 ## CI report: * be8c12ec97231e1dd549cb3ece42a388e2976563 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

hudi-bot commented on PR #6848: URL: https://github.com/apache/hudi/pull/6848#issuecomment-1264384029 ## CI report: * fcfc1baee8aa5394c4472135f6ceb0d280cf8c16 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6745: Fix comment in RFC46

hudi-bot commented on PR #6745: URL: https://github.com/apache/hudi/pull/6745#issuecomment-1264365805 ## CI report: * b7a71b7de263c5117e199df45cba0ead191159a3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6745: Fix comment in RFC46

hudi-bot commented on PR #6745: URL: https://github.com/apache/hudi/pull/6745#issuecomment-1264364720 ## CI report: * b7a71b7de263c5117e199df45cba0ead191159a3 Azure:

[jira] [Closed] (HUDI-4936) as.of.instant not recognized as hoodie config

[ https://issues.apache.org/jira/browse/HUDI-4936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-4936. Resolution: Fixed > as.of.instant not recognized as hoodie config >

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-1380: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Async cleaning does not work with Timeline

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-1574: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Trim existing unit tests to finish in much

[jira] [Updated] (HUDI-2465) Fix merge, update for spark sql dml support to test suite infra

[ https://issues.apache.org/jira/browse/HUDI-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2465: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Fix merge, update for spark sql dml

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-1885: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support Delete/Update Non-Pk Table >

[jira] [Updated] (HUDI-2528) Flaky test: MERGE_ON_READ testTableOperationsWithRestore

[ https://issues.apache.org/jira/browse/HUDI-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2528: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Flaky test: MERGE_ON_READ

[jira] [Updated] (HUDI-2555) Fix flaky FlinkCompaction integration test

[ https://issues.apache.org/jira/browse/HUDI-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2555: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Fix flaky FlinkCompaction integration test

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2768: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Enable async timeline server by default >

[jira] [Updated] (HUDI-2928) Evaluate rebasing Hudi's default compression from Gzip to Zstd

[ https://issues.apache.org/jira/browse/HUDI-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2928: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Evaluate rebasing Hudi's default

[jira] [Resolved] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-3054. --- > Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter >

[jira] [Updated] (HUDI-2860) Make timeline server work with concurrent/async table service

[ https://issues.apache.org/jira/browse/HUDI-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2860: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make timeline server work with

[jira] [Updated] (HUDI-3000) [UMBRELLA] Consistent Hashing Index

[ https://issues.apache.org/jira/browse/HUDI-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3000: -- Fix Version/s: 0.13.0 (was: 0.12.1) > [UMBRELLA] Consistent Hashing Index >

[jira] [Updated] (HUDI-2873) Support optimize data layout by sql and make the build more fast

[ https://issues.apache.org/jira/browse/HUDI-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-2873: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support optimize data layout by sql and

[jira] [Updated] (HUDI-3057) Instants should be generated strictly under locks

[ https://issues.apache.org/jira/browse/HUDI-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3057: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Instants should be generated strictly

[jira] [Updated] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3054: -- Fix Version/s: 0.12.1 > Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter >

[jira] [Resolved] (HUDI-3204) Allow original partition column value to be retrieved when using TimestampBasedKeyGen

[ https://issues.apache.org/jira/browse/HUDI-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-3204. --- > Allow original partition column value to be retrieved when using > TimestampBasedKeyGen >

[jira] [Updated] (HUDI-3210) [UMBRELLA] A new Presto connector for Hudi

[ https://issues.apache.org/jira/browse/HUDI-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3210: -- Fix Version/s: 0.13.0 (was: 0.12.1) > [UMBRELLA] A new Presto connector for Hudi

[jira] [Updated] (HUDI-3067) "Table already exists" error with multiple writers and dynamodb

[ https://issues.apache.org/jira/browse/HUDI-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3067: -- Fix Version/s: 0.13.0 (was: 0.12.1) > "Table already exists" error with multiple

[jira] [Updated] (HUDI-3054) Fix flaky TestHoodieClientMultiWriter. testHoodieClientBasicMultiWriter

[ https://issues.apache.org/jira/browse/HUDI-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3054: -- Fix Version/s: (was: 0.12.1) > Fix flaky TestHoodieClientMultiWriter.

[jira] [Updated] (HUDI-3055) Make sure that Compression Codec configuration is respected across the board

[ https://issues.apache.org/jira/browse/HUDI-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3055: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure that Compression Codec

[jira] [Updated] (HUDI-3214) Optimize auto partition in spark

[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3214: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Optimize auto partition in spark >

[jira] [Updated] (HUDI-3249) Performance Improvements

[ https://issues.apache.org/jira/browse/HUDI-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3249: -- Fix Version/s: (was: 0.12.1) > Performance Improvements > > >

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3300: -- Fix Version/s: 0.13.0 > Timeline server FSViewManager should avoid point lookup for metadata file >

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3300: -- Fix Version/s: (was: 0.12.1) > Timeline server FSViewManager should avoid point lookup for metadata

[jira] [Updated] (HUDI-3248) Improve Hudi table services

[ https://issues.apache.org/jira/browse/HUDI-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3248: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Improve Hudi table services >

[jira] [Updated] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3301: -- Fix Version/s: 0.13.0 (was: 0.12.1) > MergedLogRecordReader inline reading

[jira] [Updated] (HUDI-3342) MOR Delta Block Rollbacks not applied if Lazy Block reading is disabled

[ https://issues.apache.org/jira/browse/HUDI-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3342: -- Fix Version/s: 0.13.0 (was: 0.12.1) > MOR Delta Block Rollbacks not applied if

[jira] [Updated] (HUDI-3517) Unicode in partition path causes it to be resolved wrongly

[ https://issues.apache.org/jira/browse/HUDI-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3517: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Unicode in partition path causes it to be

[jira] [Updated] (HUDI-3495) Reading keys in parallel from HoodieMetadataMergedLogRecordReader may lead to empty results even if key exists

[ https://issues.apache.org/jira/browse/HUDI-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3495: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Reading keys in parallel from

[jira] [Updated] (HUDI-3407) Make sure Restore operation is Not Concurrent w/ Writes in Multi-Writer scenario

[ https://issues.apache.org/jira/browse/HUDI-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3407: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure Restore operation is Not

[jira] [Updated] (HUDI-3467) Check shutdown logic with async compaction in Spark Structured Streaming

[ https://issues.apache.org/jira/browse/HUDI-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3467: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Check shutdown logic with async compaction

[jira] [Updated] (HUDI-3519) Make sure every public Hudi Client Method invokes necessary prologue

[ https://issues.apache.org/jira/browse/HUDI-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3519: -- Fix Version/s: 0.13.0 > Make sure every public Hudi Client Method invokes necessary prologue >

[jira] [Updated] (HUDI-3519) Make sure every public Hudi Client Method invokes necessary prologue

[ https://issues.apache.org/jira/browse/HUDI-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3519: -- Fix Version/s: (was: 0.12.1) > Make sure every public Hudi Client Method invokes necessary prologue

[jira] [Updated] (HUDI-3648) Failed to execute rollback due to HoodieIOException: Could not delete instant

[ https://issues.apache.org/jira/browse/HUDI-3648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3648: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Failed to execute rollback due to

[jira] [Updated] (HUDI-3646) The Hudi update syntax should not modify the nullability attribute of a column

[ https://issues.apache.org/jira/browse/HUDI-3646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3646: -- Fix Version/s: 0.13.0 (was: 0.12.1) > The Hudi update syntax should not modify

[jira] [Updated] (HUDI-3626) Refactor TableSchemaResolver to remove `includeMetadataFields` flags

[ https://issues.apache.org/jira/browse/HUDI-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3626: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Refactor TableSchemaResolver to remove

[jira] [Updated] (HUDI-3649) Add HoodieTableConfig defaults to HoodieWriteConfig

[ https://issues.apache.org/jira/browse/HUDI-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3649: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Add HoodieTableConfig defaults to

[jira] [Updated] (HUDI-3742) Enable parquet enableVectorizedReader for spark incremental read to prevent pef regression

[ https://issues.apache.org/jira/browse/HUDI-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3742: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Enable parquet enableVectorizedReader for

[jira] [Updated] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3717: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Avoid double-listing w/in

[jira] [Updated] (HUDI-3818) hudi doesn't support bytes column as primary key

[ https://issues.apache.org/jira/browse/HUDI-3818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3818: -- Fix Version/s: 0.13.0 (was: 0.12.1) > hudi doesn't support bytes column as

[jira] [Updated] (HUDI-3775) Allow for offline compaction of MOR tables via spark streaming

[ https://issues.apache.org/jira/browse/HUDI-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3775: -- Fix Version/s: 0.13.0 > Allow for offline compaction of MOR tables via spark streaming >

[jira] [Updated] (HUDI-3796) Implement layout to filter out uncommitted log files without reading the log blocks

[ https://issues.apache.org/jira/browse/HUDI-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3796: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Implement layout to filter out uncommitted

[GitHub] [hudi] hudi-bot commented on pull request #6850: [Draft][HUDI-4964] inline all the getter methods that have no logic …

hudi-bot commented on PR #6850: URL: https://github.com/apache/hudi/pull/6850#issuecomment-1264348973 ## CI report: * e3aef767db19eed24222f8fff89ae4c59d0799c2 Azure:

[jira] [Updated] (HUDI-3775) Allow for offline compaction of MOR tables via spark streaming

[ https://issues.apache.org/jira/browse/HUDI-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3775: -- Fix Version/s: (was: 0.12.1) > Allow for offline compaction of MOR tables via spark streaming >

[jira] [Updated] (HUDI-3881) Implement index syntax for spark sql

[ https://issues.apache.org/jira/browse/HUDI-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3881: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Implement index syntax for spark sql >

[jira] [Updated] (HUDI-3882) Make sure Hudi Spark relations implementations provide similar file-scanning metrics

[ https://issues.apache.org/jira/browse/HUDI-3882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3882: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure Hudi Spark relations

[jira] [Updated] (HUDI-3956) Optimize hudi-presto-bundle size

[ https://issues.apache.org/jira/browse/HUDI-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3956: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Optimize hudi-presto-bundle size >

[jira] [Updated] (HUDI-3919) Support out of order rollback blocks in AbstractHoodieLogRecordReader

[ https://issues.apache.org/jira/browse/HUDI-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3919: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support out of order rollback blocks in

[jira] [Updated] (HUDI-3892) Add HoodieReadClient with java

[ https://issues.apache.org/jira/browse/HUDI-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-3892: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Add HoodieReadClient with java >

[jira] [Updated] (HUDI-4021) Support deferring compaction when there is an inflight delta commit

[ https://issues.apache.org/jira/browse/HUDI-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4021: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support deferring compaction when there is

[jira] [Updated] (HUDI-4036) Investigate whether meta fields could be omitted completely

[ https://issues.apache.org/jira/browse/HUDI-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4036: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Investigate whether meta fields could be

[jira] [Updated] (HUDI-4010) DynamoDB lock configs for naming/docs could be improved

[ https://issues.apache.org/jira/browse/HUDI-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4010: -- Status: Patch Available (was: In Progress) > DynamoDB lock configs for naming/docs could be improved >

[jira] [Updated] (HUDI-4209) TestHoodieBulkInsertDataInternalWriter fails due to MiniDFSCluster class not found

[ https://issues.apache.org/jira/browse/HUDI-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4209: -- Fix Version/s: 0.13.0 (was: 0.12.1) > TestHoodieBulkInsertDataInternalWriter

[jira] [Updated] (HUDI-4184) Creating external table in Spark SQL modifies "hoodie.properties"

[ https://issues.apache.org/jira/browse/HUDI-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4184: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Creating external table in Spark SQL

[jira] [Updated] (HUDI-4123) HoodieDeltaStreamer throws exception due to SqlSource return null checkpoint

[ https://issues.apache.org/jira/browse/HUDI-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4123: -- Fix Version/s: 0.13.0 (was: 0.12.1) > HoodieDeltaStreamer throws exception due

[jira] [Resolved] (HUDI-4237) spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create non-partition hudi table in Spark

[ https://issues.apache.org/jira/browse/HUDI-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-4237. --- > spark.sql.sources.schema.partCol.0 is non-empty in HiveMetaStore when create > non-partition hudi

[jira] [Updated] (HUDI-4330) NPE when trying to upsert into a dataset with no Meta Fields

[ https://issues.apache.org/jira/browse/HUDI-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4330: -- Fix Version/s: 0.13.0 > NPE when trying to upsert into a dataset with no Meta Fields >

[jira] [Updated] (HUDI-4244) Support common Spark transformations w/in Spark SQL "partitioned by" clause

[ https://issues.apache.org/jira/browse/HUDI-4244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4244: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support common Spark transformations w/in

[jira] [Updated] (HUDI-4302) CI Instability / flaky tests

[ https://issues.apache.org/jira/browse/HUDI-4302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4302: -- Fix Version/s: 0.13.0 (was: 0.12.1) > CI Instability / flaky tests >

[jira] [Updated] (HUDI-4457) Make sure IT docker test return code non-zero when failed

[ https://issues.apache.org/jira/browse/HUDI-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4457: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure IT docker test return code

[jira] [Updated] (HUDI-4542) Flink streaming query fails with ClassNotFoundException

[ https://issues.apache.org/jira/browse/HUDI-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4542: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Flink streaming query fails with

[jira] [Resolved] (HUDI-4488) Improve S3 File listing efficiency

[ https://issues.apache.org/jira/browse/HUDI-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu resolved HUDI-4488. --- > Improve S3 File listing efficiency > -- > > Key:

[jira] [Updated] (HUDI-4522) [DOCS] Set presto session prop to use parquet column names in case of type mismatch

[ https://issues.apache.org/jira/browse/HUDI-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4522: -- Fix Version/s: 0.13.0 (was: 0.12.1) > [DOCS] Set presto session prop to use

[GitHub] [hudi] hudi-bot commented on pull request #6850: [Draft][HUDI-4964] inline all the getter methods that have no logic …

hudi-bot commented on PR #6850: URL: https://github.com/apache/hudi/pull/6850#issuecomment-1264347926 ## CI report: * e3aef767db19eed24222f8fff89ae4c59d0799c2 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

hudi-bot commented on PR #6848: URL: https://github.com/apache/hudi/pull/6848#issuecomment-1264347911 ## CI report: * 6318c29ab4e0415d365db365aac92f1f562a4b68 Azure:

[jira] [Updated] (HUDI-4330) NPE when trying to upsert into a dataset with no Meta Fields

[ https://issues.apache.org/jira/browse/HUDI-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4330: -- Fix Version/s: (was: 0.12.1) > NPE when trying to upsert into a dataset with no Meta Fields >

[jira] [Updated] (HUDI-4454) Support hiveSync command based on Call Procedure Command

[ https://issues.apache.org/jira/browse/HUDI-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4454: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Support hiveSync command based on Call

[jira] [Updated] (HUDI-4341) HoodieHFileReader is not compatible with Hadoop 3

[ https://issues.apache.org/jira/browse/HUDI-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4341: -- Fix Version/s: 0.13.0 (was: 0.12.1) > HoodieHFileReader is not compatible with

[jira] [Updated] (HUDI-4369) Hudi Kafka Connect Sink writing to GCS bucket

[ https://issues.apache.org/jira/browse/HUDI-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4369: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Hudi Kafka Connect Sink writing to GCS

[jira] [Updated] (HUDI-4573) Fix HoodieMultiTableDeltaStreamer to write all tables in continuous mode

[ https://issues.apache.org/jira/browse/HUDI-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4573: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Fix HoodieMultiTableDeltaStreamer to write

[jira] [Updated] (HUDI-4624) Make sure all DeltaStreamer Sources are Closeable

[ https://issues.apache.org/jira/browse/HUDI-4624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4624: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Make sure all DeltaStreamer Sources are

[jira] [Updated] (HUDI-4586) Address S3 timeouts in Bloom Index with metadata table

[ https://issues.apache.org/jira/browse/HUDI-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4586: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Address S3 timeouts in Bloom Index with

[jira] [Updated] (HUDI-4602) Implement getScheme for PrestoS3FileSystem

[ https://issues.apache.org/jira/browse/HUDI-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4602: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Implement getScheme for PrestoS3FileSystem

[jira] [Updated] (HUDI-4674) change the default value of inputFormat for the MOR table

[ https://issues.apache.org/jira/browse/HUDI-4674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4674: -- Fix Version/s: 0.13.0 (was: 0.12.1) > change the default value of inputFormat

[jira] [Updated] (HUDI-4631) Enhance retries for failed writes w/ write conflicts in a multi writer scenarios

[ https://issues.apache.org/jira/browse/HUDI-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4631: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Enhance retries for failed writes w/ write

[jira] [Updated] (HUDI-4688) Decouple lazy cleaning of failed writes from clean action in multi-writer

[ https://issues.apache.org/jira/browse/HUDI-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4688: -- Fix Version/s: 0.13.0 (was: 0.12.1) > Decouple lazy cleaning of failed writes

[jira] [Updated] (HUDI-4704) bulk insert overwrite table will delete the table and then recreate a table

[ https://issues.apache.org/jira/browse/HUDI-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaojing Yu updated HUDI-4704: -- Fix Version/s: 0.13.0 (was: 0.12.1) > bulk insert overwrite table will delete

[GitHub] [hudi] hudi-bot commented on pull request #6848: [HUDI-4769] Option read.streaming.skip_compaction skips delta commit

hudi-bot commented on PR #6848: URL: https://github.com/apache/hudi/pull/6848#issuecomment-1264346736 ## CI report: * 6318c29ab4e0415d365db365aac92f1f562a4b68 Azure:

  1   2   >