[jira] [Updated] (HUDI-7511) Offset range calculation in kafka should return all topic partitions

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7511: Fix Version/s: 0.15.0 1.0.0 > Offset range calculation in kafka should return all topic p

[jira] [Updated] (HUDI-7672) Fix the Hive server scratch dir for tests in hudi-utilities

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7672: Fix Version/s: 0.15.0 > Fix the Hive server scratch dir for tests in hudi-utilities > --

[jira] [Updated] (HUDI-7648) Refactor MetadataPartitionType so as to enahance reuse across metadata writer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7648: Fix Version/s: (was: 0.15.0) > Refactor MetadataPartitionType so as to enahance reuse across metadata wr

[jira] [Updated] (HUDI-7645) Optimize BQ sync tool for MDT

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7645: Fix Version/s: 0.15.0 1.0.0 > Optimize BQ sync tool for MDT > ---

[jira] [Updated] (HUDI-7648) Refactor MetadataPartitionType so as to enahance reuse across metadata writer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7648: Fix Version/s: 0.15.0 > Refactor MetadataPartitionType so as to enahance reuse across metadata writer >

[jira] [Updated] (HUDI-7632) Remove FileSystem usage in HoodieLogFormatWriter

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7632: Fix Version/s: 0.15.0 > Remove FileSystem usage in HoodieLogFormatWriter > -

[jira] [Updated] (HUDI-6386) Fix testArchivalWithMultiWriters when metadata enabled

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6386: Fix Version/s: 0.15.0 1.0.0 (was: 1.1.0) > Fix testArchivalWithMul

[jira] [Closed] (HUDI-7235) Checkpoint in S3/GCS when there are no commits left to consume in S3 metadata table

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7235. --- Resolution: Fixed > Checkpoint in S3/GCS when there are no commits left to consume in S3 metadata > table > -

[jira] [Updated] (HUDI-7235) Checkpoint in S3/GCS when there are no commits left to consume in S3 metadata table

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7235: Fix Version/s: 0.15.0 1.0.0 > Checkpoint in S3/GCS when there are no commits left to cons

[jira] [Closed] (HUDI-6386) Fix testArchivalWithMultiWriters when metadata enabled

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-6386. --- Resolution: Fixed > Fix testArchivalWithMultiWriters when metadata enabled > -

[jira] [Updated] (HUDI-7655) Support configuration for clean to fail execution if there is at least one file is marked as a failed delete

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7655: Fix Version/s: 0.15.0 > Support configuration for clean to fail execution if there is at least one > file i

[jira] [Closed] (HUDI-7655) Support configuration for clean to fail execution if there is at least one file is marked as a failed delete

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7655. --- Resolution: Fixed > Support configuration for clean to fail execution if there is at least one > file is mark

[jira] [Updated] (HUDI-7647) READ_UTC_TIMEZONE doesn't affect log files for MOR tables

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7647: Fix Version/s: 0.15.0 > READ_UTC_TIMEZONE doesn't affect log files for MOR tables >

[jira] [Updated] (HUDI-7628) Rename FSUtils.getPartitionPath to constructAbsolutePath

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7628: Fix Version/s: 0.15.0 > Rename FSUtils.getPartitionPath to constructAbsolutePath > -

[jira] [Updated] (HUDI-7631) Clean up usage of `CachingPath` outside hudi-common module

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7631: Fix Version/s: 0.15.0 > Clean up usage of `CachingPath` outside hudi-common module > ---

[jira] [Closed] (HUDI-7618) Add ability to ignore checkpoints in delta streamer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7618. --- Resolution: Fixed > Add ability to ignore checkpoints in delta streamer >

[jira] [Updated] (HUDI-7623) Refactoring of RemoteHoodieTableFileSystemView and RequestHandler

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7623: Fix Version/s: 0.15.0 > Refactoring of RemoteHoodieTableFileSystemView and RequestHandler >

[jira] [Updated] (HUDI-7618) Add ability to ignore checkpoints in delta streamer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7618: Fix Version/s: 0.15.0 1.0.0 > Add ability to ignore checkpoints in delta streamer > -

[jira] [Updated] (HUDI-4228) Clean up literal usage in Hudi CLI argument check

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-4228: Fix Version/s: 0.15.0 > Clean up literal usage in Hudi CLI argument check >

[jira] [Closed] (HUDI-7606) Ensure that rdds persisted by table services are released in SparkRDDWriteClient

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7606. --- Resolution: Fixed > Ensure that rdds persisted by table services are released in > SparkRDDWriteClient >

[jira] [Updated] (HUDI-7619) Remove code duplicates in HoodieTableMetadataUtil

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7619: Fix Version/s: 0.15.0 > Remove code duplicates in HoodieTableMetadataUtil >

[jira] [Updated] (HUDI-6762) Remove usages of MetadataRecordsGenerationParams

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6762: Fix Version/s: 0.15.0 > Remove usages of MetadataRecordsGenerationParams > -

[jira] [Closed] (HUDI-7605) Unable to set merger strategy with DataSourceWriteOptions.RECORD_MERGER_STRATEGY

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7605. --- Resolution: Fixed > Unable to set merger strategy with > DataSourceWriteOptions.RECORD_MERGER_STRATEGY >

[jira] [Updated] (HUDI-7290) filterPendingReplaceTimeline used incorrectly in various places

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7290: Fix Version/s: 0.15.0 1.0.0 > filterPendingReplaceTimeline used incorrectly in various pl

[jira] [Closed] (HUDI-7391) HoodieMetadataMetrics should use Metrics instance for metrics registry

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7391. --- Resolution: Fixed > HoodieMetadataMetrics should use Metrics instance for metrics registry > -

[jira] [Closed] (HUDI-7290) filterPendingReplaceTimeline used incorrectly in various places

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7290. --- Resolution: Fixed > filterPendingReplaceTimeline used incorrectly in various places >

[jira] [Updated] (HUDI-7605) Unable to set merger strategy with DataSourceWriteOptions.RECORD_MERGER_STRATEGY

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7605: Fix Version/s: 0.15.0 > Unable to set merger strategy with > DataSourceWriteOptions.RECORD_MERGER_STRATEGY

[jira] [Updated] (HUDI-7391) HoodieMetadataMetrics should use Metrics instance for metrics registry

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7391: Fix Version/s: 0.15.0 1.0.0 > HoodieMetadataMetrics should use Metrics instance for metri

[jira] [Updated] (HUDI-7559) Fix functional index (on column stats): Handle NPE in filterQueriesWithRecordKey(...)

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7559: Fix Version/s: 0.15.0 > Fix functional index (on column stats): Handle NPE in > filterQueriesWithRecordKey(

[jira] [Updated] (HUDI-6854) Change default payload type to HOODIE_AVRO_DEFAULT

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6854: Fix Version/s: 0.15.0 > Change default payload type to HOODIE_AVRO_DEFAULT > ---

[jira] [Updated] (HUDI-7572) Avoid to schedule empty compaction plan without log files

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7572: Fix Version/s: 0.15.0 > Avoid to schedule empty compaction plan without log files >

[jira] [Closed] (HUDI-7486) Classify exceptions as schema exceptions when converting from avro to spark row format

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7486. --- Resolution: Fixed > Classify exceptions as schema exceptions when converting from avro to spark > row format

[jira] [Updated] (HUDI-7486) Classify exceptions as schema exceptions when converting from avro to spark row format

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7486: Fix Version/s: 0.15.0 1.0.0 > Classify exceptions as schema exceptions when converting fr

[jira] [Updated] (HUDI-7557) NoSuchElementException when commit corresponding to savepoint has been removed or archived

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7557: Fix Version/s: 1.0.0 > NoSuchElementException when commit corresponding to savepoint has been > removed or

[jira] [Updated] (HUDI-7564) Fix HiveSync configuration inconsistencies

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7564: Fix Version/s: 1.0.0 > Fix HiveSync configuration inconsistencies >

[jira] [Closed] (HUDI-7557) NoSuchElementException when commit corresponding to savepoint has been removed or archived

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7557. --- Resolution: Fixed > NoSuchElementException when commit corresponding to savepoint has been > removed or archi

[jira] [Updated] (HUDI-7569) Fix wrong result while using RLI for pruning files

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7569: Fix Version/s: 0.15.0 > Fix wrong result while using RLI for pruning files > ---

[jira] [Updated] (HUDI-7499) Support OverwriteWithGreaterRecordPayload for Hudi

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7499: Fix Version/s: 0.15.0 > Support OverwriteWithGreaterRecordPayload for Hudi > ---

[jira] [Updated] (HUDI-6538) Refactor methods in TimelineDiffHelper class

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6538: Fix Version/s: 0.15.0 > Refactor methods in TimelineDiffHelper class > -

[jira] [Updated] (HUDI-7187) Fix integ test props to honor new streamer properties

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7187: Fix Version/s: 0.15.0 1.0.0 > Fix integ test props to honor new streamer properties > --

[jira] [Updated] (HUDI-6317) Streaming read should skip compaction and clustering instants to avoid duplicates

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6317: Fix Version/s: 0.15.0 > Streaming read should skip compaction and clustering instants to avoid > duplicates

[jira] [Updated] (HUDI-7500) SchemaProvider not deduced for some deltastreamer scenarios

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7500: Fix Version/s: 0.15.0 1.0.0 > SchemaProvider not deduced for some deltastreamer scenarios

[jira] [Closed] (HUDI-7500) SchemaProvider not deduced for some deltastreamer scenarios

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7500. --- Resolution: Fixed > SchemaProvider not deduced for some deltastreamer scenarios >

[jira] [Updated] (HUDI-7516) Put jdbc-h2 creds into static variables for hudi-utilities tests

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7516: Fix Version/s: 0.15.0 > Put jdbc-h2 creds into static variables for hudi-utilities tests > -

[jira] [Updated] (HUDI-7530) Refactoring of handleUpdateInternal in CommitActionExecutors and HoodieTables

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7530: Fix Version/s: 0.15.0 > Refactoring of handleUpdateInternal in CommitActionExecutors and HoodieTables >

[jira] [Closed] (HUDI-7506) Compute offsetRanges based on eventsPerPartition allocated in each range

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7506. --- Resolution: Fixed > Compute offsetRanges based on eventsPerPartition allocated in each range > --

[jira] [Updated] (HUDI-7382) Get partitions from active timeline instead of listing when building clustering plan

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7382: Fix Version/s: 0.15.0 1.0.0 > Get partitions from active timeline instead of listing when

[jira] [Updated] (HUDI-7506) Compute offsetRanges based on eventsPerPartition allocated in each range

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7506: Status: Patch Available (was: In Progress) > Compute offsetRanges based on eventsPerPartition allocated in

[jira] [Updated] (HUDI-7506) Compute offsetRanges based on eventsPerPartition allocated in each range

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7506: Fix Version/s: 0.15.0 1.0.0 > Compute offsetRanges based on eventsPerPartition allocated

[jira] [Updated] (HUDI-7421) Build HoodieDeltaWriteStat using CommitMetadataUtils#getHoodieDeltaWriteStatFromPreviousStat

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7421: Fix Version/s: 0.15.0 > Build HoodieDeltaWriteStat using > CommitMetadataUtils#getHoodieDeltaWriteStatFromP

[jira] [Closed] (HUDI-7382) Get partitions from active timeline instead of listing when building clustering plan

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7382. --- Resolution: Fixed > Get partitions from active timeline instead of listing when building > clustering plan >

[jira] [Updated] (HUDI-7478) Fix max delta commits guard check w/ MDT

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7478: Fix Version/s: 1.0.0 > Fix max delta commits guard check w/ MDT > -

[jira] [Updated] (HUDI-7489) Row writer clustering collects write statuses on the driver

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7489: Fix Version/s: 1.0.0 > Row writer clustering collects write statuses on the driver > ---

[jira] [Closed] (HUDI-1517) Create marker file for every log file

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-1517. --- Resolution: Fixed > Create marker file for every log file > - > >

[jira] [Assigned] (HUDI-7496) Bump mybatis from 3.4.6 to 3.5.6 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-7496: --- Assignee: Ethan Guo > Bump mybatis from 3.4.6 to 3.5.6 in > /hudi-platform-service/hudi-metaserver/h

[jira] [Closed] (HUDI-7495) Bump mysql-connector-java from 8.0.22 to 8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7495. --- Resolution: Fixed > Bump mysql-connector-java from 8.0.22 to 8.0.28 in > /hudi-platform-service/hudi-metaserv

[jira] [Updated] (HUDI-7496) Bump mybatis from 3.4.6 to 3.5.6 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7496: Fix Version/s: 0.15.0 1.0.0 > Bump mybatis from 3.4.6 to 3.5.6 in > /hudi-platform-servi

[jira] [Closed] (HUDI-7163) DeltaStreamer compact failed caused by DateTimeParseException: Text '00000000000001999' could not be parsed

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7163. --- Resolution: Fixed > DeltaStreamer compact failed caused by DateTimeParseException: Text > '01999'

[jira] [Closed] (HUDI-7496) Bump mybatis from 3.4.6 to 3.5.6 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7496. --- Resolution: Fixed > Bump mybatis from 3.4.6 to 3.5.6 in > /hudi-platform-service/hudi-metaserver/hudi-metaser

[jira] [Updated] (HUDI-1517) Create marker file for every log file

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-1517: Fix Version/s: 0.15.0 1.0.0 (was: 1.1.0) > Create marker file for

[jira] [Updated] (HUDI-5101) Adding spark structured streaming tests to integ tests

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5101: Fix Version/s: 0.15.0 1.0.0 > Adding spark structured streaming tests to integ tests > --

[jira] [Closed] (HUDI-5101) Adding spark structured streaming tests to integ tests

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5101. --- Resolution: Fixed > Adding spark structured streaming tests to integ tests > -

[jira] [Updated] (HUDI-7495) Bump mysql-connector-java from 8.0.22 to 8.0.28 in /hudi-platform-service/hudi-metaserver/hudi-metaserver-server

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7495: Fix Version/s: 0.15.0 1.0.0 > Bump mysql-connector-java from 8.0.22 to 8.0.28 in > /hudi

[jira] [Updated] (HUDI-7488) The BigQuerySyncTool can't work well when the hudi table schema changed

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7488: Fix Version/s: 1.0.0 > The BigQuerySyncTool can't work well when the hudi table schema changed > ---

[jira] [Closed] (HUDI-5167) Reduce test run time for virtual key tests

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5167. --- Resolution: Fixed > Reduce test run time for virtual key tests > -- >

[jira] [Closed] (HUDI-7491) Handle null extra metadata w/ clean commit metadata

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7491. --- Resolution: Fixed > Handle null extra metadata w/ clean commit metadata >

[jira] [Updated] (HUDI-7491) Handle null extra metadata w/ clean commit metadata

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7491: Fix Version/s: 0.15.0 1.0.0 > Handle null extra metadata w/ clean commit metadata > -

[jira] [Updated] (HUDI-7197) Mis bug fixes around table services

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7197: Fix Version/s: 0.15.0 1.0.0 > Mis bug fixes around table services >

[jira] [Updated] (HUDI-5167) Reduce test run time for virtual key tests

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5167: Fix Version/s: 0.15.0 1.0.0 > Reduce test run time for virtual key tests > --

[jira] [Closed] (HUDI-7197) Mis bug fixes around table services

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7197. --- Resolution: Fixed > Mis bug fixes around table services > > >

[jira] [Updated] (HUDI-7356) Passing configs to file reader constructor for flexibility

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7356: Fix Version/s: 0.15.0 > Passing configs to file reader constructor for flexibility > ---

[jira] [Closed] (HUDI-6947) Clean up HoodieSparkSqlWriter.deduceWriterSchema

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-6947. --- Resolution: Fixed > Clean up HoodieSparkSqlWriter.deduceWriterSchema > ---

[jira] [Updated] (HUDI-6947) Clean up HoodieSparkSqlWriter.deduceWriterSchema

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6947: Fix Version/s: 0.15.0 1.0.0 > Clean up HoodieSparkSqlWriter.deduceWriterSchema >

[jira] [Updated] (HUDI-7337) Implement MetricsReporter for M3

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7337: Priority: Major (was: Trivial) > Implement MetricsReporter for M3 > > >

[jira] [Updated] (HUDI-7413) Make Issues with schema easier to understand for users

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7413: Fix Version/s: 0.15.0 1.0.0 > Make Issues with schema easier to understand for users > --

[jira] [Closed] (HUDI-7337) Implement MetricsReporter for M3

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7337. --- Resolution: Fixed > Implement MetricsReporter for M3 > > > Ke

[jira] [Closed] (HUDI-7413) Make Issues with schema easier to understand for users

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7413. --- Resolution: Fixed > Make Issues with schema easier to understand for users > -

[jira] [Updated] (HUDI-7337) Implement MetricsReporter for M3

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7337: Issue Type: New Feature (was: Wish) > Implement MetricsReporter for M3 > >

[jira] [Updated] (HUDI-7337) Implement MetricsReporter for M3

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7337: Fix Version/s: 0.15.0 1.0.0 > Implement MetricsReporter for M3 >

[jira] [Updated] (HUDI-7479) SQL confs don't propagate to spark row writer deltastreamer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7479: Fix Version/s: 0.15.0 > SQL confs don't propagate to spark row writer deltastreamer > --

[jira] [Updated] (HUDI-6953) Optimizing hudi sink operators generation

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6953: Fix Version/s: 0.15.0 > Optimizing hudi sink operators generation >

[jira] [Closed] (HUDI-6953) Optimizing hudi sink operators generation

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-6953. --- Resolution: Fixed > Optimizing hudi sink operators generation > - > >

[jira] [Updated] (HUDI-6089) Handle default insert behaviour to ingest duplicates

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-6089: Fix Version/s: 0.15.0 1.0.0 (was: 1.1.0) > Handle default insert b

[jira] [Updated] (HUDI-7341) Support unmerged log reader for HoodieFileGroupReader

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7341: Fix Version/s: 0.15.0 > Support unmerged log reader for HoodieFileGroupReader >

[jira] [Updated] (HUDI-7341) Support unmerged log reader for HoodieFileGroupReader

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7341: Fix Version/s: (was: 0.15.0) > Support unmerged log reader for HoodieFileGroupReader > -

[jira] [Updated] (HUDI-7462) Refactor checkTopicCheckpoint in KafkaOffsetGen for reusability

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7462: Fix Version/s: 0.15.0 1.0.0 > Refactor checkTopicCheckpoint in KafkaOffsetGen for reusabi

[jira] [Closed] (HUDI-7459) Update hudi-gcp-bundle pom to make it consistent with hudi-gcp

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7459. --- Resolution: Fixed > Update hudi-gcp-bundle pom to make it consistent with hudi-gcp > -

[jira] [Closed] (HUDI-7462) Refactor checkTopicCheckpoint in KafkaOffsetGen for reusability

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7462. --- Resolution: Fixed > Refactor checkTopicCheckpoint in KafkaOffsetGen for reusability >

[jira] [Updated] (HUDI-7464) JsonKafkaSource Metadata Bug

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7464: Fix Version/s: 0.15.0 1.0.0 > JsonKafkaSource Metadata Bug >

[jira] [Closed] (HUDI-7464) JsonKafkaSource Metadata Bug

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7464. --- Resolution: Fixed > JsonKafkaSource Metadata Bug > > > Key: HUDI-

[jira] [Updated] (HUDI-7385) Add config for custom write support for parquet row writer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7385: Fix Version/s: 1.0.0 > Add config for custom write support for parquet row writer >

[jira] [Updated] (HUDI-7459) Update hudi-gcp-bundle pom to make it consistent with hudi-gcp

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7459: Fix Version/s: 0.15.0 1.0.0 (was: 0.14.1) > Update hudi-gcp-bundle

[jira] [Closed] (HUDI-7385) Add config for custom write support for parquet row writer

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7385. --- Resolution: Fixed > Add config for custom write support for parquet row writer > -

[jira] [Closed] (HUDI-7456) Set 'hudi' as the explicit provider for new table properties when create table by spark

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-7456. --- Resolution: Fixed > Set 'hudi' as the explicit provider for new table properties when create > table by spark

[jira] [Updated] (HUDI-7456) Set 'hudi' as the explicit provider for new table properties when create table by spark

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7456: Fix Version/s: 0.15.0 1.0.0 > Set 'hudi' as the explicit provider for new table propertie

[jira] [Updated] (HUDI-7452) Repartition row dataset in S3/GCS based on task size

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7452: Fix Version/s: 0.15.0 1.0.0 > Repartition row dataset in S3/GCS based on task size >

[jira] [Closed] (HUDI-5823) RFC-65 : Partition TTL Management

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-5823. --- Resolution: Fixed > RFC-65 : Partition TTL Management > - > >

[jira] [Updated] (HUDI-5292) Exclude the test resources from every module packaging

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5292: Fix Version/s: 0.15.0 1.0.0 (was: 1.1.0) > Exclude the test resour

[jira] [Updated] (HUDI-7450) Fix invalid kafka offset range bug in KafkaOffsetGen.computeOffsetRanges

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-7450: Fix Version/s: 0.15.0 1.0.0 > Fix invalid kafka offset range bug in KafkaOffsetGen.comput

[jira] [Updated] (HUDI-5823) RFC-65 : Partition TTL Management

2024-06-09 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-5823: Fix Version/s: 1.0.0 (was: 1.1.0) > RFC-65 : Partition TTL Management > -

<    1   2   3   >