[jira] [Updated] (HUDI-7964) Partitions not created correctly with SQL when multiple partitions specified out of order

2024-07-06 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7964: -- Labels: spark-sql (was: ) > Partitions not created correctly with SQL when multiple partitions

[jira] [Updated] (HUDI-7964) Partitions not created correctly with SQL when multiple partitions specified out of order

2024-07-06 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7964: -- Issue Type: Bug (was: Task) > Partitions not created correctly with SQL when multiple partitions

[jira] [Created] (HUDI-7964) Partitions not created correctly with SQL when multiple partitions specified out of order

2024-07-06 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7964: - Summary: Partitions not created correctly with SQL when multiple partitions specified out of order Key: HUDI-7964 URL: https://issues.apache.org/jira/browse/HUDI-7964

[jira] [Closed] (HUDI-7954) Fix data skipping with secondary index when there are no log files

2024-07-05 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7954. - Resolution: Fixed > Fix data skipping with secondary index when there are no log files >

[jira] [Created] (HUDI-7959) Refactor HoodieBackedTableMetadata APIs

2024-07-05 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7959: - Summary: Refactor HoodieBackedTableMetadata APIs Key: HUDI-7959 URL: https://issues.apache.org/jira/browse/HUDI-7959 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7958) Create partition stats index for all columns when no columns specified

2024-07-05 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7958: - Summary: Create partition stats index for all columns when no columns specified Key: HUDI-7958 URL: https://issues.apache.org/jira/browse/HUDI-7958 Project: Apache Hudi

[jira] [Created] (HUDI-7954) Fix data skipping with secondary index when there are no log files

2024-07-05 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7954: - Summary: Fix data skipping with secondary index when there are no log files Key: HUDI-7954 URL: https://issues.apache.org/jira/browse/HUDI-7954 Project: Apache Hudi

[jira] [Closed] (HUDI-7945) Fix partition pruning using PARTITION_STATS index in Spark

2024-07-04 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7945. - Resolution: Fixed > Fix partition pruning using PARTITION_STATS index in Spark >

[jira] [Updated] (HUDI-7945) Fix partition pruning using PARTITION_STATS index in Spark

2024-07-04 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7945: -- Status: Patch Available (was: In Progress) > Fix partition pruning using PARTITION_STATS index in

[jira] [Closed] (HUDI-7841) RLI and secondary index should consider only pruned partitions for file skipping

2024-07-02 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7841. - Resolution: Fixed > RLI and secondary index should consider only pruned partitions for file > skipping >

[jira] [Closed] (HUDI-7924) Capture Latency and Failure Metrics For Hive Table recreation

2024-06-28 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7924. - Fix Version/s: 1.0.0 Resolution: Fixed > Capture Latency and Failure Metrics For Hive Table

[jira] [Closed] (HUDI-7817) Use Jackson Core instead of org.codehaus.jackson for JSON encoding

2024-06-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7817. - Resolution: Fixed > Use Jackson Core instead of org.codehaus.jackson for JSON encoding >

[jira] [Updated] (HUDI-7665) Rolling upgrade of 1.0

2024-06-23 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7665: -- Epic Link: HUDI-7856 (was: HUDI-6242) > Rolling upgrade of 1.0 > --- > >

[jira] [Created] (HUDI-7908) HoodieFileGroupReader fails if precombine and partition fields are same

2024-06-18 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7908: - Summary: HoodieFileGroupReader fails if precombine and partition fields are same Key: HUDI-7908 URL: https://issues.apache.org/jira/browse/HUDI-7908 Project: Apache Hudi

[jira] [Updated] (HUDI-7420) Parallelize the process of constructing `logFilesMarkerPath` in CommitMetadatautils#reconcileMetadataForMissingFiles

2024-06-18 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7420: -- Sprint: Sprint 2024-03-25, Sprint 2024-04-26, 2024/06/03-16 (was: Sprint 2024-03-25, Sprint

[jira] [Updated] (HUDI-7904) RLI not skipping data files

2024-06-18 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7904: -- Sprint: 2024/06/17-30 > RLI not skipping data files > --- > >

[jira] [Updated] (HUDI-7905) New Action for Clustering

2024-06-18 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7905: -- Sprint: 2024/06/17-30 > New Action for Clustering > - > > Key:

[jira] [Updated] (HUDI-7907) Validate new file slicing on table with mix of older and new log files

2024-06-18 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7907: -- Sprint: 2024/06/17-30 > Validate new file slicing on table with mix of older and new log files >

[jira] [Updated] (HUDI-7903) Partition Stats Index not getting created with SQL

2024-06-18 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7903: -- Sprint: 2024/06/17-30 > Partition Stats Index not getting created with SQL >

[jira] [Updated] (HUDI-7907) Validate new file slicing on table with mix of older and new log files

2024-06-18 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7907: -- Fix Version/s: 1.0.0 > Validate new file slicing on table with mix of older and new log files >

[jira] [Created] (HUDI-7907) Validate new file slicing on table with mix of older and new log files

2024-06-18 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7907: - Summary: Validate new file slicing on table with mix of older and new log files Key: HUDI-7907 URL: https://issues.apache.org/jira/browse/HUDI-7907 Project: Apache Hudi

[jira] [Created] (HUDI-7905) New Action for Clustering

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7905: - Summary: New Action for Clustering Key: HUDI-7905 URL: https://issues.apache.org/jira/browse/HUDI-7905 Project: Apache Hudi Issue Type: Task Reporter:

[jira] [Assigned] (HUDI-7539) Use .compaction for compaction action consistently

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7539: - Assignee: Lokesh Jain (was: Vinoth Chandar) > Use .compaction for compaction action

[jira] [Assigned] (HUDI-7903) Partition Stats Index not getting created with SQL

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7903: - Assignee: Sagar Sumit > Partition Stats Index not getting created with SQL >

[jira] [Created] (HUDI-7904) RLI not skipping data files

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7904: - Summary: RLI not skipping data files Key: HUDI-7904 URL: https://issues.apache.org/jira/browse/HUDI-7904 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-7903) Partition Stats Index not getting created with SQL

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7903: - Summary: Partition Stats Index not getting created with SQL Key: HUDI-7903 URL: https://issues.apache.org/jira/browse/HUDI-7903 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-7882) Umbrella ticket to track all changes required to support reading 1.x tables with 0.16.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7882: -- Description: We wanted to support reading 1.x tables in 0.16.0 release. So, creating this umbrella

[jira] [Created] (HUDI-7901) Ensure 1.0 MDT timeline is readable by 0.16

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7901: - Summary: Ensure 1.0 MDT timeline is readable by 0.16 Key: HUDI-7901 URL: https://issues.apache.org/jira/browse/HUDI-7901 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-7178) Performance test for Time Travel Queries (MOR and COW)

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7178: -- Fix Version/s: 1.0.0 > Performance test for Time Travel Queries (MOR and COW) >

[jira] [Updated] (HUDI-7180) Performance Test for CDC queries (MOR and COW)

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7180: -- Fix Version/s: 1.0.0 > Performance Test for CDC queries (MOR and COW) >

[jira] [Updated] (HUDI-7179) Performance Test for Incremental Queries (MOR and COW)

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7179: -- Fix Version/s: 1.0.0 > Performance Test for Incremental Queries (MOR and COW) >

[jira] [Updated] (HUDI-7894) Umbrella ticket for 0.16.0 to 1.0.0 upgrade

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7894: -- Description: # Rewrite archived timeline as LSM timeline - HUDI-7858 # Test backward compatibility for

[jira] [Updated] (HUDI-7894) Umbrella ticket for 0.16.0 to 1.0.0 upgrade

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7894: -- Description: # Rewrite archived timeline as LSM timeline - HUDI-7858 # Test backward compatibility for

[jira] [Updated] (HUDI-7895) Umbrella ticket for 1.0.0 to 0.16.0 downgrade

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7895: -- Description: # Rewrite LSM timeline as 0.x archived timeline - HUDI-7862 # Test Active timeline with

[jira] [Updated] (HUDI-7899) Test Active timeline with mix of 1.0 and 0.x instants

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7899: -- Epic Link: HUDI-7856 Fix Version/s: 1.0.0 > Test Active timeline with mix of 1.0 and 0.x

[jira] [Created] (HUDI-7900) Downgrade handles to delete new MDT partitions and cleanup MDT table properties

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7900: - Summary: Downgrade handles to delete new MDT partitions and cleanup MDT table properties Key: HUDI-7900 URL: https://issues.apache.org/jira/browse/HUDI-7900 Project:

[jira] [Created] (HUDI-7899) Test Active timeline with mix of 1.0 and 0.x instants

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7899: - Summary: Test Active timeline with mix of 1.0 and 0.x instants Key: HUDI-7899 URL: https://issues.apache.org/jira/browse/HUDI-7899 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7894) Umbrella ticket for 0.16.0 to 1.0.0 upgrade

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7894: -- Description: # Rewrite archived timeline as LSM timeline - HUDI-7858 # Test backward compatibility for

[jira] [Assigned] (HUDI-7886) Make metadata payload from 1.x readable in 0.16.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7886: - Assignee: Lokesh Jain > Make metadata payload from 1.x readable in 0.16.0 >

[jira] [Closed] (HUDI-7857) Handle timeline instants without completion time

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7857. - Resolution: Duplicate > Handle timeline instants without completion time >

[jira] [Updated] (HUDI-7883) Ensure 1.x commit instants are readable w/ 0.16.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7883: -- Description: Ensure 1.x commit instants are readable w/ 0.16.0 reader.   May be we need to migrate

[jira] [Updated] (HUDI-7884) Design HoodieDefaultTimeline to be able to read timeline both from 0.16.0 and from 1.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7884: -- Description: We wanted to support reading 1.x tables in 0.16.0 reader.  Either entire timeline will be

[jira] [Assigned] (HUDI-7857) Handle timeline instants without completion time

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7857: - Assignee: Sagar Sumit (was: Danny Chen) > Handle timeline instants without completion time >

[jira] [Updated] (HUDI-7857) Handle timeline instants without completion time

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7857: -- Description: Pull HoodieInstant and completionTime name changes from

[jira] [Updated] (HUDI-7857) Handle timeline instants without completion time

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7857: -- Status: In Progress (was: Open) > Handle timeline instants without completion time >

[jira] [Closed] (HUDI-7671) Make Hudi timeline backward compatible

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7671. - Resolution: Fixed > Make Hudi timeline backward compatible > -- > >

[jira] [Updated] (HUDI-7857) Handle timeline instants without completion time

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7857: -- Status: Patch Available (was: In Progress) > Handle timeline instants without completion time >

[jira] [Assigned] (HUDI-7877) Add record position to record index metadata payload

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7877: - Assignee: Lokesh Jain > Add record position to record index metadata payload >

[jira] [Closed] (HUDI-7885) Port table property changes from 1.0 to 0.16.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7885. - Resolution: Duplicate > Port table property changes from 1.0 to 0.16.0 >

[jira] [Assigned] (HUDI-7884) Design HoodieDefaultTimeline to be able to read timeline both from 0.16.0 and from 1.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7884: - Assignee: sivabalan narayanan > Design HoodieDefaultTimeline to be able to read timeline both

[jira] [Assigned] (HUDI-7866) Pull commit metadata changes in bridge release.

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7866: - Assignee: sivabalan narayanan > Pull commit metadata changes in bridge release. >

[jira] [Closed] (HUDI-7860) Branch out bridge release

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7860. - Assignee: Ethan Guo Resolution: Done We are using branch-0.x > Branch out bridge release >

[jira] [Assigned] (HUDI-7883) Ensure 1.x commit instants are readable w/ 0.16.0

2024-06-17 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7883: - Assignee: Sagar Sumit > Ensure 1.x commit instants are readable w/ 0.16.0 >

[jira] [Created] (HUDI-7897) Efficient lookup of completed replacecommits from timeline

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7897: - Summary: Efficient lookup of completed replacecommits from timeline Key: HUDI-7897 URL: https://issues.apache.org/jira/browse/HUDI-7897 Project: Apache Hudi Issue

[jira] [Created] (HUDI-7895) Umbrella ticket for 1.0.0 to 0.16.0 downgrade

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7895: - Summary: Umbrella ticket for 1.0.0 to 0.16.0 downgrade Key: HUDI-7895 URL: https://issues.apache.org/jira/browse/HUDI-7895 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7894) Umbrella ticket for 0.16.0 to 1.0.0 upgrade

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7894: - Summary: Umbrella ticket for 0.16.0 to 1.0.0 upgrade Key: HUDI-7894 URL: https://issues.apache.org/jira/browse/HUDI-7894 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7893) Avoid renames for cloud storage and provide new atomic API in HoodieStorage

2024-06-17 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7893: - Summary: Avoid renames for cloud storage and provide new atomic API in HoodieStorage Key: HUDI-7893 URL: https://issues.apache.org/jira/browse/HUDI-7893 Project: Apache

[jira] [Created] (HUDI-7878) Flakey integration test from hudi-integ-test-bundle

2024-06-13 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7878: - Summary: Flakey integration test from hudi-integ-test-bundle Key: HUDI-7878 URL: https://issues.apache.org/jira/browse/HUDI-7878 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-7877) Add record position to record index metadata payload

2024-06-13 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7877: - Summary: Add record position to record index metadata payload Key: HUDI-7877 URL: https://issues.apache.org/jira/browse/HUDI-7877 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-7865) Pull table properties changes in bridge release

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7865: - Assignee: Sagar Sumit > Pull table properties changes in bridge release >

[jira] [Assigned] (HUDI-7865) Pull table properties changes in bridge release

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7865: - Assignee: Lokesh Jain (was: Sagar Sumit) > Pull table properties changes in bridge release >

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7865: -- Description: In 1.0.0, we changed some table properties to have nums as value instead of classnames

[jira] [Updated] (HUDI-7866) Pull commit metadata changes in bridge release.

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7866: -- Fix Version/s: 0.16.0 > Pull commit metadata changes in bridge release. >

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7865: -- Fix Version/s: 0.16.0 > Pull table properties changes in bridge release >

[jira] [Updated] (HUDI-7861) Pull MDT schema changes to bridge release

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7861: -- Description: In 1.0.0, we changed MDT schema, essentially added fields for new MDT partitions. The

[jira] [Updated] (HUDI-7865) Pull table properties changes in bridge release

2024-06-12 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7865: -- Description: In 1.0.0, we changed some table properties to have nums as value instead of classnames and

[jira] [Created] (HUDI-7866) Pull commit metadata changes in bridge release.

2024-06-12 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7866: - Summary: Pull commit metadata changes in bridge release. Key: HUDI-7866 URL: https://issues.apache.org/jira/browse/HUDI-7866 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7865) Pull table properties changes in bridge release

2024-06-12 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7865: - Summary: Pull table properties changes in bridge release Key: HUDI-7865 URL: https://issues.apache.org/jira/browse/HUDI-7865 Project: Apache Hudi Issue Type: Task

[jira] [Closed] (HUDI-7864) Audit all beta2 configs are enabled by default

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7864. - Resolution: Done > Audit all beta2 configs are enabled by default >

[jira] [Created] (HUDI-7864) Audit all beta2 configs are enabled by default

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7864: - Summary: Audit all beta2 configs are enabled by default Key: HUDI-7864 URL: https://issues.apache.org/jira/browse/HUDI-7864 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-7857) Handle timeline instants without completion time

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7857: -- Sprint: 2024/06/03-16 > Handle timeline instants without completion time >

[jira] [Assigned] (HUDI-7857) Handle timeline instants without completion time

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7857: - Assignee: Danny Chen > Handle timeline instants without completion time >

[jira] [Created] (HUDI-7863) Ensure full compaction before downgrade

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7863: - Summary: Ensure full compaction before downgrade Key: HUDI-7863 URL: https://issues.apache.org/jira/browse/HUDI-7863 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-7857) Handle timeline instants without completion time

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7857: -- Summary: Handle timeline instants without completion time (was: Handline timeline instants without

[jira] [Created] (HUDI-7862) Implement LegacyArchivedMetaEntryWriter to rewrite archived timeline

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7862: - Summary: Implement LegacyArchivedMetaEntryWriter to rewrite archived timeline Key: HUDI-7862 URL: https://issues.apache.org/jira/browse/HUDI-7862 Project: Apache Hudi

[jira] [Updated] (HUDI-7860) Branch out bridge release

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7860: -- Fix Version/s: 1.0.0 > Branch out bridge release > - > > Key:

[jira] [Created] (HUDI-7861) Pull MDT schema changes to bridge release

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7861: - Summary: Pull MDT schema changes to bridge release Key: HUDI-7861 URL: https://issues.apache.org/jira/browse/HUDI-7861 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-7860) Branch out bridge release

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7860: -- Fix Version/s: 0.16.0 > Branch out bridge release > - > > Key:

[jira] [Updated] (HUDI-7857) Handline timeline instants without completion time

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7857: -- Fix Version/s: 1.0.0 > Handline timeline instants without completion time >

[jira] [Created] (HUDI-7859) Rename instant files to be consistent with 0.x naming format

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7859: - Summary: Rename instant files to be consistent with 0.x naming format Key: HUDI-7859 URL: https://issues.apache.org/jira/browse/HUDI-7859 Project: Apache Hudi

[jira] [Updated] (HUDI-7859) Rename instant files to be consistent with 0.x naming format

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7859: -- Fix Version/s: 1.0.0 > Rename instant files to be consistent with 0.x naming format >

[jira] [Created] (HUDI-7860) Branch out bridge release

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7860: - Summary: Branch out bridge release Key: HUDI-7860 URL: https://issues.apache.org/jira/browse/HUDI-7860 Project: Apache Hudi Issue Type: Task Reporter:

[jira] [Updated] (HUDI-7858) Write archived timeline as LSM timeline

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7858: -- Fix Version/s: 1.0.0 > Write archived timeline as LSM timeline >

[jira] [Created] (HUDI-7858) Write archived timeline as LSM timeline

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7858: - Summary: Write archived timeline as LSM timeline Key: HUDI-7858 URL: https://issues.apache.org/jira/browse/HUDI-7858 Project: Apache Hudi Issue Type: Task

[jira] [Created] (HUDI-7857) Handline timeline instants without completion time

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7857: - Summary: Handline timeline instants without completion time Key: HUDI-7857 URL: https://issues.apache.org/jira/browse/HUDI-7857 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-7856) 1.0 Migration

2024-06-11 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7856: - Summary: 1.0 Migration Key: HUDI-7856 URL: https://issues.apache.org/jira/browse/HUDI-7856 Project: Apache Hudi Issue Type: Epic Reporter: Sagar Sumit

[jira] [Closed] (HUDI-7269) Fallback to key-based merging if there is no positions in log header

2024-06-11 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7269. - Resolution: Done > Fallback to key-based merging if there is no positions in log header >

[jira] [Updated] (HUDI-7269) Fallback to key-based merging if there is no positions in log header

2024-06-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7269: -- Fix Version/s: 1.0.0-beta2 > Fallback to key-based merging if there is no positions in log header >

[jira] [Updated] (HUDI-6798) Implement event-time-based merging mode in FileGroupReader

2024-06-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-6798: -- Fix Version/s: 1.0.0-beta2 > Implement event-time-based merging mode in FileGroupReader >

[jira] [Closed] (HUDI-7852) Constrain the comparison of different types of ordering values to limited cases

2024-06-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7852. - Resolution: Fixed > Constrain the comparison of different types of ordering values to limited > cases >

[jira] [Updated] (HUDI-7841) RLI and secondary index should consider only pruned partitions for file skipping

2024-06-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7841: -- Sprint: 2024/06/03-16 > RLI and secondary index should consider only pruned partitions for file >

[jira] [Updated] (HUDI-7841) RLI and secondary index should consider only pruned partitions for file skipping

2024-06-10 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7841: -- Story Points: 4 > RLI and secondary index should consider only pruned partitions for file > skipping >

[jira] [Closed] (HUDI-7844) Fix HoodieSparkSqlTestBase to throw error upon test failure

2024-06-08 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7844. - Resolution: Fixed > Fix HoodieSparkSqlTestBase to throw error upon test failure >

[jira] [Commented] (HUDI-7835) Spark context not stopped properly if the test had some exception that was ignored

2024-06-08 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853358#comment-17853358 ] Sagar Sumit commented on HUDI-7835: --- I observed one more thing: Somehow the TestFunctionalIndex is

[jira] [Updated] (HUDI-7841) RLI and secondary index should consider only pruned partitions for file skipping

2024-06-07 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-7841: -- Summary: RLI and secondary index should consider only pruned partitions for file skipping (was: RLI

[jira] [Assigned] (HUDI-7841) RLI should consider only pruned partitions for file skipping

2024-06-07 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit reassigned HUDI-7841: - Assignee: Lokesh Jain > RLI should consider only pruned partitions for file skipping >

[jira] [Created] (HUDI-7841) RLI should consider only pruned partitions for file skipping

2024-06-07 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7841: - Summary: RLI should consider only pruned partitions for file skipping Key: HUDI-7841 URL: https://issues.apache.org/jira/browse/HUDI-7841 Project: Apache Hudi

[jira] [Closed] (HUDI-7567) Break-up schema evolution: Integrate the readers into the new fg reader

2024-06-07 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7567. - Resolution: Done > Break-up schema evolution: Integrate the readers into the new fg reader >

[jira] [Closed] (HUDI-7146) Implement secondary index

2024-06-07 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit closed HUDI-7146. - Resolution: Done > Implement secondary index > - > > Key:

[jira] [Created] (HUDI-7836) Support secondary index to be created on multiple fields

2024-06-06 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-7836: - Summary: Support secondary index to be created on multiple fields Key: HUDI-7836 URL: https://issues.apache.org/jira/browse/HUDI-7836 Project: Apache Hudi Issue

  1   2   3   4   5   6   7   8   9   10   >