[jira] [Commented] (HUDI-6787) Integrate FileGroupReader with HoodieMergeOnReadSnapshotReader and RealtimeCompactedRecordReader for Hive

2024-04-03 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17833719#comment-17833719 ] Jonathan Vexler commented on HUDI-6787: --- Use [https://github.com/apache/hudi/pull/57

[jira] [Updated] (HUDI-7565) Break-up schema evolution: port spark code to file readers

2024-04-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7565: -- Due Date: 3/Apr/24 > Break-up schema evolution: port spark code to file readers > --

[jira] [Updated] (HUDI-7566) Break-up schema evolution: add schema evolution changes to ported spark

2024-04-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7566: -- Due Date: 4/Apr/24 > Break-up schema evolution: add schema evolution changes to ported spark > -

[jira] [Updated] (HUDI-7567) Break-up schema evolution: Integrate the readers into the new fg reader

2024-04-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7567: -- Due Date: 5/Apr/24 > Break-up schema evolution: Integrate the readers into the new fg reader > -

[jira] [Created] (HUDI-7568) Performance test fg reader

2024-04-02 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7568: - Summary: Performance test fg reader Key: HUDI-7568 URL: https://issues.apache.org/jira/browse/HUDI-7568 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-7567) Break-up schema evolution: Integrate the readers into the new fg reader

2024-04-02 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7567: - Summary: Break-up schema evolution: Integrate the readers into the new fg reader Key: HUDI-7567 URL: https://issues.apache.org/jira/browse/HUDI-7567 Project: Apache

[jira] [Created] (HUDI-7566) Break-up schema evolution: add schema evolution changes to ported spark

2024-04-02 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7566: - Summary: Break-up schema evolution: add schema evolution changes to ported spark Key: HUDI-7566 URL: https://issues.apache.org/jira/browse/HUDI-7566 Project: Apache

[jira] [Updated] (HUDI-7565) Break-up schema evolution: port spark code to file readers

2024-04-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7565: -- Fix Version/s: 1.0.0 > Break-up schema evolution: port spark code to file readers >

[jira] [Created] (HUDI-7565) Break-up schema evolution: port spark code to file readers

2024-04-02 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7565: - Summary: Break-up schema evolution: port spark code to file readers Key: HUDI-7565 URL: https://issues.apache.org/jira/browse/HUDI-7565 Project: Apache Hudi

[jira] [Assigned] (HUDI-7565) Break-up schema evolution: port spark code to file readers

2024-04-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-7565: - Assignee: Jonathan Vexler > Break-up schema evolution: port spark code to file readers >

[jira] [Created] (HUDI-7562) using -DTest=TestClass will still run scala tests

2024-04-01 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7562: - Summary: using -DTest=TestClass will still run scala tests Key: HUDI-7562 URL: https://issues.apache.org/jira/browse/HUDI-7562 Project: Apache Hudi Issue T

[jira] [Created] (HUDI-7525) Prevent dag trigger in mappartitions if possible

2024-03-21 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7525: - Summary: Prevent dag trigger in mappartitions if possible Key: HUDI-7525 URL: https://issues.apache.org/jira/browse/HUDI-7525 Project: Apache Hudi Issue Ty

[jira] [Updated] (HUDI-7417) NPE in StreamSync if empty batch and schema and upsert operation new table

2024-03-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7417: -- [https://github.com/apache/hudi/pull/10689] typo in the pr title. This is the fixing pr > NPE in S

[jira] [Updated] (HUDI-7500) SchemaProvider not deduced for some deltastreamer scenarios

2024-03-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7500: -- Status: In Progress (was: Open) > SchemaProvider not deduced for some deltastreamer scenarios >

[jira] [Updated] (HUDI-7500) SchemaProvider not deduced for some deltastreamer scenarios

2024-03-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7500: -- Status: Patch Available (was: In Progress) > SchemaProvider not deduced for some deltastreamer

[jira] [Created] (HUDI-7500) SchemaProvider not deduced for some deltastreamer scenarios

2024-03-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7500: - Summary: SchemaProvider not deduced for some deltastreamer scenarios Key: HUDI-7500 URL: https://issues.apache.org/jira/browse/HUDI-7500 Project: Apache Hudi

[jira] [Created] (HUDI-7489) Row writer clustering collects write statuses on the driver

2024-03-07 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7489: - Summary: Row writer clustering collects write statuses on the driver Key: HUDI-7489 URL: https://issues.apache.org/jira/browse/HUDI-7489 Project: Apache Hudi

[jira] [Created] (HUDI-7486) Classify exceptions as schema exceptions when converting from avro to spark row format

2024-03-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7486: - Summary: Classify exceptions as schema exceptions when converting from avro to spark row format Key: HUDI-7486 URL: https://issues.apache.org/jira/browse/HUDI-7486

[jira] [Created] (HUDI-7482) Update schema evolution docs to explicitly state allowed type promotions

2024-03-05 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7482: - Summary: Update schema evolution docs to explicitly state allowed type promotions Key: HUDI-7482 URL: https://issues.apache.org/jira/browse/HUDI-7482 Project: Apach

[jira] [Updated] (HUDI-7479) SQL confs don't propagate to spark row writer deltastreamer

2024-03-04 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7479: -- Status: Patch Available (was: In Progress) > SQL confs don't propagate to spark row writer delt

[jira] [Updated] (HUDI-7479) SQL confs don't propagate to spark row writer deltastreamer

2024-03-04 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7479: -- Description: SQL confs set outside of spark row writer bulk insert deltastreamer are missing whe

[jira] [Updated] (HUDI-7479) SQL confs don't propagate to spark row writer

2024-03-04 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7479: -- Status: In Progress (was: Open) > SQL confs don't propagate to spark row writer > -

[jira] [Created] (HUDI-7479) SQL confs don't propagate to spark row writer

2024-03-04 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7479: - Summary: SQL confs don't propagate to spark row writer Key: HUDI-7479 URL: https://issues.apache.org/jira/browse/HUDI-7479 Project: Apache Hudi Issue Type:

[jira] [Closed] (HUDI-7417) NPE in StreamSync if empty batch and schema and upsert operation new table

2024-02-16 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7417. - Resolution: Fixed > NPE in StreamSync if empty batch and schema and upsert operation new table > -

[jira] [Updated] (HUDI-7417) NPE in StreamSync if empty batch and schema and upsert operation new table

2024-02-16 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7417: -- Status: Patch Available (was: In Progress) > NPE in StreamSync if empty batch and schema and up

[jira] [Updated] (HUDI-7417) NPE in StreamSync if empty batch and schema and upsert operation new table

2024-02-16 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7417: -- Status: In Progress (was: Open) > NPE in StreamSync if empty batch and schema and upsert operat

[jira] [Created] (HUDI-7417) NPE in StreamSync if empty batch and schema and upsert operation new table

2024-02-16 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7417: - Summary: NPE in StreamSync if empty batch and schema and upsert operation new table Key: HUDI-7417 URL: https://issues.apache.org/jira/browse/HUDI-7417 Project: Apa

[jira] [Updated] (HUDI-7413) Make Issues with schema easier to understand for users

2024-02-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7413: -- Status: Patch Available (was: In Progress) > Make Issues with schema easier to understand for u

[jira] [Updated] (HUDI-7413) Make Issues with schema easier to understand for users

2024-02-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7413: -- Status: In Progress (was: Open) > Make Issues with schema easier to understand for users >

[jira] [Created] (HUDI-7413) Make Issues with schema easier to understand for users

2024-02-15 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7413: - Summary: Make Issues with schema easier to understand for users Key: HUDI-7413 URL: https://issues.apache.org/jira/browse/HUDI-7413 Project: Apache Hudi Is

[jira] [Created] (HUDI-7386) Add builder to filegroup reader

2024-02-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7386: - Summary: Add builder to filegroup reader Key: HUDI-7386 URL: https://issues.apache.org/jira/browse/HUDI-7386 Project: Apache Hudi Issue Type: New Feature

[jira] [Updated] (HUDI-7385) Add config for custom write support for parquet row writer

2024-02-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7385: -- Status: In Progress (was: Open) > Add config for custom write support for parquet row writer >

[jira] [Updated] (HUDI-7385) Add config for custom write support for parquet row writer

2024-02-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7385: -- Status: Patch Available (was: In Progress) > Add config for custom write support for parquet ro

[jira] [Created] (HUDI-7385) Add config for custom write support for parquet row writer

2024-02-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7385: - Summary: Add config for custom write support for parquet row writer Key: HUDI-7385 URL: https://issues.apache.org/jira/browse/HUDI-7385 Project: Apache Hudi

[jira] [Updated] (HUDI-7373) Revert config name back to hoodie.write.set.null.for.missing.columns in master

2024-02-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7373: -- Description: hoodie.write.set.null.for.missing.columns was renamed to  hoodie.write.handle.miss

[jira] [Updated] (HUDI-7373) Revert config name back to hoodie.write.set.null.for.missing.columns in master

2024-02-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7373: -- Status: In Progress (was: Open) > Revert config name back to hoodie.write.set.null.for.missing.

[jira] [Updated] (HUDI-7373) Revert config name back to hoodie.write.set.null.for.missing.columns in master

2024-02-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7373: -- Status: Patch Available (was: In Progress) > Revert config name back to hoodie.write.set.null.f

[jira] [Created] (HUDI-7373) Revert config name back to hoodie.write.set.null.for.missing.columns in master

2024-02-02 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7373: - Summary: Revert config name back to hoodie.write.set.null.for.missing.columns in master Key: HUDI-7373 URL: https://issues.apache.org/jira/browse/HUDI-7373 Project:

[jira] [Updated] (HUDI-3545) Make HoodieAvroWriteSupport class configurable

2024-01-31 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-3545: -- Status: Patch Available (was: In Progress) > Make HoodieAvroWriteSupport class configurable > -

[jira] [Updated] (HUDI-3545) Make HoodieAvroWriteSupport class configurable

2024-01-31 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-3545: -- Status: In Progress (was: Open) > Make HoodieAvroWriteSupport class configurable >

[jira] [Closed] (HUDI-3545) Make HoodieAvroWriteSupport class configurable

2024-01-31 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-3545. - Resolution: Fixed > Make HoodieAvroWriteSupport class configurable > -

[jira] [Closed] (HUDI-7327) hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSource unless meta cols are dropped

2024-01-26 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7327. - Resolution: Fixed > hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work >

[jira] [Closed] (HUDI-7215) Delete NewHoodieParquetFileFormat and all references

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7215. - Resolution: Fixed > Delete NewHoodieParquetFileFormat and all references > ---

[jira] [Closed] (HUDI-7244) Ensure ClosableIterator is propagated all the way to FileScanRDD

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7244. - Resolution: Fixed > Ensure ClosableIterator is propagated all the way to FileScanRDD > ---

[jira] [Updated] (HUDI-7045) Fix new file format and reader for schema evolution

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7045: -- Status: In Progress (was: Open) > Fix new file format and reader for schema evolution > ---

[jira] [Closed] (HUDI-7296) Reduce combinations for some tests to make ci faster

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7296. - Resolution: Fixed > Reduce combinations for some tests to make ci faster > ---

[jira] [Updated] (HUDI-6787) Integrate FileGroupReader with HoodieMergeOnReadSnapshotReader and RealtimeCompactedRecordReader for Hive

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-6787: -- Status: Patch Available (was: In Progress) > Integrate FileGroupReader with HoodieMergeOnReadSn

[jira] [Closed] (HUDI-6872) Simplify Out Of Box Schema Evolution Functionality

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-6872. - Resolution: Fixed > Simplify Out Of Box Schema Evolution Functionality > -

[jira] [Updated] (HUDI-7327) hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSource unless meta cols are dropped

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7327: -- Status: Patch Available (was: In Progress) > hoodie.write.handle.missing.cols.with.lossless.typ

[jira] [Closed] (HUDI-7298) Write bad records to error table in more cases instead of failing stream

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7298. - Resolution: Fixed > Write bad records to error table in more cases instead of failing stream > ---

[jira] [Updated] (HUDI-7327) hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSource unless meta cols are dropped

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7327: -- Status: In Progress (was: Open) > hoodie.write.handle.missing.cols.with.lossless.type.promotion

[jira] [Closed] (HUDI-6464) Implement Spark SQL Merge Into for tables without primary key

2024-01-24 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-6464. - Resolution: Fixed > Implement Spark SQL Merge Into for tables without primary key > --

[jira] [Updated] (HUDI-7327) hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSource unless meta cols are dropped

2024-01-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7327: -- Summary: hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with Hoodie

[jira] [Created] (HUDI-7327) hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSourceConfig unless meta cols are dropped

2024-01-23 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7327: - Summary: hoodie.write.handle.missing.cols.with.lossless.type.promotion does not work with HoodieIncrSourceConfig unless meta cols are dropped Key: HUDI-7327 URL: https://issues

[jira] [Closed] (HUDI-5361) Propagate Hudi properties set in Spark's SQLConf to Hudi

2024-01-18 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-5361. - Fix Version/s: 0.14.0 (was: 1.1.0) Resolution: Fixed > Propagate Hud

[jira] [Created] (HUDI-7298) Write bad records to error table in more cases instead of failing stream

2024-01-15 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7298: - Summary: Write bad records to error table in more cases instead of failing stream Key: HUDI-7298 URL: https://issues.apache.org/jira/browse/HUDI-7298 Project: Apach

[jira] [Created] (HUDI-7296) Reduce combinations for some tests to make ci faster

2024-01-11 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7296: - Summary: Reduce combinations for some tests to make ci faster Key: HUDI-7296 URL: https://issues.apache.org/jira/browse/HUDI-7296 Project: Apache Hudi Issu

[jira] [Updated] (HUDI-7290) filterPendingReplaceTimeline used incorrectly in various places

2024-01-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7290: -- Status: Patch Available (was: In Progress) > filterPendingReplaceTimeline used incorrectly in v

[jira] [Updated] (HUDI-7284) Differentiate between replacecommits in stream sync

2024-01-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7284: -- Status: In Progress (was: Open) > Differentiate between replacecommits in stream sync > ---

[jira] [Updated] (HUDI-7284) Differentiate between replacecommits in stream sync

2024-01-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7284: -- Status: Patch Available (was: In Progress) > Differentiate between replacecommits in stream syn

[jira] [Closed] (HUDI-7284) Differentiate between replacecommits in stream sync

2024-01-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7284. - Resolution: Fixed > Differentiate between replacecommits in stream sync >

[jira] [Updated] (HUDI-7290) filterPendingReplaceTimeline used incorrectly in various places

2024-01-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7290: -- Status: In Progress (was: Open) > filterPendingReplaceTimeline used incorrectly in various plac

[jira] [Created] (HUDI-7290) filterPendingReplaceTimeline used incorrectly in various places

2024-01-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7290: - Summary: filterPendingReplaceTimeline used incorrectly in various places Key: HUDI-7290 URL: https://issues.apache.org/jira/browse/HUDI-7290 Project: Apache Hudi

[jira] [Created] (HUDI-7284) Differentiate between replacecommits in stream sync

2024-01-09 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7284: - Summary: Differentiate between replacecommits in stream sync Key: HUDI-7284 URL: https://issues.apache.org/jira/browse/HUDI-7284 Project: Apache Hudi Issue

[jira] [Created] (HUDI-7275) org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC causes issues with following tests

2024-01-05 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7275: - Summary: org.apache.hudi.TestHoodieSparkSqlWriter#testInsertDatasetWithTimelineTimezoneUTC causes issues with following tests Key: HUDI-7275 URL: https://issues.apache.org/jira

[jira] [Assigned] (HUDI-6787) Integrate FileGroupReader with HoodieMergeOnReadSnapshotReader and RealtimeCompactedRecordReader for Hive

2023-12-27 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-6787: - Assignee: Jonathan Vexler > Integrate FileGroupReader with HoodieMergeOnReadSnapshotReade

[jira] [Created] (HUDI-7244) Ensure ClosableIterator is propagated all the way to FileScanRDD

2023-12-20 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7244: - Summary: Ensure ClosableIterator is propagated all the way to FileScanRDD Key: HUDI-7244 URL: https://issues.apache.org/jira/browse/HUDI-7244 Project: Apache Hudi

[jira] [Updated] (HUDI-7236) MIT fails when attempting to change partition

2023-12-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7236: -- Status: In Progress (was: Open) > MIT fails when attempting to change partition > -

[jira] [Updated] (HUDI-7236) MIT fails when attempting to change partition

2023-12-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7236: -- Status: Patch Available (was: In Progress) > MIT fails when attempting to change partition > --

[jira] [Created] (HUDI-7236) MIT fails when attempting to change partition

2023-12-15 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7236: - Summary: MIT fails when attempting to change partition Key: HUDI-7236 URL: https://issues.apache.org/jira/browse/HUDI-7236 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-7215) Delete NewHoodieParquetFileFormat and all references

2023-12-11 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7215: -- Status: In Progress (was: Open) > Delete NewHoodieParquetFileFormat and all references > --

[jira] [Created] (HUDI-7215) Delete NewHoodieParquetFileFormat and all references

2023-12-11 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7215: - Summary: Delete NewHoodieParquetFileFormat and all references Key: HUDI-7215 URL: https://issues.apache.org/jira/browse/HUDI-7215 Project: Apache Hudi Issu

[jira] [Closed] (HUDI-7087) NewHoodieParquetFileFormat does not work with parquet log files

2023-12-11 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7087. - Resolution: Invalid > NewHoodieParquetFileFormat does not work with parquet log files > --

[jira] [Closed] (HUDI-7201) reconcileSchemaRequirements returns empty schema if the incoming data is empty

2023-12-11 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7201. - Resolution: Fixed > reconcileSchemaRequirements returns empty schema if the incoming data is empty

[jira] [Updated] (HUDI-7201) reconcileSchemaRequirements returns empty schema if the incoming data is empty

2023-12-08 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7201: -- Status: Patch Available (was: In Progress) > reconcileSchemaRequirements returns empty schema i

[jira] [Assigned] (HUDI-7201) reconcileSchemaRequirements returns empty schema if the incoming data is empty

2023-12-08 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-7201: - Assignee: Jonathan Vexler > reconcileSchemaRequirements returns empty schema if the incom

[jira] [Updated] (HUDI-7201) reconcileSchemaRequirements returns empty schema if the incoming data is empty

2023-12-08 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7201: -- Status: In Progress (was: Open) > reconcileSchemaRequirements returns empty schema if the incom

[jira] [Created] (HUDI-7201) reconcileSchemaRequirements returns empty schema if the incoming data is empty

2023-12-08 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7201: - Summary: reconcileSchemaRequirements returns empty schema if the incoming data is empty Key: HUDI-7201 URL: https://issues.apache.org/jira/browse/HUDI-7201 Project:

[jira] [Closed] (HUDI-7137) Implement bootstrap for new filegroup reader

2023-12-07 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7137. - Resolution: Fixed > Implement bootstrap for new filegroup reader > ---

[jira] [Created] (HUDI-7193) HoodieFileGroupRecordBuffer should be able to work properly without any log files

2023-12-07 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7193: - Summary: HoodieFileGroupRecordBuffer should be able to work properly without any log files Key: HUDI-7193 URL: https://issues.apache.org/jira/browse/HUDI-7193 Proje

[jira] [Created] (HUDI-7192) Add constructor to new filegroup reader to deduce the fileslice

2023-12-07 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7192: - Summary: Add constructor to new filegroup reader to deduce the fileslice Key: HUDI-7192 URL: https://issues.apache.org/jira/browse/HUDI-7192 Project: Apache Hudi

[jira] [Updated] (HUDI-7045) Fix new file format and reader for schema evolution

2023-12-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7045: -- Description: When this is implemented, parquet readers should not be created in  HoodieFileGrou

[jira] [Updated] (HUDI-7045) Fix new file format and reader for schema evolution

2023-12-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7045: -- Description: When this is implemented, parquet readers should not be created in  HoodieFileGrou

[jira] [Closed] (HUDI-7062) Use caching iterator style in new filegroup reader

2023-12-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7062. - Resolution: Fixed > Use caching iterator style in new filegroup reader > -

[jira] [Created] (HUDI-7162) RDD's Don't cache in some situations with new filegroup reader + new parquet file format

2023-11-29 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7162: - Summary: RDD's Don't cache in some situations with new filegroup reader + new parquet file format Key: HUDI-7162 URL: https://issues.apache.org/jira/browse/HUDI-7162

[jira] [Updated] (HUDI-7137) Implement bootstrap for new filegroup reader

2023-11-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7137: -- Status: In Progress (was: Open) > Implement bootstrap for new filegroup reader > --

[jira] [Created] (HUDI-7137) Implement bootstrap for new filegroup reader

2023-11-23 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7137: - Summary: Implement bootstrap for new filegroup reader Key: HUDI-7137 URL: https://issues.apache.org/jira/browse/HUDI-7137 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-7137) Implement bootstrap for new filegroup reader

2023-11-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7137: -- Status: Patch Available (was: In Progress) > Implement bootstrap for new filegroup reader > ---

[jira] [Updated] (HUDI-7087) NewHoodieParquetFileFormat does not work with parquet log files

2023-11-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7087: -- Description: {code:java}     at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecut

[jira] [Updated] (HUDI-7087) NewHoodieParquetFileFormat does not work with parquet log files

2023-11-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7087: -- Description: {code:java}     at org.apache.hudi.table.action.commit.BaseSparkCommitActionExecut

[jira] [Created] (HUDI-7087) NewHoodieParquetFileFormat does not work with parquet log files

2023-11-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7087: - Summary: NewHoodieParquetFileFormat does not work with parquet log files Key: HUDI-7087 URL: https://issues.apache.org/jira/browse/HUDI-7087 Project: Apache Hudi

[jira] [Assigned] (HUDI-6658) Implement MOR Incremental for new file format

2023-11-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-6658: - Assignee: Jonathan Vexler > Implement MOR Incremental for new file format > -

[jira] [Assigned] (HUDI-6613) New file format does not work with in memory index

2023-11-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-6613: - Assignee: Jonathan Vexler > New file format does not work with in memory index >

[jira] [Updated] (HUDI-6613) New file format does not work with in memory index

2023-11-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-6613: -- Status: In Progress (was: Open) > New file format does not work with in memory index >

[jira] [Created] (HUDI-7081) Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

2023-11-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7081: - Summary: Hoodie FilegroupReader cannot read Enums from MOR avro log blocks Key: HUDI-7081 URL: https://issues.apache.org/jira/browse/HUDI-7081 Project: Apache Hudi

[jira] [Created] (HUDI-7079) Disable new file reader for metadata table

2023-11-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7079: - Summary: Disable new file reader for metadata table Key: HUDI-7079 URL: https://issues.apache.org/jira/browse/HUDI-7079 Project: Apache Hudi Issue Type: Im

[jira] [Created] (HUDI-7068) Disable vectorized reader for hoodie filegroup reader when schema isn't supported

2023-11-09 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7068: - Summary: Disable vectorized reader for hoodie filegroup reader when schema isn't supported Key: HUDI-7068 URL: https://issues.apache.org/jira/browse/HUDI-7068 Proje

[jira] [Created] (HUDI-7066) Only push down all filters to mor base reader

2023-11-09 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7066: - Summary: Only push down all filters to mor base reader Key: HUDI-7066 URL: https://issues.apache.org/jira/browse/HUDI-7066 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-7064) Temp view different reads cause issues with support batch

2023-11-09 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7064: - Summary: Temp view different reads cause issues with support batch Key: HUDI-7064 URL: https://issues.apache.org/jira/browse/HUDI-7064 Project: Apache Hudi

[jira] [Created] (HUDI-7062) Use caching iterator style in new filegroup reader

2023-11-09 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7062: - Summary: Use caching iterator style in new filegroup reader Key: HUDI-7062 URL: https://issues.apache.org/jira/browse/HUDI-7062 Project: Apache Hudi Issue

<    1   2   3   4   5   6   7   8   9   >