[jira] [Commented] (HUDI-7717) hoodie.combine.before.insert silently broken for bulk_insert if meta fields disabled (causes duplicates)

2024-05-16 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847029#comment-17847029 ] Aditya Goenka commented on HUDI-7717: - Thanks a lot [~geserdugarov]  > hoodie.combine.before.insert

[jira] [Commented] (HUDI-7383) CDC query failed due to dependency issue

2024-05-15 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846687#comment-17846687 ] Aditya Goenka commented on HUDI-7383: - Fixed in [https://github.com/apache/hudi/pull/10877]  

[jira] [Closed] (HUDI-7360) Incremental CDC Query after 0.14.1 upgrade giving Jackson class incompatibility exception

2024-05-15 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-7360. --- Resolution: Duplicate > Incremental CDC Query after 0.14.1 upgrade giving Jackson class >

[jira] [Commented] (HUDI-7360) Incremental CDC Query after 0.14.1 upgrade giving Jackson class incompatibility exception

2024-05-15 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846686#comment-17846686 ] Aditya Goenka commented on HUDI-7360: - Fixed in [https://github.com/apache/hudi/pull/10877] >

[jira] [Created] (HUDI-7717) hoodie.combine.before.insert silently broken for bulk_insert if meta fields disabled (causes duplicates)

2024-05-06 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7717: --- Summary: hoodie.combine.before.insert silently broken for bulk_insert if meta fields disabled (causes duplicates) Key: HUDI-7717 URL:

[jira] [Created] (HUDI-7709) Class Cast Exception while reading the data using TimestampBasedKeyGenerator

2024-05-03 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7709: --- Summary: Class Cast Exception while reading the data using TimestampBasedKeyGenerator Key: HUDI-7709 URL: https://issues.apache.org/jira/browse/HUDI-7709 Project:

[jira] [Created] (HUDI-7698) Introduce config to Return the original partition value from parquet when using CustomKeyGenerator

2024-04-30 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7698: --- Summary: Introduce config to Return the original partition value from parquet when using CustomKeyGenerator Key: HUDI-7698 URL: https://issues.apache.org/jira/browse/HUDI-7698

[jira] [Updated] (HUDI-7602) Writer failing with exception when precision is different for two decimal fields with same name

2024-04-11 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7602: Description: Github issue - [https://github.com/apache/hudi/issues/10983]   Reproducible Code - 

[jira] [Updated] (HUDI-7602) Writer failing with exception when precision is different for two decimal fields with same name

2024-04-11 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7602: Description: Github issue - [https://github.com/apache/hudi/issues/10983]   Reproducible Code - 

[jira] [Created] (HUDI-7602) Writer failing with exception when precision is different for two decimal fields with same name

2024-04-11 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7602: --- Summary: Writer failing with exception when precision is different for two decimal fields with same name Key: HUDI-7602 URL: https://issues.apache.org/jira/browse/HUDI-7602

[jira] [Updated] (HUDI-7521) Fix Critical and High vulnerabilities reported in hudi jar

2024-04-09 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7521: Description: Github Issue - [https://github.com/apache/hudi/issues/10893]   There is one more

[jira] [Created] (HUDI-7561) Skip shuffling entire data in SortMergeJoin while upserting

2024-04-01 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7561: --- Summary: Skip shuffling entire data in SortMergeJoin while upserting Key: HUDI-7561 URL: https://issues.apache.org/jira/browse/HUDI-7561 Project: Apache Hudi

[jira] [Created] (HUDI-7560) Rollback with async cleaning creating deadlocks and failing the subsequent write

2024-04-01 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7560: --- Summary: Rollback with async cleaning creating deadlocks and failing the subsequent write Key: HUDI-7560 URL: https://issues.apache.org/jira/browse/HUDI-7560 Project:

[jira] [Created] (HUDI-7558) Support INSERT_OVERWRITE mode with deltastreamer

2024-04-01 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7558: --- Summary: Support INSERT_OVERWRITE mode with deltastreamer Key: HUDI-7558 URL: https://issues.apache.org/jira/browse/HUDI-7558 Project: Apache Hudi Issue Type:

[jira] [Updated] (HUDI-7521) Fix Critical and High vulnerabilities reported in hudi jar

2024-03-20 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7521: Component/s: dependencies (was: code-quality) > Fix Critical and High

[jira] [Updated] (HUDI-7521) Fix Critical and High vulnerabilities reported in hudi jar

2024-03-20 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7521: Component/s: code-quality > Fix Critical and High vulnerabilities reported in hudi jar >

[jira] [Created] (HUDI-7521) Fix Critical and High vulnerabilities reported in hudi jar

2024-03-20 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7521: --- Summary: Fix Critical and High vulnerabilities reported in hudi jar Key: HUDI-7521 URL: https://issues.apache.org/jira/browse/HUDI-7521 Project: Apache Hudi

[jira] [Created] (HUDI-7485) Can't read the Hudi Table if using TimestampBasedKeyGenerator to write table

2024-03-06 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7485: --- Summary: Can't read the Hudi Table if using TimestampBasedKeyGenerator to write table Key: HUDI-7485 URL: https://issues.apache.org/jira/browse/HUDI-7485 Project:

[jira] [Created] (HUDI-7481) schemacommit file increases with every commit and ultimately failing with OOM

2024-03-05 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7481: --- Summary: schemacommit file increases with every commit and ultimately failing with OOM Key: HUDI-7481 URL: https://issues.apache.org/jira/browse/HUDI-7481 Project:

[jira] [Created] (HUDI-7461) Date columns showing incorrect integer values while doing CDC read

2024-03-01 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7461: --- Summary: Date columns showing incorrect integer values while doing CDC read Key: HUDI-7461 URL: https://issues.apache.org/jira/browse/HUDI-7461 Project: Apache Hudi

[jira] [Comment Edited] (HUDI-4818) Using CustomKeyGenerator fails w/ SparkHoodieTableFileIndex

2024-02-28 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821639#comment-17821639 ] Aditya Goenka edited comment on HUDI-4818 at 2/28/24 12:32 PM: --- This is

[jira] [Commented] (HUDI-4818) Using CustomKeyGenerator fails w/ SparkHoodieTableFileIndex

2024-02-28 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821639#comment-17821639 ] Aditya Goenka commented on HUDI-4818: - This is still open -  One more GitHub issue reported with

[jira] [Updated] (HUDI-7360) Incremental CDC Query after 0.14.1 upgrade giving Jackson class incompatibility exception

2024-02-28 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7360: Fix Version/s: 0.15.0 (was: 1.1.0) > Incremental CDC Query after 0.14.1

[jira] [Created] (HUDI-7442) Support Schema evolution for complex type field

2024-02-26 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7442: --- Summary: Support Schema evolution for complex type field Key: HUDI-7442 URL: https://issues.apache.org/jira/browse/HUDI-7442 Project: Apache Hudi Issue Type:

[jira] [Created] (HUDI-7403) Support Filter/Transformer to Hudi Exporter Utility

2024-02-12 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7403: --- Summary: Support Filter/Transformer to Hudi Exporter Utility Key: HUDI-7403 URL: https://issues.apache.org/jira/browse/HUDI-7403 Project: Apache Hudi Issue

[jira] [Created] (HUDI-7396) Improve Flink doc related to table services

2024-02-08 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7396: --- Summary: Improve Flink doc related to table services Key: HUDI-7396 URL: https://issues.apache.org/jira/browse/HUDI-7396 Project: Apache Hudi Issue Type:

[jira] [Commented] (HUDI-7287) Exception in streaming read while querying tables with 'cdc.enabled' is true

2024-01-31 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812652#comment-17812652 ] Aditya Goenka commented on HUDI-7287: - Need documentation update here, as only MOR supports cdc. as

[jira] [Updated] (HUDI-7360) Incremental CDC Query after 0.14.1 upgrade giving Jackson class incompatibility exception

2024-01-30 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7360: Description: Github Issue - [https://github.com/apache/hudi/issues/10590] Reproducible code  ```

[jira] [Updated] (HUDI-7360) Incremental CDC Query after 0.14.1 upgrade giving Jackson class incompatibility exception

2024-01-30 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7360: Summary: Incremental CDC Query after 0.14.1 upgrade giving Jackson class incompatibility exception

[jira] [Created] (HUDI-7360) Incremental CDC Query after 0.14.X upgrade giving Jackson class incompatibility exception

2024-01-30 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7360: --- Summary: Incremental CDC Query after 0.14.X upgrade giving Jackson class incompatibility exception Key: HUDI-7360 URL: https://issues.apache.org/jira/browse/HUDI-7360

[jira] [Created] (HUDI-7352) Add WARN log in catch block when not able to instantiate with Metrics Provider

2024-01-27 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7352: --- Summary: Add WARN log in catch block when not able to instantiate with Metrics Provider Key: HUDI-7352 URL: https://issues.apache.org/jira/browse/HUDI-7352 Project:

[jira] [Closed] (HUDI-7330) With 0.14 upgrade, MIT failing with mismatched case in field names.

2024-01-24 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-7330. --- Fix Version/s: (was: 1.1.0) Resolution: Duplicate Duplicate of already known bug -

[jira] [Commented] (HUDI-7330) With 0.14 upgrade, MIT failing with mismatched case in field names.

2024-01-24 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810480#comment-17810480 ] Aditya Goenka commented on HUDI-7330: - Github issue - [https://github.com/apache/hudi/issues/10558] >

[jira] [Created] (HUDI-7330) With 0.14 upgrade, MIT failing with mismatched case in field names.

2024-01-24 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7330: --- Summary: With 0.14 upgrade, MIT failing with mismatched case in field names. Key: HUDI-7330 URL: https://issues.apache.org/jira/browse/HUDI-7330 Project: Apache Hudi

[jira] [Created] (HUDI-7319) COLUMN_ALREADY_EXISTS exception while reading using reconcile schema and schema on read

2024-01-22 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7319: --- Summary: COLUMN_ALREADY_EXISTS exception while reading using reconcile schema and schema on read Key: HUDI-7319 URL: https://issues.apache.org/jira/browse/HUDI-7319

[jira] [Created] (HUDI-7306) CustomKeyGenerator with TIMESTAMP skipping the microseconds part

2024-01-17 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7306: --- Summary: CustomKeyGenerator with TIMESTAMP skipping the microseconds part Key: HUDI-7306 URL: https://issues.apache.org/jira/browse/HUDI-7306 Project: Apache Hudi

[jira] [Created] (HUDI-7292) NullPointerException while reading using reconcile schema and schema on read

2024-01-11 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7292: --- Summary: NullPointerException while reading using reconcile schema and schema on read Key: HUDI-7292 URL: https://issues.apache.org/jira/browse/HUDI-7292 Project:

[jira] [Created] (HUDI-7289) Fix parameters for Big Query Sync

2024-01-10 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7289: --- Summary: Fix parameters for Big Query Sync Key: HUDI-7289 URL: https://issues.apache.org/jira/browse/HUDI-7289 Project: Apache Hudi Issue Type: Improvement

[jira] [Created] (HUDI-7287) Exception in streaming read while querying tables with 'cdc.enabled' is true

2024-01-10 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7287: --- Summary: Exception in streaming read while querying tables with 'cdc.enabled' is true Key: HUDI-7287 URL: https://issues.apache.org/jira/browse/HUDI-7287 Project:

[jira] [Created] (HUDI-7273) Record Index is not working with iNSERT_OVERWRITE_TABLE

2024-01-05 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7273: --- Summary: Record Index is not working with iNSERT_OVERWRITE_TABLE Key: HUDI-7273 URL: https://issues.apache.org/jira/browse/HUDI-7273 Project: Apache Hudi

[jira] [Updated] (HUDI-6282) Config conflict with Deltastreamer CustomKeyGenerator for PartitionPath

2024-01-03 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6282: Fix Version/s: 1.1.0 > Config conflict with Deltastreamer CustomKeyGenerator for PartitionPath >

[jira] [Updated] (HUDI-6764) Failed to read S3 multi-path for hudi datasource after 0.12.0

2024-01-03 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6764: Fix Version/s: (was: 1.0.0) > Failed to read S3 multi-path for hudi datasource after 0.12.0 >

[jira] [Resolved] (HUDI-7100) Data loss when using insert_overwrite_table with insert.drop.duplicates

2023-12-19 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka resolved HUDI-7100. - > Data loss when using insert_overwrite_table with insert.drop.duplicates >

[jira] [Updated] (HUDI-7211) Relax need of ordering/precombine field for tables with autogenerated record keys for DeltaStreamer

2023-12-11 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7211: Description: [https://github.com/apache/hudi/issues/10233]   ``` NOW=$(date '+%Y%m%dt%H%M%S')

[jira] [Updated] (HUDI-7211) Relax need of ordering/precombine field for tables with autogenerated record keys for DeltaStreamer

2023-12-11 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7211: Summary: Relax need of ordering/precombine field for tables with autogenerated record keys for

[jira] [Updated] (HUDI-7211) Relax need of precombine key for tables with autogenerated record keys

2023-12-11 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-7211: Description: [https://github.com/apache/hudi/issues/10233]   Reproducible code -

[jira] [Created] (HUDI-7211) Relax need of precombine key for tables with autogenerated record keys

2023-12-11 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7211: --- Summary: Relax need of precombine key for tables with autogenerated record keys Key: HUDI-7211 URL: https://issues.apache.org/jira/browse/HUDI-7211 Project: Apache

[jira] [Updated] (HUDI-6737) ArrayIndexOutOfBoundException when using MERGE INTO with partial updates, partition path update and Global Index

2023-12-09 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6737: Summary: ArrayIndexOutOfBoundException when using MERGE INTO with partial updates, partition path

[jira] [Created] (HUDI-7117) Functional index creation not working when table is created using datasource writer

2023-11-16 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7117: --- Summary: Functional index creation not working when table is created using datasource writer Key: HUDI-7117 URL: https://issues.apache.org/jira/browse/HUDI-7117

[jira] [Created] (HUDI-7100) Data loss when using insert_overwrite_table with insert.drop.duplicates

2023-11-15 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7100: --- Summary: Data loss when using insert_overwrite_table with insert.drop.duplicates Key: HUDI-7100 URL: https://issues.apache.org/jira/browse/HUDI-7100 Project: Apache

[jira] [Created] (HUDI-7091) Add configuration to allow column list for which value can be force updated even if its null

2023-11-14 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7091: --- Summary: Add configuration to allow column list for which value can be force updated even if its null Key: HUDI-7091 URL: https://issues.apache.org/jira/browse/HUDI-7091

[jira] [Created] (HUDI-7043) Add validations for table properties for flink writers

2023-11-07 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7043: --- Summary: Add validations for table properties for flink writers Key: HUDI-7043 URL: https://issues.apache.org/jira/browse/HUDI-7043 Project: Apache Hudi

[jira] [Created] (HUDI-7040) Exception when using Bulk insert operation type along with populateMetaFields set false and dropPartitionColumns set true

2023-11-07 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7040: --- Summary: Exception when using Bulk insert operation type along with populateMetaFields set false and dropPartitionColumns set true Key: HUDI-7040 URL:

[jira] [Created] (HUDI-7035) Exception while Reading from CDC table when new partition is added.

2023-11-06 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7035: --- Summary: Exception while Reading from CDC table when new partition is added. Key: HUDI-7035 URL: https://issues.apache.org/jira/browse/HUDI-7035 Project: Apache Hudi

[jira] [Created] (HUDI-7024) Null Pointer Exception for a flink streaming pipeline for Consistent Hashing

2023-11-02 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-7024: --- Summary: Null Pointer Exception for a flink streaming pipeline for Consistent Hashing Key: HUDI-7024 URL: https://issues.apache.org/jira/browse/HUDI-7024 Project:

[jira] [Resolved] (HUDI-6932) Fix batch size for delete partition for AWSGlueCatalogSyncClient

2023-11-01 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka resolved HUDI-6932. - > Fix batch size for delete partition for AWSGlueCatalogSyncClient >

[jira] [Created] (HUDI-6981) Revisit Savepoint Design to handle OOM issues due to very large save points

2023-10-25 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6981: --- Summary: Revisit Savepoint Design to handle OOM issues due to very large save points Key: HUDI-6981 URL: https://issues.apache.org/jira/browse/HUDI-6981 Project:

[jira] [Created] (HUDI-6980) Spark job stuck after completion, due to some non daemon threads still running

2023-10-25 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6980: --- Summary: Spark job stuck after completion, due to some non daemon threads still running Key: HUDI-6980 URL: https://issues.apache.org/jira/browse/HUDI-6980 Project:

[jira] [Updated] (HUDI-6946) Data Duplicates with range pruning while using hoodie.bloom.index.use.metadata

2023-10-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6946: Fix Version/s: 0.13.2 > Data Duplicates with range pruning while using

[jira] [Updated] (HUDI-6946) Data Duplicates with range pruning while using hoodie.bloom.index.use.metadata

2023-10-16 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6946: Description: Github Issue -  [https://github.com/apache/hudi/issues/9870]   Code to Reproduce - 

[jira] [Updated] (HUDI-6946) Data Duplicates with range pruning while using hoodie.bloom.index.use.metadata

2023-10-16 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6946: Description: Github Issue -  [https://github.com/apache/hudi/issues/9870]   Code to Reproduce - 

[jira] [Created] (HUDI-6946) Data Duplicates with range pruning while using hoodie.bloom.index.use.metadata

2023-10-16 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6946: --- Summary: Data Duplicates with range pruning while using hoodie.bloom.index.use.metadata Key: HUDI-6946 URL: https://issues.apache.org/jira/browse/HUDI-6946 Project:

[jira] [Updated] (HUDI-6737) ArrayIndexOutOfBoundException when using MERGE INTO with partition path update and Global Index

2023-10-15 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6737: Description: Github Issue - [https://github.com/apache/hudi/issues/9469]

[jira] [Updated] (HUDI-6737) ArrayIndexOutOfBoundException when using MERGE INTO with partition path update and Global Index

2023-10-15 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6737: Summary: ArrayIndexOutOfBoundException when using MERGE INTO with partition path update and Global

[jira] [Updated] (HUDI-6737) ArrayIndexOutOfBoundExaception when using MERGE INTO with partition path update and Global Index

2023-10-15 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6737: Summary: ArrayIndexOutOfBoundExaception when using MERGE INTO with partition path update and Global

[jira] [Created] (HUDI-6936) Hudi is not handling ShortType columns well and throwing NPE

2023-10-10 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6936: --- Summary: Hudi is not handling ShortType columns well and throwing NPE Key: HUDI-6936 URL: https://issues.apache.org/jira/browse/HUDI-6936 Project: Apache Hudi

[jira] [Closed] (HUDI-6739) Avoid checking timeline for successful commits for spark structured streaming when offset is 0

2023-10-10 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-6739. --- Resolution: Won't Fix > Avoid checking timeline for successful commits for spark structured streaming

[jira] [Closed] (HUDI-6773) Add Test cases to show case insert into behaviour with different mergers and payload.

2023-10-10 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-6773. --- Resolution: Not A Problem > Add Test cases to show case insert into behaviour with different mergers

[jira] [Created] (HUDI-6933) bulk_insert Fails if one of the composite key contains null

2023-10-10 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6933: --- Summary: bulk_insert Fails if one of the composite key contains null Key: HUDI-6933 URL: https://issues.apache.org/jira/browse/HUDI-6933 Project: Apache Hudi

[jira] [Created] (HUDI-6932) Fix batch size for delete partition for AWSGlueCatalogSyncClient

2023-10-10 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6932: --- Summary: Fix batch size for delete partition for AWSGlueCatalogSyncClient Key: HUDI-6932 URL: https://issues.apache.org/jira/browse/HUDI-6932 Project: Apache Hudi

[jira] [Created] (HUDI-6931) Revisit Documentation in case of concurrent writes for upserts.

2023-10-10 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6931: --- Summary: Revisit Documentation in case of concurrent writes for upserts. Key: HUDI-6931 URL: https://issues.apache.org/jira/browse/HUDI-6931 Project: Apache Hudi

[jira] [Updated] (HUDI-6918) Use combineAndGetUpdateValue instead of precombine for MOR logs processing for HoodieAvroRecordMerger

2023-10-05 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6918: Priority: Critical (was: Blocker) > Use combineAndGetUpdateValue instead of precombine for MOR

[jira] [Created] (HUDI-6918) Use combineAndGetUpdateValue instead of precombine for MOR logs processing for HoodieAvroRecordMerger

2023-10-05 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6918: --- Summary: Use combineAndGetUpdateValue instead of precombine for MOR logs processing for HoodieAvroRecordMerger Key: HUDI-6918 URL: https://issues.apache.org/jira/browse/HUDI-6918

[jira] [Created] (HUDI-6774) Prefix HiveConf properties to Hoodie catalog properties map with '.hadoop'

2023-08-29 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6774: --- Summary: Prefix HiveConf properties to Hoodie catalog properties map with '.hadoop' Key: HUDI-6774 URL: https://issues.apache.org/jira/browse/HUDI-6774 Project: Apache

[jira] [Created] (HUDI-6773) Add Test cases to show case insert into behaviour with different mergers and payload.

2023-08-29 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6773: --- Summary: Add Test cases to show case insert into behaviour with different mergers and payload. Key: HUDI-6773 URL: https://issues.apache.org/jira/browse/HUDI-6773

[jira] [Updated] (HUDI-6764) Failed to read S3 multi-path for hudi datasource after 0.12.0

2023-08-28 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6764: Priority: Critical (was: Major) > Failed to read S3 multi-path for hudi datasource after 0.12.0 >

[jira] [Created] (HUDI-6764) Failed to read S3 multi-path for hudi datasource after 0.12.0

2023-08-28 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6764: --- Summary: Failed to read S3 multi-path for hudi datasource after 0.12.0 Key: HUDI-6764 URL: https://issues.apache.org/jira/browse/HUDI-6764 Project: Apache Hudi

[jira] [Created] (HUDI-6739) Avoid checking timeline for successful commits for spark structured streaming when offset is 0

2023-08-23 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6739: --- Summary: Avoid checking timeline for successful commits for spark structured streaming when offset is 0 Key: HUDI-6739 URL: https://issues.apache.org/jira/browse/HUDI-6739

[jira] [Created] (HUDI-6737) Data consistency issues with partition path update and MERGE INTO

2023-08-22 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6737: --- Summary: Data consistency issues with partition path update and MERGE INTO Key: HUDI-6737 URL: https://issues.apache.org/jira/browse/HUDI-6737 Project: Apache Hudi

[jira] [Created] (HUDI-6727) Add additional config to pass incremental predicate for JDBC delta Streamer

2023-08-18 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6727: --- Summary: Add additional config to pass incremental predicate for JDBC delta Streamer Key: HUDI-6727 URL: https://issues.apache.org/jira/browse/HUDI-6727 Project:

[jira] [Created] (HUDI-6713) Redesign CDC workload to include partition column for partition pruning

2023-08-16 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6713: --- Summary: Redesign CDC workload to include partition column for partition pruning Key: HUDI-6713 URL: https://issues.apache.org/jira/browse/HUDI-6713 Project: Apache

[jira] [Updated] (HUDI-6589) Upsert failing for array type if value given [null]

2023-07-25 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6589: Fix Version/s: (was: 0.12.1) > Upsert failing for array type if value given [null] >

[jira] [Closed] (HUDI-6589) Upsert failing for array type if value given [null]

2023-07-25 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-6589. --- Fix Version/s: 0.12.1 (was: 0.15.0) Resolution: Resolved > Upsert

[jira] [Commented] (HUDI-6589) Upsert failing for array type if value given [null]

2023-07-25 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17747076#comment-17747076 ] Aditya Goenka commented on HUDI-6589: - Upon further investigation and debugging, it has been

[jira] [Resolved] (HUDI-6589) Upsert failing for array type if value given [null]

2023-07-25 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka resolved HUDI-6589. - > Upsert failing for array type if value given [null] >

[jira] [Updated] (HUDI-6589) Upsert failing for array type if value given [null]

2023-07-25 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6589: Priority: Critical (was: Major) > Upsert failing for array type if value given [null] >

[jira] [Created] (HUDI-6589) Upsert failing for array type if value given [null]

2023-07-25 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6589: --- Summary: Upsert failing for array type if value given [null] Key: HUDI-6589 URL: https://issues.apache.org/jira/browse/HUDI-6589 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-6564) Global index with HoodieSparkRecordMerger fails for upsert with update partition path

2023-07-19 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6564: Fix Version/s: 0.15.0 (was: 0.14.0) > Global index with

[jira] [Closed] (HUDI-6533) Glue Catalog Sync not working with 0.12.3.

2023-07-19 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-6533. --- Resolution: Fixed Working fine with Master > Glue Catalog Sync not working with 0.12.3. >

[jira] [Resolved] (HUDI-6533) Glue Catalog Sync not working with 0.12.3.

2023-07-19 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka resolved HUDI-6533. - > Glue Catalog Sync not working with 0.12.3. > -- > >

[jira] [Commented] (HUDI-6533) Glue Catalog Sync not working with 0.12.3.

2023-07-19 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744568#comment-17744568 ] Aditya Goenka commented on HUDI-6533: - With Master code, it is working as expected.   We need to add

[jira] [Created] (HUDI-6564) Global index with HoodieSparkRecordMerger fails for upsert with update partition path

2023-07-19 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6564: --- Summary: Global index with HoodieSparkRecordMerger fails for upsert with update partition path Key: HUDI-6564 URL: https://issues.apache.org/jira/browse/HUDI-6564

[jira] [Created] (HUDI-6562) AWSDmsAvroPayload is failing for Delete events when CDC enabled

2023-07-19 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6562: --- Summary: AWSDmsAvroPayload is failing for Delete events when CDC enabled Key: HUDI-6562 URL: https://issues.apache.org/jira/browse/HUDI-6562 Project: Apache Hudi

[jira] [Comment Edited] (HUDI-6556) Big Query sync with master code failing for partitioned table with the Exception

2023-07-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744345#comment-17744345 ] Aditya Goenka edited comment on HUDI-6556 at 7/18/23 7:53 PM: -- While testing,

[jira] [Closed] (HUDI-6556) Big Query sync with master code failing for partitioned table with the Exception

2023-07-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-6556. --- Resolution: Not A Problem > Big Query sync with master code failing for partitioned table with the >

[jira] [Commented] (HUDI-6556) Big Query sync with master code failing for partitioned table with the Exception

2023-07-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744345#comment-17744345 ] Aditya Goenka commented on HUDI-6556: - While testing, I was using the partitionPath as slash encoded

[jira] [Created] (HUDI-6557) Deletes are not working if using custom timestamp for replica identity DEFAULT

2023-07-18 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-6557: --- Summary: Deletes are not working if using custom timestamp for replica identity DEFAULT Key: HUDI-6557 URL: https://issues.apache.org/jira/browse/HUDI-6557 Project:

[jira] [Closed] (HUDI-6411) Make SQL parameters case insensitive

2023-07-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka closed HUDI-6411. --- Resolution: Fixed > Make SQL parameters case insensitive > - > >

[jira] [Commented] (HUDI-6411) Make SQL parameters case insensitive

2023-07-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744285#comment-17744285 ] Aditya Goenka commented on HUDI-6411: - The PR is merged. Closing the JIRA. > Make SQL parameters case

[jira] [Updated] (HUDI-6411) Make SQL parameters case insensitive

2023-07-18 Thread Aditya Goenka (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aditya Goenka updated HUDI-6411: Status: Patch Available (was: In Progress) > Make SQL parameters case insensitive >

  1   2   >