[
https://issues.apache.org/jira/browse/HUDI-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360060#comment-17360060
]
Vinay commented on HUDI-1892:
-----------------------------
Fixed - 11360f707e969747e1a30791acb23857cc376589
> NullPointerException when using OverwriteNonDefaultsWithLatestAvroPayload at
> hudi 0.9.0
> ---------------------------------------------------------------------------------------
>
> Key: HUDI-1892
> URL: https://issues.apache.org/jira/browse/HUDI-1892
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: shenbing
> Assignee: Vinay
> Priority: Major
> Labels: pull-request-available
>
> using compiled hudi 0.9.0 with hadoop3.0.0 and hive3.1.1 after resolving
> dependency conflicts,
> I import hudi-spark-bundle_2.11-0.9.0-SNAPSHOT.jar into my project.
> When I using OverwriteNonDefaultsWithLatestAvroPayload to update field with
> new value, I got the error.
> {code:java}
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.hudi.exception.HoodieUpsertException: Failed to combine/merge new
> record with old value in storage, for new record {HoodieRecord{key=HoodieKey
> { recordKey=1 partitionPath=date=1}, currentLocation='HoodieRecordLocation
> {instantTime=20210510160355, fileId=9a0fcb8e-8cd9-4c9c-bea8-46bbf509035e-0}',
> newLocation='HoodieRecordLocation {instantTime=20210510160400,
> fileId=9a0fcb8e-8cd9-4c9c-bea8-46bbf509035e-0}'}}, old value
> {{"_hoodie_commit_time": "20210510160355", "_hoodie_commit_seqno":
> "20210510160355_0_50", "_hoodie_record_key": "1", "_hoodie_partition_path":
> "date=1", "_hoodie_file_name":
> "9a0fcb8e-8cd9-4c9c-bea8-46bbf509035e-0_0-1502-1519_20210510160355.parquet",
> "uuid": "1", "name": "jerry", "age": 10, "date": "1", "update_time": "1"}}
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.execute(BoundedInMemoryExecutor.java:141)
> ... 34 more
> Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to
> combine/merge new record with old value in storage, for new record
> {HoodieRecord{key=HoodieKey { recordKey=1 partitionPath=date=1},
> currentLocation='HoodieRecordLocation {instantTime=20210510160355,
> fileId=9a0fcb8e-8cd9-4c9c-bea8-46bbf509035e-0}',
> newLocation='HoodieRecordLocation {instantTime=20210510160400,
> fileId=9a0fcb8e-8cd9-4c9c-bea8-46bbf509035e-0}'}}, old value
> {{"_hoodie_commit_time": "20210510160355", "_hoodie_commit_seqno":
> "20210510160355_0_50", "_hoodie_record_key": "1", "_hoodie_partition_path":
> "date=1", "_hoodie_file_name":
> "9a0fcb8e-8cd9-4c9c-bea8-46bbf509035e-0_0-1502-1519_20210510160355.parquet",
> "uuid": "1", "name": "jerry", "age": 10, "date": "1", "update_time": "1"}}
> at
> org.apache.hudi.io.HoodieMergeHandle.write(HoodieMergeHandle.java:290)
> at
> org.apache.hudi.table.action.commit.AbstractMergeHelper$UpdateHandler.consumeOneRecord(AbstractMergeHelper.java:122)
> at
> org.apache.hudi.table.action.commit.AbstractMergeHelper$UpdateHandler.consumeOneRecord(AbstractMergeHelper.java:112)
> at
> org.apache.hudi.common.util.queue.BoundedInMemoryQueueConsumer.consume(BoundedInMemoryQueueConsumer.java:37)
> at
> org.apache.hudi.common.util.queue.BoundedInMemoryExecutor.lambda$null$2(BoundedInMemoryExecutor.java:121)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.hudi.common.model.OverwriteWithLatestAvroPayload.overwriteField(OverwriteWithLatestAvroPayload.java:97)
> at
> org.apache.hudi.common.model.OverwriteNonDefaultsWithLatestAvroPayload.lambda$combineAndGetUpdateValue$0(OverwriteNonDefaultsWithLatestAvroPayload.java:67)
> at java.util.ArrayList.forEach(ArrayList.java:1259)
> at
> org.apache.hudi.common.model.OverwriteNonDefaultsWithLatestAvroPayload.combineAndGetUpdateValue(OverwriteNonDefaultsWithLatestAvroPayload.java:64)
> at
> org.apache.hudi.common.model.HoodieRecordPayload.combineAndGetUpdateValue(HoodieRecordPayload.java:81)
> at
> org.apache.hudi.io.HoodieMergeHandle.write(HoodieMergeHandle.java:276)
> ... 8 more
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
