[
https://issues.apache.org/jira/browse/HUDI-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lietong Liu updated HUDI-1583:
------------------------------
Description:
When `spark.speculation` is enabled, there may be logFile with zero size.
`HoodieLogFormatReader.hasNext()` will return false when encounter logFile
with zero size，which will skip remaining log files。
!image-2021-02-19-19-07-49-264.png!
> Hudi will skip remaining log files if there is logFile with zero size in
> logFileList when merge on read.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HUDI-1583
> URL: https://issues.apache.org/jira/browse/HUDI-1583
> Project: Apache Hudi
> Issue Type: Bug
> Components: Common Core
> Affects Versions: 0.6.0
> Reporter: Lietong Liu
> Priority: Major
> Fix For: 0.6.0
>
> Attachments: image-2021-02-19-19-07-49-264.png
>
>
> When `spark.speculation` is enabled, there may be logFile with zero size.
> `HoodieLogFormatReader.hasNext()` will return false when encounter logFile
> with zero size，which will skip remaining log files。
>
> !image-2021-02-19-19-07-49-264.png!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
