[
https://issues.apache.org/jira/browse/HADOOP-19102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pranav Saxena updated HADOOP-19102:
-----------------------------------
Description:
The method `optimisedRead` creates a buffer array of size `readBufferSize`. If
footerReadBufferSize is greater than readBufferSize, abfs will attempt to read
more data than the buffer array can hold, which causes an exception.
Change: To avoid this, we will keep footerBufferSize =
min(readBufferSizeConfig, footerBufferSizeConfig)
was:
The method `optimisedRead` creates a buffer array of size `readBufferSize`. If
footerReadBufferSize is greater than readBufferSize, abfs will attempt to read
more data than the buffer array can hold, which causes an exception.
Change: To avoid this, we will assign readBufferSize to footerReadBufferSize
when footerReadBufferSize is larger than readBufferSize.
> [ABFS]: FooterReadBufferSize should not be greater than readBufferSize
> ----------------------------------------------------------------------
>
> Key: HADOOP-19102
> URL: https://issues.apache.org/jira/browse/HADOOP-19102
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: Pranav Saxena
> Assignee: Pranav Saxena
> Priority: Major
> Fix For: 3.4.0, 3.5.0
>
>
> The method `optimisedRead` creates a buffer array of size `readBufferSize`.
> If footerReadBufferSize is greater than readBufferSize, abfs will attempt to
> read more data than the buffer array can hold, which causes an exception.
> Change: To avoid this, we will keep footerBufferSize =
> min(readBufferSizeConfig, footerBufferSizeConfig)
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
