Steve Loughran created HADOOP-18792:
---------------------------------------
Summary: s3a prefetching to use split start/end options to limit
prefetch range
Key: HADOOP-18792
URL: https://issues.apache.org/jira/browse/HADOOP-18792
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Steve Loughran
the bundled hadoop record readers pass the split start/end down to openFile()
-these can be used by the prefetching stream as hints as to where to start and
stop prefetching.
Hints only as
* records can extend past split end; that last record will still be read when
split end < EOF
* for formats with footers which get read, caching that footer is important
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
