[
https://issues.apache.org/jira/browse/HADOOP-1602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Bieniosek updated HADOOP-1602:
--------------------------------------
Description: While working on HADOOP-1524, I noticed that
TaskLog.Reader.fetchAll() pulls the entire userlog into a giant byte[] and
returns the byte[]. This won't work well for large logs. TaskLog should
return an InputStream instead. (was: While working on HADOOP-1524, I noticed
that TaskLog.java pulls the entire userlog into a giant byte[] and returns the
byte[]. This won't work well for large logs. TaskLog should return an
InputStream instead.)
> TaskLog.java buffers entire task userlog in memory
> --------------------------------------------------
>
> Key: HADOOP-1602
> URL: https://issues.apache.org/jira/browse/HADOOP-1602
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.13.0
> Reporter: Michael Bieniosek
> Priority: Minor
>
> While working on HADOOP-1524, I noticed that TaskLog.Reader.fetchAll() pulls
> the entire userlog into a giant byte[] and returns the byte[]. This won't
> work well for large logs. TaskLog should return an InputStream instead.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
