[
https://issues.apache.org/jira/browse/TEZ-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17743033#comment-17743033
]
Ayush Saxena commented on TEZ-4451:
-----------------------------------
We are on 3.3.6 now in Tez, I think this should be doable now. But does this
require, like we go and play with every place where a stream is opened?
Can't this be done out of the box in Hadoop, like if debug log is enabled, we
automatically log these stats during close? Else doing this in every project
for every stream seems bit tough..
[[email protected]] any pointers here?
> ThreadLevel IO Stats Support for TEZ
> ------------------------------------
>
> Key: TEZ-4451
> URL: https://issues.apache.org/jira/browse/TEZ-4451
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Harshit Gupta
> Priority: Major
>
> Dump IO Statistics for each of the tasks in the log.
> This will requires upgrading Tez to use Hadoop-3.3.9-SNAPSHOT
>
> cc: [~rbalamohan] [~abstractdog] [~mthakur]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
