[
https://issues.apache.org/jira/browse/TEZ-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17811682#comment-17811682
]
Ayush Saxena commented on TEZ-4451:
-----------------------------------
Thanx [[email protected]] for the pointers, The
{{IOStatisticsLogging.ioStatisticsToPrettyString()}} looks better, I gave it a
try on a small query
{noformat}
2024-01-29T00:39:33,798 INFO [TezChild] task.TaskRunner2Callable:
TaskAttemptId=attempt_1706468971205_0001_1_00_000000_0,
counters=((stream_read_bytes=432)
(stream_write_bytes=411));
gauges=();
minimums=();
maximums=();
means=();
{noformat}
The original one was printing the 0 value, I think we can avoid that.
{noformat}
2024-01-29T00:46:50,015 INFO [TezChild] task.TaskRunner2Callable:
TaskAttemptId=attempt_1706469407185_0001_1_01_000000_0,
counters=((stream_write_exceptions=0) (stream_write_bytes=204));
gauges=();
minimums=();
maximums=();
means=();
{noformat}
> ThreadLevel IO Stats Support for TEZ
> ------------------------------------
>
> Key: TEZ-4451
> URL: https://issues.apache.org/jira/browse/TEZ-4451
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Harshit Gupta
> Assignee: Ayush Saxena
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Dump IO Statistics for each of the tasks in the log.
> This will requires upgrading Tez to use Hadoop-3.3.9-SNAPSHOT
>
> cc: [~rbalamohan] [~abstractdog] [~mthakur]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
