abstractdog commented on PR #331: URL: https://github.com/apache/tez/pull/331#issuecomment-1914190287
> I believe yes, Should be possible, I need to propagate the results back to the DAGAppMaster from each task and put up a aggregate, propagating back might be challenging, I will create a followup and explore fortunately, it's not that hard, [task-level counters](https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/common/counters/TaskCounter.java) are collected automatically by tez framework, if you navigate on some occurrences of this interface, you'll figure out, it would awesome as a followup task > You mean to say in the Hive code here? [TaskRunnerCallable.java](https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/TaskRunnerCallable.java) yes, exactly, however, I just realized that due to the independent LLAP IO Elevator threads, these IO stats can easily become useless noise there...anyway, we can investigate in the scope of a Hive ticket there -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
