ayushtkn commented on PR #331: URL: https://github.com/apache/tez/pull/331#issuecomment-1913736704
Thanx @abstractdog for the review!!! > can you please attach an example here and/or Jira of what a snippet of statistics looks like? I have attached the snippet here, ran a small query to check if it is working, I chaged from previous to use IOStatisticsLogging, https://issues.apache.org/jira/browse/TEZ-4451?focusedCommentId=17811682&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17811682 > does this stat object contain info that can be cumulated for a whole DAG? I feel useful DAG-level counters here, maybe in a follow-up ticket I believe yes, Should be possible, I need to propagate the results back to the DAGAppMaster from each task and put up a aggregate, propagating back might be challenging, I will create a followup and explore > if this applies to tez container mode's task runner, let's consider adding the same to LLAP's task runner as well (or where it's applicable) You mean to say in the Hive code here? [TaskRunnerCallable.java](https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/daemon/impl/TaskRunnerCallable.java) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
