[ https://issues.apache.org/jira/browse/TEZ-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated TEZ-1851: -------------------------------- Priority: Critical (was: Major) > BYTES_READ counter does not differentiate between local vs HDFS > --------------------------------------------------------------- > > Key: TEZ-1851 > URL: https://issues.apache.org/jira/browse/TEZ-1851 > Project: Apache Tez > Issue Type: Bug > Affects Versions: 0.6.0 > Reporter: Prasanth Jayachandran > Priority: Critical > > I checked hadoop counters after running a hive query on tez. The logs show > two counters for BYTES_READ but does not differentiate between them. Here is > the log line for counters > {code} > 2014-12-12 15:17:10,102 INFO [AsyncDispatcher event handler] > history.HistoryEventHandler: > [HISTORY][DAG:dag_1418425019273_0003_1][Event:DAG_FINISHED]: > dagId=dag_1418425019273_0003_1, startTime=1418426223988, > finishTime=1418426230084, timeTaken=6096, status=SUCCEEDED, diagnostics=, > counters=Counters: 49, org.apache.tez.common.counters.DAGCounter, > NUM_SUCCEEDED_TASKS=7, TOTAL_LAUNCHED_TASKS=7, DATA_LOCAL_TASKS=6, File > System Counters, BYTES_READ=250, BYTES_WRITTEN=358, READ_OPS=0, > LARGE_READ_OPS=0, WRITE_OPS=0, BYTES_READ=7918626, BYTES_WRITTEN=8, > READ_OPS=38, LARGE_READ_OPS=0, WRITE_OPS=2, > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)