[
https://issues.apache.org/jira/browse/HBASE-25148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leonid Vasilev updated HBASE-25148:
-----------------------------------
Description:
I setup a MapReduce job that scans HBase table with scan metrics enabled via
Java API:
{code:java}
Scan scan = ...;
scan.setScanMetricsEnabled(true);
// Or via attribute
scan.setAttribute(
Scan.SCAN_ATTRIBUTES_METRICS_ENABLE,
Bytes.toBytes(true));
TableMapReduceUtil.initTableMapperJob(...);
job.waitForCompletion(true)
{code}
I expect HBase scan related counters to appear with current values in Hadoop
web UI after job starts or in CLI after job ends alongside other counters such
as CPU_MILLISECONDS. But no metrics were displayed. I can clearly see that scan
is performed and mappers got non-zero inputs.
The JAR version is 1.2.0-cdh5.16.1.
was:
Hello, I setup a MapReduce job that scans HBase table and enabled scan metrics
via Java API:
{code:java}
Scan scan = ...;
scan.setScanMetricsEnabled(true);
// Or via attribute
scan.setAttribute(
Scan.SCAN_ATTRIBUTES_METRICS_ENABLE,
Bytes.toBytes(true));
TableMapReduceUtil.initTableMapperJob(...);
job.waitForCompletion(true)
{code}
I expect HBase scan related counters to appear with current values in Hadoop
web UI after job starts or in CLI after job ends alongside other counters such
as CPU_MILLISECONDS. But no metrics were displayed. I can clearly see that scan
is performed and mappers got non-zero inputs.
> Scan metrics are not reported to Hadoop MapReduce counters
> ----------------------------------------------------------
>
> Key: HBASE-25148
> URL: https://issues.apache.org/jira/browse/HBASE-25148
> Project: HBase
> Issue Type: Bug
> Components: Client, mapreduce, scan
> Affects Versions: 1.2.0
> Reporter: Leonid Vasilev
> Priority: Major
>
> I setup a MapReduce job that scans HBase table with scan metrics enabled via
> Java API:
> {code:java}
> Scan scan = ...;
> scan.setScanMetricsEnabled(true);
> // Or via attribute
> scan.setAttribute(
> Scan.SCAN_ATTRIBUTES_METRICS_ENABLE,
> Bytes.toBytes(true));
> TableMapReduceUtil.initTableMapperJob(...);
>
> job.waitForCompletion(true)
> {code}
> I expect HBase scan related counters to appear with current values in Hadoop
> web UI after job starts or in CLI after job ends alongside other counters
> such as CPU_MILLISECONDS. But no metrics were displayed. I can clearly see
> that scan is performed and mappers got non-zero inputs.
> The JAR version is 1.2.0-cdh5.16.1.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
