hujiahua created KYLIN-5121:
-------------------------------
Summary: Make JobMetricsUtils.collectMetrics work again
Key: KYLIN-5121
URL: https://issues.apache.org/jira/browse/KYLIN-5121
Project: Kylin
Issue Type: Improvement
Reporter: hujiahua
At present, the rowCount needs to be eval after the cube built every time, and
spark `QueryExecution` metric have `numOutputRows` metric for this purpose.
But, after patch KYLIN-4662 (Migrate from third-party Spark to offical Apache
Spark), the util function `JobMetricsUtils.collectMetrics` becomes out of
working. Each rowCount needs to call `Dataset.count()`, which wastes resources
and affects the cube build time.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
