[ https://issues.apache.org/jira/browse/SPARK-13234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-13234: ------------------------------ Assignee: Davies Liu > Remove duplicated SQL metrics > ----------------------------- > > Key: SPARK-13234 > URL: https://issues.apache.org/jira/browse/SPARK-13234 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Davies Liu > Assignee: Davies Liu > Fix For: 2.0.0 > > > For lots of SQL operators, we have metrics for both of input and output, the > number of input rows should be exactly the number of output rows of child, we > could only have metrics for output rows. > After we improve the performance using whole stage codegen, the overhead of > SQL metrics are not trivial anymore, we should avoid that if it's not > necessary. > Some of the operator does not have SQL metrics, we should add that for them. > For those operators that have the same number of rows from input and output > (for example, Projection, we may don't need that). -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org