Chao Sun created HIVE-16009:
-------------------------------
Summary: HoS: refactor set reducer parallelism
Key: HIVE-16009
URL: https://issues.apache.org/jira/browse/HIVE-16009
Project: Hive
Issue Type: Improvement
Components: Spark
Reporter: Chao Sun
There are two paths for Spark set reducer parallelism, depending on the config
{{hive.spark.use.op.stats}}. We currently handle all the logic in
{{SetSparkReducerParallelism}}, and the logic is a bit complicated. Ideally we
should refactor this to make it clearer, perhaps with separate rules for the
paths.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)