Chao Sun created HIVE-16009:
-------------------------------

             Summary: HoS: refactor set reducer parallelism
                 Key: HIVE-16009
                 URL: https://issues.apache.org/jira/browse/HIVE-16009
             Project: Hive
          Issue Type: Improvement
          Components: Spark
            Reporter: Chao Sun


There are two paths for Spark set reducer parallelism, depending on the config 
{{hive.spark.use.op.stats}}. We currently handle all the logic in 
{{SetSparkReducerParallelism}}, and the logic is a bit complicated. Ideally we 
should refactor this to make it clearer, perhaps with separate rules for the 
paths.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to