Chao Sun created HIVE-16009: ------------------------------- Summary: HoS: refactor set reducer parallelism Key: HIVE-16009 URL: https://issues.apache.org/jira/browse/HIVE-16009 Project: Hive Issue Type: Improvement Components: Spark Reporter: Chao Sun
There are two paths for Spark set reducer parallelism, depending on the config {{hive.spark.use.op.stats}}. We currently handle all the logic in {{SetSparkReducerParallelism}}, and the logic is a bit complicated. Ideally we should refactor this to make it clearer, perhaps with separate rules for the paths. -- This message was sent by Atlassian JIRA (v6.3.15#6346)