[
https://issues.apache.org/jira/browse/HIVE-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174277#comment-14174277
]
Brock Noland commented on HIVE-8486:
------------------------------------
Thanks Chao! Two questions:
1) Can we fix this the calculation described above?
2) Why are we estimating a single reducer in the normal case? The join covers
the entire store_sales table which is 2.2GB. Perhap we need to add some debug
statements to SetSparkReducerParallelism?
> TPC-DS Query 96 parallelism is not set correcly
> -----------------------------------------------
>
> Key: HIVE-8486
> URL: https://issues.apache.org/jira/browse/HIVE-8486
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Brock Noland
> Assignee: Chao
>
> When we run the query on a 20B we only have a parallelism factor of 1.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)