[ https://issues.apache.org/jira/browse/HIVE-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929407#comment-15929407 ]
liyunzhang_intel commented on HIVE-14919: ----------------------------------------- [~lirui]: I guess you mean to set spark.executor.extraJavaOptions in conf/spark-defaults.conf like following {code} spark.executor.extraJavaOptions -Xms${the value of spark.executor.memory} {code} Is my understanding right? > Improve the performance of Hive on Spark 2.0.0 > ---------------------------------------------- > > Key: HIVE-14919 > URL: https://issues.apache.org/jira/browse/HIVE-14919 > Project: Hive > Issue Type: Improvement > Reporter: Ferdinand Xu > Assignee: Ferdinand Xu > > In HIVE-14029, we have updated Spark dependency to 2.0.0. We use Intel > BigBench[1] to run benchmark with Spark 2.0 over 1 TB data set comparing with > Spark 1.6. We can see performance improvments about 5.4% in general and 45% > for the best case. However, some queries doesn't have significant performance > improvements. This JIRA is the umbrella ticket addressing those performance > issues. > [1] https://github.com/intel-hadoop/Big-Data-Benchmark-for-Big-Bench -- This message was sent by Atlassian JIRA (v6.3.15#6346)