Xuefu Zhang created HIVE-7372:
---------------------------------
Summary: Select query gives unpredictable incorrect result when
parallelism is greater than 1 [Spark Branch]
Key: HIVE-7372
URL: https://issues.apache.org/jira/browse/HIVE-7372
Project: Hive
Issue Type: Bug
Components: Spark
Reporter: Xuefu Zhang
In SparkClient.java, if the following property is set, unpredictable, incorrect
result may be observed.
{code}
sparkConf.set("spark.default.parallelism", "1");
{code}
It's suspected that there are some concurrency issues, as Spark may process
multiple datasets in a single JVM when parallelism is greater than 1 in order
to use multiple cores.
--
This message was sent by Atlassian JIRA
(v6.2#6252)