David Ross created SPARK-6482:
---------------------------------

             Summary: Remove synchronization of Hive Native commands
                 Key: SPARK-6482
                 URL: https://issues.apache.org/jira/browse/SPARK-6482
             Project: Spark
          Issue Type: Improvement
            Reporter: David Ross


As discussed in https://issues.apache.org/jira/browse/SPARK-4908, concurrent 
hive native commands run into thread-safety issues with 
{{org.apache.hadoop.hive.ql.Driver}}.

The quick-fix was to synchronize calls to {{runHive}}:

https://github.com/apache/spark/commit/480bd1d2edd1de06af607b0cf3ff3c0b16089add

However, if the hive native command is long-running, this can block subsequent 
queries if they have native dependencies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to