Tao Wang created SPARK-13935: -------------------------------- Summary: Other clients' connection hang up when someone do huge load Key: SPARK-13935 URL: https://issues.apache.org/jira/browse/SPARK-13935 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.2, 1.5.0 Reporter: Tao Wang Priority: Critical
We run a sql like "insert overwrite table store_returns partition (sr_returned_date) select xxxxxx" using beeline then it will block other beeline connection while invoke the Hive method via "ClientWrapper.loadDynamicPartitions". The reason is that "withHiveState" will lock "clientLoader". Sadly when a new client comes, it will invoke "setConf" methods which is also sychronized with "clientLoader". So the problem is that if the first sql took very long time to run, then all other client could not connect to thrift server successfully. We tested on release 1.5.1. not sure if latest release has same issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org