[
https://issues.apache.org/jira/browse/HIVE-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278422#comment-14278422
]
Szehon Ho commented on HIVE-9352:
---------------------------------
Failures do not look related. TestMTQueries and TestStreaming fail in the next
two builds as well, see
([2366|http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2366]/
[2367|http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2367]).
The spark failure is non-reproducible and from [test
logs|http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2365/failed/TestSparkCliDriver-auto_join_reordering_values.q-auto_sortmerge_join_7.q-insert1.q-and-12-more/hive.log]
is due to the following error:
{noformat}
2015-01-14 18:47:49,859 WARN [main]: client.SparkClientImpl
(SparkClientImpl.java:<init>(90)) - Error while waiting for client to connect.
java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException:
Timed out waiting for client connection.
at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:37)
at
org.apache.hive.spark.client.SparkClientImpl.<init>(SparkClientImpl.java:88)
at
org.apache.hive.spark.client.SparkClientFactory.createClient(SparkClientFactory.java:75)
at
org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient.<init>(RemoteHiveSparkClient.java:82)
at
org.apache.hadoop.hive.ql.exec.spark.HiveSparkClientFactory.createHiveSparkClient(HiveSparkClientFactory.java:53)
at
org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionImpl.open(SparkSessionImpl.java:56)
at
org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionManagerImpl.getSession(SparkSessionManagerImpl.java:128)
at
org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.getSparkSession(SparkUtilities.java:84)
{noformat}
I believe its the same one I've discussed with [~chengxiang li] in HIVE-9094 ,
and I think it can be fixed by increasing a client-connect timeout. I'll take
a look after this.
> Merge from spark to trunk (follow-up of HIVE-9257)
> --------------------------------------------------
>
> Key: HIVE-9352
> URL: https://issues.apache.org/jira/browse/HIVE-9352
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Affects Versions: 0.15.0
> Reporter: Szehon Ho
> Assignee: Szehon Ho
> Attachments: HIVE-9352.patch, HIVE-9352.patch
>
>
> Will include following JIRA's (not-inclusive list)
> HIVE-7674 (remove spark-snapshot dependency)
> HIVE-9335 (cleanup)
> HIVE-9340 (cleanup 2, including removing spark snapshot repo)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
