[
https://issues.apache.org/jira/browse/HIVE-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brock Noland updated HIVE-9036:
-------------------------------
Attachment: rsc-problem-1.tar.gz
[~vanzin],
I am testing the latest patch and it locks up here:
{noformat}
"main" prio=10 tid=0x00007f6a8c013800 nid=0x2977 in Object.wait()
[0x00007f6a92bfe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000db3ef648> (a
io.netty.util.concurrent.DefaultPromise)
at java.lang.Object.wait(Object.java:503)
at
io.netty.util.concurrent.DefaultPromise.await(DefaultPromise.java:254)
- locked <0x00000000db3ef648> (a
io.netty.util.concurrent.DefaultPromise)
at io.netty.util.concurrent.DefaultPromise.await(DefaultPromise.java:32)
at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:31)
at org.apache.hive.spark.client.JobHandleImpl.get(JobHandleImpl.java:83)
at org.apache.hive.spark.client.JobHandleImpl.get(JobHandleImpl.java:37)
at
org.apache.hadoop.hive.ql.exec.spark.status.impl.RemoteSparkJobStatus.getSparkStageInfo(RemoteSparkJobStatus.java:174)
at
org.apache.hadoop.hive.ql.exec.spark.status.impl.RemoteSparkJobStatus.getSparkStageProgress(RemoteSparkJobStatus.java:88)
at
org.apache.hadoop.hive.ql.exec.spark.status.SparkJobMonitor.startMonitor(SparkJobMonitor.java:76)
{noformat}
Debugging into attached in {{rsc-problem-1.tar.gz}}
> Replace akka for remote spark client RPC [Spark Branch]
> -------------------------------------------------------
>
> Key: HIVE-9036
> URL: https://issues.apache.org/jira/browse/HIVE-9036
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Attachments: HIVE-9036.1-spark.patch, HIVE-9036.2-spark.patch,
> HIVE-9036.3-spark.patch, rsc-problem-1.tar.gz
>
>
> We've had weird issues with akka, especially when something goes wrong and it
> becomes a little hard to debug. Let's replace it with a simple(r) RPC system
> built on top of netty.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)