[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-17 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930841#comment-15930841 ] Chaoyu Tang commented on HIVE-16071: Two tests failed but none of them are related to

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-17 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929988#comment-15929988 ] Chaoyu Tang commented on HIVE-16071: Precommit tests were run but for some reasons the

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929424#comment-15929424 ] Rui Li commented on HIVE-16071: --- +1 > Spark remote driver misuses the timeout in RPC handsh

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903479#comment-15903479 ] Xuefu Zhang commented on HIVE-16071: [~ctang.ma], Sasl handshake happens after the con

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-09 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903422#comment-15903422 ] Chaoyu Tang commented on HIVE-16071: So we reached the consensus that hive.spark.clien

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-09 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902756#comment-15902756 ] Rui Li commented on HIVE-16071: --- Yeah that makes sense to me. > Spark remote driver misuses

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902455#comment-15902455 ] Xuefu Zhang commented on HIVE-16071: {quote} One improvement may be to call onError un

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902425#comment-15902425 ] Rui Li commented on HIVE-16071: --- Hi [~xuefuz], your understanding is inline with mine. Not s

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901334#comment-15901334 ] Xuefu Zhang commented on HIVE-16071: Hi [~lirui], thank you very much for your further

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900942#comment-15900942 ] Rui Li commented on HIVE-16071: --- I looked more into the code and it turned out to be trickie

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900728#comment-15900728 ] Rui Li commented on HIVE-16071: --- Hi [~xuefuz], let me summarise my point: here we're talking

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900703#comment-15900703 ] Xuefu Zhang commented on HIVE-16071: Hi [~lirui], thank for your input and experiment.

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900627#comment-15900627 ] Rui Li commented on HIVE-16071: --- Hi [~xuefuz], in your example, if the SASL handshake doesn'

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-07 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900607#comment-15900607 ] Chaoyu Tang commented on HIVE-16071: I agree with [~xuefuz] that we need a timeout fo

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15899483#comment-15899483 ] Xuefu Zhang commented on HIVE-16071: [~lirui], did you see above my hypothetic example

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898962#comment-15898962 ] Rui Li commented on HIVE-16071: --- Hi [~xuefuz] and [~ctang.ma], I'd prefer removing the cance

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898686#comment-15898686 ] Xuefu Zhang commented on HIVE-16071: Hi [~ctang.ma], Thanks for your findings and anal

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-03 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894672#comment-15894672 ] Chaoyu Tang commented on HIVE-16071: Yes, [~lirui]. Increasing hive.spark.client.serve

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893801#comment-15893801 ] Rui Li commented on HIVE-16071: --- Thanks [~ctang.ma] for the detailed analysis! bq. it was ca

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-02 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893684#comment-15893684 ] Chaoyu Tang commented on HIVE-16071: For the error I mentioned in this JIRA descriptio

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-01 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891686#comment-15891686 ] Rui Li commented on HIVE-16071: --- Hi [~ctang.ma], for the issue mentioned in this JIRA, I thi

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-01 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891586#comment-15891586 ] Xuefu Zhang commented on HIVE-16071: I think we still need both. server.connect.timeou

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-01 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890961#comment-15890961 ] Chaoyu Tang commented on HIVE-16071: [~xuefuz], [~lirui], and [~vanzin], thanks for th

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-03-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890770#comment-15890770 ] Marcelo Vanzin commented on HIVE-16071: --- re: the timeout used in 2 places, it's been

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-02-28 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889695#comment-15889695 ] Rui Li commented on HIVE-16071: --- My understanding is the timeout on SparkClient side is long

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-02-28 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889641#comment-15889641 ] Hive QA commented on HIVE-16071: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-02-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889478#comment-15889478 ] Xuefu Zhang commented on HIVE-16071: [~ctang.ma], thanks for looking into this. It see

[jira] [Commented] (HIVE-16071) Spark remote driver misuses the timeout in RPC handshake

2017-02-28 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889474#comment-15889474 ] Rui Li commented on HIVE-16071: --- [~ctang.ma], you might want to take a look at HIVE-15671. I