[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25527152 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -82,6 +93,102 @@ class YarnSparkHadoopUtil extends SparkHadoopUt

[GitHub] spark pull request: [SPARK-5991][MLLIB] support save/load in PySpa...

Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/4811#issuecomment-76446225 I messed up not passing sc to save/load. Is this patch going into 1.3? If not, then I'll submit a separate patch fixing the documentation (which will conflict a littl

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect __eq__ of...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4808#issuecomment-76445822 [Test build #28079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28079/consoleFull) for PR 4808 at commit [`534ac90`](https://githu

[GitHub] spark pull request: SPARK-6063

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4815#issuecomment-76445667 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25526812 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -866,23 +910,11 @@ object Client extends Logging { * Get the list of n

[GitHub] spark pull request: SPARK-6063

GitHub user msjgriffiths opened a pull request: https://github.com/apache/spark/pull/4815 SPARK-6063 Remove unicode characters from MLlib file. You can merge this pull request into a Git repository by running: $ git pull https://github.com/msjgriffiths/spark SPARK-6063 Alterna

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25526585 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -540,6 +561,29 @@ private[spark] class Client( amContainer }

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25526548 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -540,6 +561,29 @@ private[spark] class Client( amContainer }

[GitHub] spark pull request: [SPARK-6051][Streaming] Add ZooKeeper offest p...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4805#issuecomment-76444874 [Test build #28078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28078/consoleFull) for PR 4805 at commit [`526e343`](https://githu

[GitHub] spark pull request: [SPARK-5751] [SQL] Sets SPARK_HOME as SPARK_PI...

Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/4758#issuecomment-76444830 Updated, you can merge it after Jenkins nods :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5751] [SQL] Sets SPARK_HOME as SPARK_PI...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4758#issuecomment-76444880 [Test build #28077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28077/consoleFull) for PR 4758 at commit [`252fa0f`](https://githu

[GitHub] spark pull request: [SPARK-5847] Allow for namespacing metrics by ...

Github user ryan-williams commented on the pull request: https://github.com/apache/spark/pull/4632#issuecomment-76444840 This one is ready for review, I think --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect DataType....

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4809#issuecomment-7626 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5751] [SQL] Sets SPARK_HOME as SPARK_PI...

Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/4758#discussion_r25526262 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala --- @@ -315,7 +315,14 @@ abstract class

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25526105 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -256,6 +256,12 @@ private[spark] class ApplicationMaster(

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25526204 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala --- @@ -256,6 +256,12 @@ private[spark] class ApplicationMaster(

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect DataType....

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4809#issuecomment-7613 [Test build #28074 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28074/consoleFull) for PR 4809 at commit [`b576107`](https://gith

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25526051 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala --- @@ -222,6 +224,14 @@ private[spark] class ClientArguments(args: Array[

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-76443789 [Test build #28075 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28075/consoleFull) for PR 4087 at commit [`5a4a534`](https://gith

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-76443797 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25525993 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala --- @@ -82,6 +93,102 @@ class YarnSparkHadoopUtil extends SparkHadoopUtil

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25525865 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -313,6 +320,21 @@ private[spark] class Client( env("SPARK_YARN_MODE")

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect DataType....

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4810#issuecomment-76441573 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28073/consoleFull) for PR 4810 at commit [`ac9db57`](https://github.com/a

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/4688#discussion_r25525230 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -313,6 +320,21 @@ private[spark] class Client( env("SPARK_YARN_MODE")

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect DataType....

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4810#issuecomment-76441586 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5847] Allow for namespacing metrics by ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4632#issuecomment-76441577 [Test build #28076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28076/consoleFull) for PR 4632 at commit [`64a7eee`](https://githu

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect __eq__ of...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4808#issuecomment-76440495 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect __eq__ of...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4808#issuecomment-76440483 [Test build #28072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28072/consoleFull) for PR 4808 at commit [`46999dc`](https://gith

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76431601 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76431586 [Test build #28071 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28071/consoleFull) for PR 4525 at commit [`a865c11`](https://gith

[GitHub] spark pull request: [SPARK-4894][mllib] Added Bernoulli option to ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4087#issuecomment-76428527 [Test build #28075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28075/consoleFull) for PR 4087 at commit [`5a4a534`](https://githu

[GitHub] spark pull request: [SPARK-6029] Stop excluding fastutil package

Github user jkleckner commented on the pull request: https://github.com/apache/spark/pull/4780#issuecomment-76428126 >Are you packaging CA yourself, are you marking all the Spark deps as provided? I see you're already using the ```userClassPathFirst``` settings. Cases of spark

[GitHub] spark pull request: [SPARK-5979][SPARK-6032] Smaller safer fix

Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4802#issuecomment-76427925 Mind maybe copying some of the description from the other PR into this one so that the commit message is useful? --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect DataType....

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4810#issuecomment-76425916 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28073/consoleFull) for PR 4810 at commit [`ac9db57`](https://github.com/ap

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect DataType....

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4809#issuecomment-76425978 [Test build #28074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28074/consoleFull) for PR 4809 at commit [`b576107`](https://githu

[GitHub] spark pull request: [SPARK-6055] [PySpark] fix incorrect __eq__ of...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4808#issuecomment-76424926 [Test build #28072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28072/consoleFull) for PR 4808 at commit [`46999dc`](https://githu

[GitHub] spark pull request: [SQL][WIP] Visualizing query plans with graphv...

Github user pierre-borckmans commented on the pull request: https://github.com/apache/spark/pull/2354#issuecomment-76424493 Why was this deleted? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-5297][Streaming][backport] Backport SPA...

Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/4154#issuecomment-76423609 OK, I will close this PR, thanks a lot for your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-5297][Streaming][backport] Backport SPA...

Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/4154 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: [SPARK-5938][SQL] Generate Row from JSON strin...

Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/4712#issuecomment-76423117 Not until after the 1.3 release. On Feb 27, 2015 8:24 AM, "Liang-Chi Hsieh" wrote: > @marmbrus do you have time to take a look

[GitHub] spark pull request: [SPARK-5938][SQL] Generate Row from JSON strin...

Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4712#issuecomment-76422284 @marmbrus do you have time to take a look of this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5950][SQL] Enable inserting array into ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4729#issuecomment-76420655 [Test build #28070 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28070/consoleFull) for PR 4729 at commit [`2949324`](https://gith

[GitHub] spark pull request: [SPARK-5950][SQL] Enable inserting array into ...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4729#issuecomment-76420679 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76416431 [Test build #28071 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28071/consoleFull) for PR 4525 at commit [`a865c11`](https://githu

[GitHub] spark pull request: [SPARK-6052][SQL]In JSON schema inference, we ...

Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4806#issuecomment-76413623 Besides, I think that it is weird to manually set up the `containsNull` for JSON schema inference. Sampling should not be an issue because you can also argue that we may m

[GitHub] spark pull request: [SPARK-5297][Streaming][backport] Backport SPA...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4154#issuecomment-76411566 @jerryshao Given the comment from @tdas, let's close this PR and not merge this change into 1.2.x. I think that's prudent. --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-5950][SQL] Enable inserting array into ...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4729#issuecomment-76403689 [Test build #28070 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28070/consoleFull) for PR 4729 at commit [`2949324`](https://githu

[GitHub] spark pull request: [SPARK-5417] Remove redundant executor-id set(...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4213#issuecomment-76402017 Since the commit this depends on was in 1.2 (https://github.com/apache/spark/commit/1f8b7186813643afdb592131bfd89228ef971e74) and this was tagged for back-port into 1.2, a

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76398141 [Test build #28069 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28069/consoleFull) for PR 4525 at commit [`4340c2b`](https://gith

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76398152 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5434] [EC2] Preserve spaces in EC2 path

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4224#issuecomment-76396713 I backported this to 1.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76396234 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76396222 [Test build #28068 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28068/consoleFull) for PR 4777 at commit [`cb878d6`](https://gith

[GitHub] spark pull request: [SPARK-6059][Yarn] Add volatile to Application...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4814 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4813 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-5983 [WEBUI] Don't respond to HTTP TRACE...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4765#issuecomment-76393975 Going once going twice... I'd love to hear a slightly tidier way to handle this across the board, although, the code is just 3 lines duplicated in 3 clear places, so not a

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76391561 [Test build #28069 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28069/consoleFull) for PR 4525 at commit [`4340c2b`](https://githu

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76390382 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76390375 [Test build #28067 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28067/consoleFull) for PR 4813 at commit [`806c932`](https://gith

[GitHub] spark pull request: [SPARK-6059][Yarn] Add volatile to Application...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4814#issuecomment-76388516 I'm going to merge into master only just because it's not clear there is an actual practical issue as a result of this. --- If your project is set up for it, you can repl

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76387284 [Test build #28068 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28068/consoleFull) for PR 4777 at commit [`cb878d6`](https://githu

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76387038 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76386919 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76386914 [Test build #28066 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28066/consoleFull) for PR 4777 at commit [`cb878d6`](https://gith

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502824 --- Diff: python/pyspark/streaming/tests.py --- @@ -446,7 +446,7 @@ def test_queue_stream(self): def test_text_file_stream(self): d = temp

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502765 --- Diff: project/MimaExcludes.scala --- @@ -83,7 +83,16 @@ object MimaExcludes { // SPARK-2757 ProblemFilters.exclude[Incompa

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502811 --- Diff: python/pyspark/streaming/context.py --- @@ -260,6 +260,12 @@ def textFileStream(self, directory): """ return DStream(self._j

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502732 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala --- @@ -279,13 +289,14 @@ class JavaStreamingContext(val ssc

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502749 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala --- @@ -309,12 +321,13 @@ class JavaStreamingContext(val ssc

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502448 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala --- @@ -278,11 +294,14 @@ class InputStreamsSuite extends TestSuiteBase w

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502300 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -173,8 +180,48 @@ class FileInputDStream[K, V, F <: NewInp

[GitHub] spark pull request: [SPARK-5124][Core] A standard RPC interface an...

Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/4588#discussion_r25502265 --- Diff: core/src/main/scala/org/apache/spark/rpc/RpcEnv.scala --- @@ -0,0 +1,343 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/2765#discussion_r25502255 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/FileInputDStream.scala --- @@ -173,8 +180,48 @@ class FileInputDStream[K, V, F <: NewInp

[GitHub] spark pull request: [SPARK-4777][CORE] Some block memory after unr...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3629#issuecomment-76382296 [Test build #28065 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28065/consoleFull) for PR 3629 at commit [`809cc41`](https://gith

[GitHub] spark pull request: [SPARK-4777][CORE] Some block memory after unr...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3629#issuecomment-76382309 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76381460 [Test build #28067 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28067/consoleFull) for PR 4813 at commit [`806c932`](https://githu

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4777#issuecomment-76380902 [Test build #28066 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28066/consoleFull) for PR 4777 at commit [`cb878d6`](https://githu

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76380837 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76380833 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1965 [WEBUI] Spark UI throws NPE on tryi...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/4777#discussion_r25500809 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/ui/ApplicationPage.scala --- @@ -55,6 +60,9 @@ private[spark] class ApplicationPage(parent: Master

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76380352 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-6058][Yarn] Log the user class exceptio...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4813#issuecomment-76380346 **[Test build #28060 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28060/consoleFull)** for PR 4813 at commit [`806c932`](https://git

[GitHub] spark pull request: [SPARK-6059][Yarn] Add volatile to Application...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4814#issuecomment-76380101 [Test build #28063 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28063/consoleFull) for PR 4814 at commit [`17d9386`](https://gith

[GitHub] spark pull request: [SPARK-6059][Yarn] Add volatile to Application...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4814#issuecomment-76380109 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

Github user srowen commented on the pull request: https://github.com/apache/spark/pull/4055#issuecomment-76378618 @cloud-fan @rxin do you have any final thoughts on this? it's looking reasonable to me though I admit I don't know this scheduler code well enough to be confident. --- I

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76377174 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76377165 [Test build #28064 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28064/consoleFull) for PR 4525 at commit [`af92a5a`](https://gith

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2765#issuecomment-76376480 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-3586][streaming]Support nested director...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2765#issuecomment-76376474 [Test build #28062 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28062/consoleFull) for PR 2765 at commit [`6620143`](https://gith

[GitHub] spark pull request: [SPARK-6014] [Core] java.io.IOException: Files...

Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/4771#discussion_r25499357 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala --- @@ -57,12 +60,15 @@ object HiveThriftServer2

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4055#issuecomment-76375414 [Test build #28061 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28061/consoleFull) for PR 4055 at commit [`9025cf1`](https://gith

[GitHub] spark pull request: [SPARK-5259][CORE]Make sure mapStage.pendingta...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4055#issuecomment-76375421 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-6052][SQL]In JSON schema inference, we ...

Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4806#issuecomment-76375347 @yhuai is this pr also dealing with one of the problems reported in #4729? Looks like it is. If so, can we solve the problem in the original pr? Or please suggest on it, i

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76372131 [Test build #28059 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28059/consoleFull) for PR 4525 at commit [`9244bb6`](https://gith

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76372143 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-4777][CORE] Some block memory after unr...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3629#issuecomment-76370289 [Test build #28065 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28065/consoleFull) for PR 3629 at commit [`809cc41`](https://githu

[GitHub] spark pull request: [SPARK-4777][CORE] Some block memory after unr...

Github user suyanNone commented on the pull request: https://github.com/apache/spark/pull/3629#issuecomment-76369781 @andrewor14 If put it at the end of `accountingLock.synchronized`, as I described above, ``` accountingLock.synchronized { 1. ensureFreeSpace()

[GitHub] spark pull request: [SPARK-4226] [SQL] Add Exists support for wher...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4812#issuecomment-76369742 [Test build #28058 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28058/consoleFull) for PR 4812 at commit [`3d6934c`](https://gith

[GitHub] spark pull request: [SPARK-4226] [SQL] Add Exists support for wher...

Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4812#issuecomment-76369754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5522] Accelerate the Histroty Server st...

Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4525#issuecomment-76368660 [Test build #28064 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28064/consoleFull) for PR 4525 at commit [`af92a5a`](https://githu

<    1   2   3   4   5   >