[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65857520 [Test build #24193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24193/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65858141 [Test build #24194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24194/consoleFull) for PR 3409 at commit

[GitHub] spark pull request: SPARK-4767: Add support for launching in a spe...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3623#issuecomment-65858470 [Test build #24190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24190/consoleFull) for PR 3623 at commit

[GitHub] spark pull request: SPARK-4767: Add support for launching in a spe...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3623#issuecomment-65858480 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Streaming doc : do you mean inadvertently?

2014-12-05 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3620#issuecomment-65859058 Merging in master branch-1.2. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: Streaming doc : do you mean inadvertently?

2014-12-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3620 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread alanctgardner
GitHub user alanctgardner opened a pull request: https://github.com/apache/spark/pull/3626 [MLLIB] SPARK-4362: Added classProbabilities method for Naive Bayes Added methods which accept an RDD or array and return a map of (label - posterior prob.) for each input set rather than

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3626#discussion_r21402613 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -65,6 +65,24 @@ class NaiveBayesModel private[mllib] (

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3626#issuecomment-65859729 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3626#discussion_r21402733 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -65,6 +65,24 @@ class NaiveBayesModel private[mllib] (

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3626#discussion_r21402810 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -65,6 +65,24 @@ class NaiveBayesModel private[mllib] (

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread alanctgardner
Github user alanctgardner commented on a diff in the pull request: https://github.com/apache/spark/pull/3626#discussion_r21402907 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -65,6 +65,24 @@ class NaiveBayesModel private[mllib] (

[GitHub] spark pull request: [MLLIB] SPARK-4362: Added classProbabilities m...

2014-12-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/3626#discussion_r21403159 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/classification/NaiveBayes.scala --- @@ -65,6 +65,24 @@ class NaiveBayesModel private[mllib] (

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65861501 [Test build #24195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24195/consoleFull) for PR 3570 at commit

[GitHub] spark pull request: [spark-4691][shuffle]Code improvement for aggr...

2014-12-05 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3553#issuecomment-65862084 I would use `[SPARK-4691][Minor] Rewrite a few lines in shuffle code`. Not a big deal if you don't change this. I'll merge this once we cut the new 1.2 release. ---

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65862705 [Test build #24191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24191/consoleFull) for PR 3622 at commit

[GitHub] spark pull request: [SPARK-4765] Make GC time always shown in UI.

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3622#issuecomment-65862711 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65862808 [Test build #24196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24196/consoleFull) for PR 3409 at commit

[GitHub] spark pull request: [spark-4691][shuffle]Code improvement for aggr...

2014-12-05 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3553#issuecomment-65862751 Should probably just merge it into master, and thus it's independent of the 1.2 release, right? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: SPARK-4770. [DOC] [YARN] spark.scheduler.minRe...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3624#issuecomment-65864826 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: SPARK-4770. [DOC] [YARN] spark.scheduler.minRe...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3624#issuecomment-65864818 [Test build #24192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24192/consoleFull) for PR 3624 at commit

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65865836 [Test build #24193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24193/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65865847 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3625#discussion_r21406023 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java --- @@ -56,12 +57,28 @@ * TransportClient, all

[GitHub] spark pull request: [SPARK-3405] add subnet-id and vpc-id options ...

2014-12-05 Thread evanv
Github user evanv commented on the pull request: https://github.com/apache/spark/pull/2872#issuecomment-65867098 Is VPC support slated for the next maintenance release? Support for VPCs is definitely needed for a lot of us, and it'd be great if we didn't have to patch it ourselves.

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-05 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/3627 [SPARK-4771][Docs] Document standalone cluster supervise mode @tdas looks like streaming already refers to the supervise mode. The link from there is broken though. You can merge this pull

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-05 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3627#discussion_r21406531 --- Diff: docs/spark-standalone.md --- @@ -257,7 +257,7 @@ To run an interactive Spark shell against the cluster, run the following command You

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3625#discussion_r21406649 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java --- @@ -97,23 +116,45 @@ public TransportClient

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-65867988 [Test build #24197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24197/consoleFull) for PR 3627 at commit

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3625#discussion_r21406760 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java --- @@ -97,23 +116,45 @@ public TransportClient

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3625#discussion_r21406852 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java --- @@ -143,43 +184,41 @@ public void

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3625#discussion_r21406868 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java --- @@ -143,43 +184,41 @@ public void

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65869095 [Test build #24198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24198/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] [WIP] Create multiple concurrent ...

2014-12-05 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65869325 Looks mostly good to me, a few remaining synchronization issues. Will take another long look after you address all comments. I'd really appreciate a test, though, if we

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65870516 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65870513 [Test build #24194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24194/consoleFull) for PR 3409 at commit

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65870763 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65870758 [Test build #24195 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24195/consoleFull) for PR 3570 at commit

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65871549 [Test build #24196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24196/consoleFull) for PR 3409 at commit

[GitHub] spark pull request: [SPARK-4461][YARN] pass extra java options to ...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3409#issuecomment-65871555 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65873447 The MiMa failure is surprising, since that class was marked as `private` and therefore shouldn't have been subject to compatibility checks. @ScrapCodes, do you know

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65874329 [Test build #24199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24199/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65874403 [Test build #24198 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24198/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65874408 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-65874932 [Test build #24197 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24197/consoleFull) for PR 3627 at commit

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-65874938 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65875429 [Test build #24200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24200/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: SPARK-3996: Shade Jetty in Spark deliverables.

2014-12-05 Thread ash211
Github user ash211 commented on the pull request: https://github.com/apache/spark/pull/3130#issuecomment-65878128 I think a core disconnect here is that the Spark team thought the majority use of Spark in applications would be through the spark-submit script. But Matt and I (and

[GitHub] spark pull request: SPARK-3996: Shade Jetty in Spark deliverables.

2014-12-05 Thread mccheah
Github user mccheah commented on the pull request: https://github.com/apache/spark/pull/3130#issuecomment-65878359 Totally makes sense. I don't think I have enough context in the Spark world as a whole to suggest a holistic build design, but I agree that this is where the disconnect

[GitHub] spark pull request: SPARK-3996: Shade Jetty in Spark deliverables.

2014-12-05 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/3130#issuecomment-65878693 I am also in the camp that wants to use Spark without `spark-submit`. My broad experience is that it's quite possible to programmatically configure `SparkContext`

[GitHub] spark pull request: [SPARK-4774] Makes HiveFromSpark more portable

2014-12-05 Thread ksakellis
GitHub user ksakellis opened a pull request: https://github.com/apache/spark/pull/3628 [SPARK-4774] Makes HiveFromSpark more portable HiveFromSpark read the kv1.txt file from SPARK_HOME/examples/src/main/resources/kv1.txt which assumed you had a source tree checked out. Now we

[GitHub] spark pull request: [SPARK-4774] Makes HiveFromSpark more portable

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65879463 [Test build #24201 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24201/consoleFull) for PR 3628 at commit

[GitHub] spark pull request: [SPARK-4774] Makes HiveFromSpark more portable

2014-12-05 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65879460 Looks ok aside from the cleanup issue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4774] Makes HiveFromSpark more portable

2014-12-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/3628#discussion_r21412176 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/hive/HiveFromSpark.scala --- @@ -24,10 +28,16 @@ import org.apache.spark.sql.hive.HiveContext

[GitHub] spark pull request: [SPARK-2309][MLlib] Generalize the binary logi...

2014-12-05 Thread avulanov
Github user avulanov commented on the pull request: https://github.com/apache/spark/pull/1379#issuecomment-65879536 @dbtsai Here are the results of my tests: - Settings: - Spark: latest Spark merged with https://github.com/dbtsai/spark/tree/dbtsai-mlor (manual merge) and

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65879741 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65879737 [Test build #24199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24199/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4774] Makes HiveFromSpark more portable

2014-12-05 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65880042 Thanks for doing this! Mind adding `[SQL]` to the PR title? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65880366 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65880355 [Test build #24200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24200/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [MLLIB] [spark-2352] Implementation of an 1-hi...

2014-12-05 Thread avulanov
Github user avulanov commented on the pull request: https://github.com/apache/spark/pull/1290#issuecomment-65880449 @jkbradley @manishamde I did performance comparisons with multinomial regression and posted them here: https://github.com/apache/spark/pull/1379#issuecomment-65879536.

[GitHub] spark pull request: [SPARK-4774] [SQL] Makes HiveFromSpark more po...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65880549 [Test build #24202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24202/consoleFull) for PR 3628 at commit

[GitHub] spark pull request: [SPARK-3623][GraphX] GraphX should support the...

2014-12-05 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/2631#issuecomment-65880798 @ankurdave I have removed the Spark core related to modify --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-05 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-65881199 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-65881246 [Test build #24203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24203/consoleFull) for PR 3564 at commit

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-65881901 [Test build #24203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24203/consoleFull) for PR 3564 at commit

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-65881904 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-05 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-65882473 Hmm, this error from the latest test is interesting: ``` [info] - Read with RegexSerDe *** FAILED *** (2 seconds, 339 milliseconds) [info] Failed to

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread guowei2
Github user guowei2 commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65882460 Sorry for that. i have a mistake about not test with shim12 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-3623][GraphX] GraphX should support the...

2014-12-05 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/2631#issuecomment-65882576 Great, thanks! LGTM - I'll merge this after Jenkins runs. ok to test --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4774] [SQL] Makes HiveFromSpark more po...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65882564 [Test build #24201 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24201/consoleFull) for PR 3628 at commit

[GitHub] spark pull request: [SPARK-4774] [SQL] Makes HiveFromSpark more po...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65882567 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65883022 [Test build #24204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24204/consoleFull) for PR 3617 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/3625#discussion_r21413717 --- Diff: network/common/src/main/java/org/apache/spark/network/client/TransportClientFactory.java --- @@ -143,43 +190,41 @@ public void

[GitHub] spark pull request: [SPARK-4774] [SQL] Makes HiveFromSpark more po...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65883209 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4774] [SQL] Makes HiveFromSpark more po...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3628#issuecomment-65883207 [Test build #24202 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24202/consoleFull) for PR 3628 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65883623 [Test build #24206 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24206/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread nkronenfeld
Github user nkronenfeld commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65883687 Should I back out the correction to the mima failure? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65883736 No, I'd leave it. I just thought I'd mention it so that we eventually investigate. I'll finish reviewing this PR later this weekend. On Fri, Dec 5, 2014

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread nkronenfeld
Github user nkronenfeld commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65883762 great... I think outside the mima issue, it should be all set, unless I can figure out a way to unit test it. So far, my best methods of testing it involve

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65883784 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-05 Thread nkronenfeld
Github user nkronenfeld commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-65883848 oh, a note for when you're reviewing - I didn't move the clear call, I just added a second one; I saw no particular harm in leaving the old one there too, just in

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65884482 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65884641 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4756][SQL] FIX: sessionToActivePool gro...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3617#issuecomment-65884637 [Test build #24204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24204/consoleFull) for PR 3617 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65885045 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65885123 [Test build #24207 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24207/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65885553 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65885551 [Test build #24206 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24206/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65886767 [Test build #24207 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24207/consoleFull) for PR 3625 at commit

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-65886768 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3623][GraphX] GraphX should support the...

2014-12-05 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/2631#issuecomment-65887724 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-3623][GraphX] GraphX should support the...

2014-12-05 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/2631#issuecomment-65888121 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3623][GraphX] GraphX should support the...

2014-12-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2631#issuecomment-65888268 [Test build #24208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24208/consoleFull) for PR 2631 at commit

<    1   2