[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36831096 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13021/ --- If your project i

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36831094 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13022/ --- If your project i

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36831093 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36831095 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread anitatailor
Github user anitatailor commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36830203 @pwendell Thanks, I have fixed style issues --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/86#issuecomment-36828689 Thanks for taking a look, Matei. If we use system properties instead of env variables, the remaining reason we'd want to start a second JVM is to be able to have a --driver-

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36828619 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36828600 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13019/ --- If your project i

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36828590 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1193. Fix indentation in pom.xmls

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/91#issuecomment-36828598 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1193. Fix indentation in pom.xmls

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/91#issuecomment-36828601 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13016/ --- If your project i

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36828618 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36828597 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36828596 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36828599 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13017/ --- If your project i

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36828586 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36828591 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13020/ --- If your project i

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/86#issuecomment-36828535 Also, not sure what people think about calling this "spark-submit" instead of "spark-app". For the in-cluster use case it's really just for submitting, and I imagine that ca

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/86#issuecomment-36828505 Hey Sandy, the overall approach looks good, though I made some comments throughout. It would be really nice to avoid launching a second JVM if possible. It seems that the ma

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332780 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332786 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1156: allow user to login into a cluster...

2014-03-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/58 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332762 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332726 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332714 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332708 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332688 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332670 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332654 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332644 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332582 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10332560 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread anitatailor
Github user anitatailor commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36827678 Thanks for review, fixing these --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36827609 Oy, good point. Ok, I'll try that out. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36827486 @sryza to test this I would do a `mvn install` and then try building a simple spark application in sbt or maven against your locally installed version. Then you can look a

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36827278 @sryza or maybe if we shade _both_ kryo and asm in the package jar, the shader plug-in is good enough to figure out that one is a dependency of the other and embed both as

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36827214 Hey @sryza I have a question here. If we shade like this for the `package` target of core, then as far as I understand this will embed a shaded version of `asm` inside of

[GitHub] spark pull request: SPARK-1156: allow user to login into a cluster...

2014-03-05 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/58#issuecomment-36827118 Nope, I think this is good to go. Going to merge it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36826678 @pwendell Ok this should now be ready for review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36826673 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/90#discussion_r10332154 --- Diff: graphx/pom.xml --- @@ -70,6 +70,10 @@ scalacheck_${scala.binary.version} test + --- End diff -- @

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/90#discussion_r10332129 --- Diff: graphx/pom.xml --- @@ -70,6 +70,10 @@ scalacheck_${scala.binary.version} test + --- End diff -- Yes.

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/90#discussion_r10332109 --- Diff: graphx/pom.xml --- @@ -70,6 +70,10 @@ scalacheck_${scala.binary.version} test + --- End diff -- H

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36826360 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13018/ --- If your pr

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36826359 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/90#discussion_r10332070 --- Diff: core/pom.xml --- @@ -269,6 +269,37 @@ + + org.apach

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36826295 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36826306 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36826305 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36826290 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/90#discussion_r10332066 --- Diff: core/pom.xml --- @@ -269,6 +269,37 @@ + + org.apach

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36826294 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36826287 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36826291 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/90#issuecomment-36826288 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1193. Fix indentation in pom.xmls

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/91#issuecomment-36826286 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1193. Fix indentation in pom.xmls

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/91#issuecomment-36826285 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36826226 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36826227 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13015/ --- If your project i

[GitHub] spark pull request: [SPARK-972] Added detailed callsite info for V...

2014-03-05 Thread jyotiska
Github user jyotiska commented on the pull request: https://github.com/apache/spark/pull/34#issuecomment-36825757 @mateiz @JoshRosen Can you verify this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: SPARK-1156: allow user to login into a cluster...

2014-03-05 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/58#issuecomment-36825482 any further comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: SPARK-1102: Create a saveAsNewAPIHadoopDataset...

2014-03-05 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/12#issuecomment-36825497 any further comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36825493 Pass securityManager and SparkConf around where we can. Note the changes to JettyUtils and calling functions. Switch to use SparkConf for getting and setting configs whe

[GitHub] spark pull request: SPARK-1193. Fix indentation in pom.xmls

2014-03-05 Thread sryza
GitHub user sryza opened a pull request: https://github.com/apache/spark/pull/91 SPARK-1193. Fix indentation in pom.xmls You can merge this pull request into a Git repository by running: $ git pull https://github.com/sryza/spark sandy-spark-1193 Alternatively you can review a

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/87#discussion_r10331715 --- Diff: examples/src/main/scala/org/apache/spark/examples/CassandraCQLTest.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/87#discussion_r10331703 --- Diff: examples/src/main/scala/org/apache/spark/examples/CassandraCQLTest.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331680 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36825193 Hey @anitatailor thanks for contributing this example! Would you mind cleaning up the style a bit (most likely the build will fail due to style issues). The main issue is

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/87#discussion_r10331678 --- Diff: examples/src/main/scala/org/apache/spark/examples/CassandraCQLTest.scala --- @@ -0,0 +1,124 @@ +/* + * Licensed to the Apache Software Founda

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36825120 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36824999 @tgravescs let me know when you've stopped changing things around. I can do a final pass. If there are just small things we can punt them to a subsequent PR to avoid merge

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331562 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-782. Shade ASM

2014-03-05 Thread sryza
GitHub user sryza opened a pull request: https://github.com/apache/spark/pull/90 SPARK-782. Shade ASM This solves the issue of Spark's version of ASM conflicting with the ASM versions of its transitive dependencies (e.g. Hadoop). The ASM packages, with their package names modified

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331365 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation (AS

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331320 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

[GitHub] spark pull request: Principal Component Analysis

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/88#issuecomment-36824072 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13014/ --- If your project i

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36824086 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Principal Component Analysis

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/88#issuecomment-36824070 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [WIP] SPARK-1192: The document for most of the...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/85#issuecomment-36824087 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: MetadataCleaner - fine control cleanup documen...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/89#issuecomment-36824083 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331185 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331089 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10331035 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10330871 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] spark pull request: MetadataCleaner - fine control cleanup documen...

2014-03-05 Thread puravaggarwal
GitHub user puravaggarwal opened a pull request: https://github.com/apache/spark/pull/89 MetadataCleaner - fine control cleanup documentation Documentation with reference to commit b5025d90bbf3e81701a3c3f5e22efbb2e2164eea by Mridul Date: Fri Oct 4 21:57:57 2013 +0530 - Allow

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10330832 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkApp.scala --- @@ -0,0 +1,178 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

Re: MLLib - Thoughts about refactoring Updater for LBFGS?

2014-03-05 Thread David Hall
I did not. They would be nice to have. On Wed, Mar 5, 2014 at 5:21 PM, Debasish Das wrote: > David, > > There used to be standard BFGS testcases in Professor Nocedal's > package...did you stress test the solver with them ? > > If not I will shoot him an email for them. > > Thanks. > Deb > > > >

[GitHub] spark pull request: Principal Component Analysis

2014-03-05 Thread rezazadeh
Github user rezazadeh commented on the pull request: https://github.com/apache/spark/pull/88#issuecomment-36822139 @mengxr @mateiz All comments from previous PR done, please take a look. --- If your project is set up for it, you can reply to this email and have your reply appear on Gi

[GitHub] spark pull request: SPARK-1126. spark-app preliminary

2014-03-05 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/86#discussion_r10330672 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkAppArguments.scala --- @@ -0,0 +1,155 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-1132] Persisting Web UI through refacto...

2014-03-05 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/42#issuecomment-36821926 Looks like test failed because of git problems. Retesting later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36821650 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: Principal Component Analysis

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/88#issuecomment-36821827 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: Principal Component Analysis

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/88#issuecomment-36821826 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Sparkpca

2014-03-05 Thread rezazadeh
GitHub user rezazadeh opened a pull request: https://github.com/apache/spark/pull/88 Sparkpca # Principal Component Analysis Computes the top k principal component coefficients for the m-by-n data matrix X. Rows of X correspond to observations and columns correspond to var

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36821651 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13013/ --- If your pr

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36821539 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1189: Add Security to Spark - Akka, Http...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/33#issuecomment-36821538 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/87#issuecomment-36821530 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: Fixed link for latest pyspark api guide

2014-03-05 Thread jyotiska
Github user jyotiska closed the pull request at: https://github.com/apache/spark/pull/83 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: Example for cassandra CQL read/write from spar...

2014-03-05 Thread anitatailor
GitHub user anitatailor opened a pull request: https://github.com/apache/spark/pull/87 Example for cassandra CQL read/write from spark Cassandra read/write using CqlPagingInputFormat/CqlOutputFormat You can merge this pull request into a Git repository by running: $ git pull ht

  1   2   >