[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-09 Thread iven
Github user iven commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-37156504 Sorry, I was a little busy last week. I'll push new version today. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark pull request: MLI-1 Decision Trees

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37156438 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37156418 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: MLI-1 Decision Trees

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/79#issuecomment-37156437 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37156415 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37156420 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-37156426 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37156414 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: Spark 1162 Implemented takeOrdered in pyspark.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/97#issuecomment-37156427 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: SPARK-1064

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/102#issuecomment-37156375 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13086/ --- If your p

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37156377 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13087/ --- If your project

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37156376 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1064

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/102#issuecomment-37156373 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Add role and checkpoint support for Mesos back...

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/60#issuecomment-37156364 Not sure if you saw this, @iven, but Ben put some good comments above -- would be good to fix those. --- If your project is set up for it, you can reply to this email and h

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37156275 Cool, looks good then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37156227 Actually I do have one other comment, maybe we should call this getCreationSite / creationSite so as not to confuse it with the call site of a job. This is really the locat

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/106#discussion_r10420059 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -830,13 +830,10 @@ class SparkContext( setLocalProperty("externalCallSite", nul

[GitHub] spark pull request: Ability to initialize Spark-Shell with command...

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/109#issuecomment-37156133 Yeah let's add those flags to help. I didn't realize that they weren't shown. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/112#issuecomment-37156103 Interesting, good catch. I might've written some of the code to get PySpark to stop tasks early a while back. --- If your project is set up for it, you can reply to this e

[GitHub] spark pull request: maintain arbitrary state data for each key

2014-03-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/114 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-929: Fully deprecate usage of SPARK_MEM

2014-03-09 Thread ash211
Github user ash211 commented on the pull request: https://github.com/apache/spark/pull/99#issuecomment-37155320 I'm used to thinking of Spark standalone clusters as having 4 different "types" of JVMs -- 1 driver, 1 master, N workers, and M executors. Does SPARK_DAEMON_MEMORY control

[GitHub] spark pull request: Ability to initialize Spark-Shell with command...

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/109#issuecomment-37154936 What if instead we added to the help docs the `-i` and `-e` flag from the scala repl? I don't think there is any way for the user to see these now. We should make sure th

[GitHub] spark pull request: SPARK-1099:Spark's local mode should probably ...

2014-03-09 Thread ash211
Github user ash211 commented on the pull request: https://github.com/apache/spark/pull/110#issuecomment-37154887 I find that new users often wonder why Spark is only using 1 core, and it's because they expected local to use all their cores rather than defaulting to just one. Changing

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37154826 Hey @mateiz updated the docs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: maintain arbitrary state data for each key

2014-03-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/114#issuecomment-37154805 Thanks. Merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: Ability to initialize Spark-Shell with command...

2014-03-09 Thread kellrott
Github user kellrott commented on the pull request: https://github.com/apache/spark/pull/109#issuecomment-37154745 That would be enough for my usage. Wasn't aware of the '-i' flag, it doesn't show up in the '--help' and wasn't mentioned when I asked about this feature in spark-users

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37154609 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37154608 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: SPARK-1064

2014-03-09 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/102#issuecomment-37154606 Updated version works with sbt as well --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37154596 @mateiz @aarondav This update simply removes the `generator` setters and changes the naming as per Matei's suggestion. --- If your project is set up for it, you can repl

[GitHub] spark pull request: maintain arbitrary state data for each key

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/114#issuecomment-37154497 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: SPARK-1064

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/102#issuecomment-37154500 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1064

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/102#issuecomment-37154499 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/112#issuecomment-37154483 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13085/ --- If your project

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/112#issuecomment-37154481 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37154480 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37154482 One or more automated tests failed Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13084/ --- If your p

[GitHub] spark pull request: maintain arbitrary state data for each key

2014-03-09 Thread CrazyJvm
GitHub user CrazyJvm opened a pull request: https://github.com/apache/spark/pull/114 maintain arbitrary state data for each key RT You can merge this pull request into a Git repository by running: $ git pull https://github.com/CrazyJvm/spark patch-1 Alternatively you can revie

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37152830 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/112#issuecomment-37152832 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/112#issuecomment-37152831 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/113#issuecomment-37152829 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: Upgrade Jetty to 9.1.3.v20140225.

2014-03-09 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/113 Upgrade Jetty to 9.1.3.v20140225. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark jetty9 Alternatively you can review and apply these ch

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/112#issuecomment-37152085 /cc @joshrosen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: SPARK-1019: pyspark RDD take() throws an NPE

2014-03-09 Thread pwendell
GitHub user pwendell opened a pull request: https://github.com/apache/spark/pull/112 SPARK-1019: pyspark RDD take() throws an NPE You can merge this pull request into a Git repository by running: $ git pull https://github.com/pwendell/spark pyspark-take Alternatively you can

Please update the incubator status for the graduated podlings

2014-03-09 Thread Roman Shaposhnik
Hi! while compiling a board report, I have noticed that the following podlings still haven't completed the graduation steps wrt. updating the Incubator tracking and removing themselves. Please make sure to follow instructions over here: http://incubator.apache.org/guides/graduation.html#life-af

[GitHub] spark pull request: SPARK-1128: set hadoop task properties when co...

2014-03-09 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/101#issuecomment-37150695 anyone would like to review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: SPARK-1104: kill Process in workerThread of Ex...

2014-03-09 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/35#issuecomment-37150704 ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: SPARK-1102: Create a saveAsNewAPIHadoopDataset...

2014-03-09 Thread CodingCat
Github user CodingCat commented on the pull request: https://github.com/apache/spark/pull/12#issuecomment-37150712 ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/108#discussion_r10417447 --- Diff: docs/monitoring.md --- @@ -48,11 +48,22 @@ Each instance can report to zero or more _sinks_. Sinks are contained in the * `ConsoleSink`:

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/106#discussion_r10417424 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1031,8 +1026,10 @@ abstract class RDD[T: ClassTag]( private var storageLevel:

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/106#discussion_r10417318 --- Diff: core/src/main/scala/org/apache/spark/rdd/RDD.scala --- @@ -1031,8 +1026,10 @@ abstract class RDD[T: ClassTag]( private var storageLevel: S

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37147113 I'd say just remove them -- this is a pretty small feature and easy to work around if anyone used it. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: Ability to initialize Spark-Shell with command...

2014-03-09 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/109#issuecomment-37147073 You can actually already use the `-i` argument on `spark-shell` (similar to on `scala`) to load a script at the beginning. Is that enough? We don't want to diverge too much

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/108#discussion_r10417262 --- Diff: docs/monitoring.md --- @@ -48,11 +48,22 @@ Each instance can report to zero or more _sinks_. Sinks are contained in the * `ConsoleSink`: Lo

[GitHub] spark pull request: SPARK-782 Clean up for ASM dependency.

2014-03-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/100 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37137320 @aarondav the spark-ec2 scripts set up a ganglia cluster separately... they actually don't use the `GangliaSink` in Spark at present. If change spark ec2 to use that then

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37136294 Will this require the spark-ec2 scripts to pull in this dependency as well? --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: SPARK-782 Clean up for ASM dependency.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/100#issuecomment-37136247 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-782 Clean up for ASM dependency.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/100#issuecomment-37136248 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13083/ --- If your project

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37136132 As per our offline discussion let's either just remove the existing function calls (which is okay since this is a 1.0 release) or continue to support them with deprecatio

[GitHub] spark pull request: Fix markup errors introduced in #33 (SPARK-118...

2014-03-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/111 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Add timeout for fetch file

2014-03-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/98 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: SPARK-1167: Remove metrics-ganglia from defaul...

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/108#issuecomment-37135373 @mateiz if you could take a glance at this that would be great. This has to get merged into 0.9.1 so I want to make sure a few people look at it. --- If your project is

[GitHub] spark pull request: Fix markup errors introduced in #33 (SPARK-118...

2014-03-09 Thread pwendell
GitHub user pwendell opened a pull request: https://github.com/apache/spark/pull/111 Fix markup errors introduced in #33 (SPARK-1189) These were causing errors on the configuration page. You can merge this pull request into a Git repository by running: $ git pull https://github

[GitHub] spark pull request: Add timeout for fetch file

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/98#issuecomment-37134421 @guojc actually on second though I can just add a quick doc. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/106#discussion_r10414992 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDD.scala --- @@ -135,7 +135,11 @@ class JavaRDD[T](val rdd: RDD[T])(implicit val classTag: ClassT

[GitHub] spark pull request: SPARK-782 Clean up for ASM dependency.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/100#issuecomment-37134276 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: SPARK-782 Clean up for ASM dependency.

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/100#issuecomment-37134277 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/106#issuecomment-37133978 Just had a couple questions essentially related to our deprecation policy. Change looks good to me otherwise. Thanks for the cleanup! --- If your project is set up for i

[GitHub] spark pull request: SPARK-929: Fully deprecate usage of SPARK_MEM

2014-03-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/99 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/106#discussion_r10414915 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDD.scala --- @@ -135,7 +135,11 @@ class JavaRDD[T](val rdd: RDD[T])(implicit val classTag: ClassT

[GitHub] spark pull request: SPARK-1205: Clean up callSite/origin/generator...

2014-03-09 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/106#discussion_r10414905 --- Diff: core/src/main/scala/org/apache/spark/api/java/JavaRDD.scala --- @@ -135,7 +135,11 @@ class JavaRDD[T](val rdd: RDD[T])(implicit val classTag: ClassT

[GitHub] spark pull request: Add timeout for fetch file

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/98#issuecomment-37133850 @guojc I think this looks good. Do you mind adding an entry for this in `docs/configuration.md`? --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request: SPARK-782 Clean up for ASM dependency.

2014-03-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/100#issuecomment-37133631 Okay I'm going to merge this into master. Did some local testing and things seem to be working. --- If your project is set up for it, you can reply to this email and hav

[GitHub] spark pull request: SPARK-1099:Spark's local mode should probably ...

2014-03-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/110#issuecomment-37121987 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj