[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/685#discussion_r13170960 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala --- @@ -180,7 +180,39 @@ object MLUtils { } /** - * :: Experim

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/685#discussion_r13170957 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala --- @@ -180,7 +180,39 @@ object MLUtils { } /** - * :: Experim

[GitHub] spark pull request: Improve maven plugin configuration

2014-05-28 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/786#issuecomment-44499013 @pwendell Do you have time to review this PR ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-1959] String "NULL" shouldn't be interp...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/909#issuecomment-44498868 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1959] String "NULL" shouldn't be interp...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/909#issuecomment-44498854 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1959] String "NULL" shouldn't be interp...

2014-05-28 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/909 [SPARK-1959] String "NULL" shouldn't be interpreted as null value JIRA issue: [SPARK-1959](https://issues.apache.org/jira/browse/SPARK-1959) You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-1901] worker should make sure executor ...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/854#issuecomment-44498506 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1901] worker should make sure executor ...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/854#issuecomment-44498508 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15281/ --- If your project

[GitHub] spark pull request: SPARK-1917: fix PySpark import of scipy.specia...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/866#issuecomment-44498510 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15282/ --- If your project

[GitHub] spark pull request: SPARK-1917: fix PySpark import of scipy.specia...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/866#issuecomment-44498507 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1912] fix compress memory issue during ...

2014-05-28 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/860#discussion_r13170390 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -329,8 +329,26 @@ private[spark] class BlockManager( * never deletes (r

[GitHub] spark pull request: [SPARK-1912] fix compress memory issue during ...

2014-05-28 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/860#discussion_r13170395 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -329,8 +329,26 @@ private[spark] class BlockManager( * never deletes (r

[GitHub] spark pull request: SPARK[1784]: Adding a balancedPartitioner

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/876#issuecomment-44497883 This functionality doesn't fit the definition of a Partitioner as used in Spark (which requires it to consistently return the same partition for each key), so it would be c

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/187 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44497685 Merged this, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: SPARK-1917: fix PySpark import of scipy.specia...

2014-05-28 Thread laserson
Github user laserson commented on the pull request: https://github.com/apache/spark/pull/866#issuecomment-44497355 Will add tests tomorrow morning... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44497341 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15279/ --- If your project

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44497340 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread colorant
Github user colorant commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44496929 And the implementation here is try to minimize the impact to current spark code base. Especially the shuffle part of code as described in the jira. which might be improve

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/877#issuecomment-44496577 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/877#issuecomment-44496578 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15283/ --- If your project is set up for it, you can r

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/877#issuecomment-44496519 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/877#issuecomment-44496500 @aarondav any other feedback on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/877#issuecomment-44496527 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/877#discussion_r13169766 --- Diff: bin/compute-classpath.sh --- @@ -51,17 +53,31 @@ if [ -f "$ASSEMBLY_DIR"/spark-assembly*hadoop*-deps.jar ]; then CLASSPATH="$CLASSPATH:$FWDI

[GitHub] spark pull request: SPARK-1843: Replace assemble-deps with env var...

2014-05-28 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/877#discussion_r13169734 --- Diff: bin/compute-classpath.sh --- @@ -51,17 +53,31 @@ if [ -f "$ASSEMBLY_DIR"/spark-assembly*hadoop*-deps.jar ]; then CLASSPATH="$CLASSPATH:$FWDI

[GitHub] spark pull request: SPARK-1639. Tidy up some Spark on YARN code

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/561#issuecomment-44496098 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15278/ --- If your project

[GitHub] spark pull request: SPARK-1639. Tidy up some Spark on YARN code

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/561#issuecomment-44496097 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread colorant
Github user colorant commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44496055 Hi, jira here: https://issues.apache.org/jira/browse/SPARK-1957 --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread colorant
Github user colorant commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44495966 Hi @witgo This is aim to aligned with the spark pluggable storage roadmap. say support different storage media across different existing / emerging hardware. ( for now,

[GitHub] spark pull request: [SPARK-1820] Make GenerateMimaIgnore @Develope...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/904#issuecomment-44495887 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1820] Make GenerateMimaIgnore @Develope...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/904#issuecomment-44495888 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15277/ --- If your project

[GitHub] spark pull request: SPARK-1917: fix PySpark import of scipy.specia...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/866#issuecomment-44495391 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1917: fix PySpark import of scipy.specia...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/866#issuecomment-44495389 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-1917: fix PySpark import of scipy.specia...

2014-05-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/866#issuecomment-44495352 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1901] worker should make sure executor ...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/854#issuecomment-44495154 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1901] worker should make sure executor ...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/854#issuecomment-44495159 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1901] worker should make sure executor ...

2014-05-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/854#issuecomment-44495082 Jenkins, test this please. LGTM pending tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: SPARK-554. Add aggregateByKey.

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/705#issuecomment-44494605 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15280/ --- If your project is set up for it, you can r

[GitHub] spark pull request: SPARK-554. Add aggregateByKey.

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/705#issuecomment-44494604 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44494532 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-554. Add aggregateByKey.

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/705#issuecomment-44494525 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-554. Add aggregateByKey.

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/705#issuecomment-44494533 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44494523 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: SPARK-554. Add aggregateByKey.

2014-05-28 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/705#discussion_r13169034 --- Diff: python/pyspark/rdd.py --- @@ -1131,7 +1131,18 @@ def _mergeCombiners(iterator): combiners[k] = mergeCombiners(combiners[k], v)

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44494404 @pwendell Thanks for the comments - done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-1639. Tidy up some Spark on YARN code

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/561#issuecomment-44494331 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1639. Tidy up some Spark on YARN code

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/561#issuecomment-44494326 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1820] Make GenerateMimaIgnore @Develope...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/904#issuecomment-44494129 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1820] Make GenerateMimaIgnore @Develope...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/904#issuecomment-44494137 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-1898: In deploy.yarn.Client, use YarnCli...

2014-05-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/850#issuecomment-44493998 Okay seems like this is in good shape. @cmccabe have you tested this at all? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-1820] Make GenerateMimaIgnore @Develope...

2014-05-28 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/904#issuecomment-44493950 Hey @pwendell, I just tried running with annotation on `Edge.scala` as you suggested above and it was correctly detected. I am not sure if I am missing something. But y

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/908#discussion_r13168847 --- Diff: graphx/src/main/scala/org/apache/spark/graphx/Graph.scala --- @@ -104,7 +104,32 @@ abstract class Graph[VD: ClassTag, ED: ClassTag] protected () ext

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44493919 Looks good, made some minor comments. We just need to remember to revert this in 1.0.0 :) --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread pwendell
Github user pwendell commented on a diff in the pull request: https://github.com/apache/spark/pull/908#discussion_r13168831 --- Diff: docs/graphx-programming-guide.md --- @@ -92,6 +92,32 @@ GraphX in Spark {{site.SPARK_VERSION}} contains one user-facing interface change

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44493781 Hey @npanj Matei and I talked with Ankur a bunch and this was a tough call but together we decided to release without it. This fix is already in the release branch so it

[GitHub] spark pull request: SPARK-1936 Removed author tags and added apach...

2014-05-28 Thread devarajk
Github user devarajk commented on the pull request: https://github.com/apache/spark/pull/890#issuecomment-44493807 Thanks for explaining this. I am closing it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: SPARK-1936 Removed author tags and added apach...

2014-05-28 Thread devarajk
Github user devarajk closed the pull request at: https://github.com/apache/spark/pull/890 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44493359 @npanj It's unfortunate that there'll be a big known problem in the 1.0.0 release. Still, I think it's tolerable for the following reasons: 1. The only GraphX li

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread npanj
Github user npanj commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44492718 It's really nice of you to update the document with workaround. Ideally we should have tried to convince Patrick et. al. the importance of this fix and why it should be in 1

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/685#issuecomment-44490169 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15276/ --- If your project

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/685#issuecomment-44490167 Build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-1901] worker should make sure executor ...

2014-05-28 Thread zhpengg
Github user zhpengg commented on the pull request: https://github.com/apache/spark/pull/854#issuecomment-4444 I have modified the error messages as you suggested, thank you @aarondav . --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44488308 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15275/ --- If your project

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44488307 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44488109 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15274/ --- If your project

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44488108 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44488023 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44488025 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15273/ --- If your project

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44487749 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44487759 @colorant This is a big changes. Can you explain this change reason? --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44487750 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15272/ --- If your project

[GitHub] spark pull request: SPARK-1416: PySpark support for SequenceFile a...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/455#issuecomment-44487284 By the way one other change: the parameter names should use `camelCase` to be consistent with our other ones. In PySpark we just chose to keep the same naming style as in S

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/685#issuecomment-44486510 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/685#issuecomment-44486505 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1752][MLLIB] Standardize text format fo...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/685#issuecomment-44486347 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44486261 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44486224 Sorry for the long delay, but this looks good. Will merge it soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44486263 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44486257 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44486254 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: Added doctest and method description in contex...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/187#issuecomment-44486191 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-1161] Add saveAsPickleFile and SparkCon...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/755#issuecomment-44484366 Hey @kanzhang, can you also add some tests for this? The easiest way is to add doctests in `context.py`. Look at how we create temp files in the tests for `SparkContext.uni

[GitHub] spark pull request: [SPARK-1161] Add saveAsPickleFile and SparkCon...

2014-05-28 Thread mateiz
Github user mateiz commented on a diff in the pull request: https://github.com/apache/spark/pull/755#discussion_r13165029 --- Diff: python/pyspark/context.py --- @@ -51,6 +51,7 @@ class SparkContext(object): _active_spark_context = None _lock = Lock() _pyt

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44484107 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44484101 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: fixes https://issues.apache.org/jira/browse/SP...

2014-05-28 Thread zeodtr
Github user zeodtr commented on a diff in the pull request: https://github.com/apache/spark/pull/899#discussion_r13164961 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -309,7 +310,7 @@ trait ClientBase extends Logging { // Add Xm

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44483876 @pwendell Since this is a post-release doc change, I wasn't sure which branch to submit against -- let me know if I should rebase to another one. --- If your project is

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread ankurdave
GitHub user ankurdave opened a pull request: https://github.com/apache/spark/pull/908 Suggest workarounds for partitionBy in Spark 1.0.0 due to SPARK-1931 The Graph.partitionBy operator allows users to choose the graph partitioning strategy, but due to SPARK-1931, this method is bro

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44483835 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: Suggest workarounds for partitionBy in Spark 1...

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/908#issuecomment-44483843 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: fixes https://issues.apache.org/jira/browse/SP...

2014-05-28 Thread zeodtr
Github user zeodtr commented on a diff in the pull request: https://github.com/apache/spark/pull/899#discussion_r13164860 --- Diff: yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala --- @@ -473,15 +474,15 @@ object ClientBase { if (localPath != nul

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44483646 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: initial version of LPA

2014-05-28 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/905#issuecomment-44483674 @haroldsultan Also haroldsultan/spark#2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44483647 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15271/ --- If your project is set up for it, you can r

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44483580 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Pluggable Diskstore for BlockManager

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/907#issuecomment-44483573 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1566] consolidate programming guide, an...

2014-05-28 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/896#issuecomment-44483569 @pwendell is it okay to merge this as is or do you want to look at it more? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-1817] RDD.zip() should verify partition...

2014-05-28 Thread kanzhang
Github user kanzhang commented on the pull request: https://github.com/apache/spark/pull/760#issuecomment-44483523 Ok. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-1817] RDD.zip() should verify partition...

2014-05-28 Thread kanzhang
Github user kanzhang closed the pull request at: https://github.com/apache/spark/pull/760 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

  1   2   3   4   >