[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91362958 Note that the YARN code is not resolving `JAVA_HOME` locally, it's adding a reference to `$JAVA_HOME` to the command that will be executed by YARN. That will be resolved o

[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91363126 [Test build #29961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29961/consoleFull) for PR 5213 at commit [`ed62ead`](https://gith

[GitHub] spark pull request: [SPARK-3074] [PySpark] support groupByKey() wi...

2015-04-09 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/1977#issuecomment-91363104 @JoshRosen Good catch! fixed it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-4897] [PySpark] Python 3 support

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5173#issuecomment-91362348 [Test build #655 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/655/consoleFull) for PR 5173 at commit [`ad7c374`](https://github

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5433#issuecomment-91361631 [Test build #29966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29966/consoleFull) for PR 5433 at commit [`d70c829`](https://githu

[GitHub] spark pull request: [SPARK-6746B] Refactor large functions in DAGS...

2015-04-09 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/5396#issuecomment-91361642 @markhamstra What do you think of the latest revision? This makes the code more modular and readable (imo) without sacrificing anything by way of code safety. --- If

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91361451 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [WIP] [SPARK-6807] [SparkR] Merge recent Spark...

2015-04-09 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/5436#issuecomment-91361548 @shivaram Should we combine these commit into a single huge commit? We will lose the history anyway, I think it's fine. --- If your project is set up for it, you can repl

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91361435 [Test build #29960 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29960/consoleFull) for PR 5270 at commit [`49600cc`](https://gith

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91361393 Is it always safe to rely on `java.home` pointing to the right directory? IIUC this is independently of whether we use Maven or SBT. Then perhaps the correct way of fi

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91360942 oh, i just had a thought: i installed a couple of different versions of java through jenkins, and right now the tests are set in the config to use 'Default', which is

[GitHub] spark pull request: SPARK-1706: Allow multiple executors per worke...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/731#issuecomment-91360706 [Test build #29965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29965/consoleFull) for PR 731 at commit [`bc82820`](https://github.

[GitHub] spark pull request: WIP: Testing to see whether this fixes the yar...

2015-04-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5441#issuecomment-91360569 Ah, good point, jenkins runs sbt not maven... :-/ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: WIP: Testing to see whether this fixes the yar...

2015-04-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/5441#issuecomment-91360482 For SBT, I think we should be able to make a corresponding change in `TestSettings`: https://github.com/apache/spark/blob/470d7453a56c56a41b2851551fe1830065f88b2c/proje

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91360301 cool. on our systems, at least, the system java we use is /usr/bin/java, which points (through /etc/alternatives), to /usr/java/latest (which itself is a link to /usr

[GitHub] spark pull request: WIP: Testing to see whether this fixes the yar...

2015-04-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/5441#issuecomment-91359955 LGTM if this works... which I think it will. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91359524 I think `JAVA_HOME` is something that YARN exposes to all containers, so even if you don't set it for your application, that code should still work. I think we problem her

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5208#issuecomment-91359531 @yhuai, thanks for the comments, for your last comment, I am wondering if we can add `Seq[SortOder]` as the parameter for `Partitioning` and `Distribution`? instea

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/5433#issuecomment-91358635 Note that this is only used for BroadcastHashJoins, and this is the broadcasted table. It is thus expected to be relatively small (< 10 MB). For Spark users with default

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91358660 btw i prefer #2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/5208#discussion_r28103653 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -178,6 +179,7 @@ class StatisticsSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91358326 so i just grepped through the code and found stuff like this: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala: YarnSparkHadoopUtil.expandE

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/5433#discussion_r28103100 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala --- @@ -55,6 +82,14 @@ private[joins] final class UniqueK

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5433#issuecomment-91356373 I must be lost in some context, why do we need to serde `HashReleation`? It supposed to be loaded once from the partition data iterator? isn't? --- If your projec

[GitHub] spark pull request: [SPARK-6661] Python type errors should print t...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5361#issuecomment-91356062 [Test build #654 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/654/consoleFull) for PR 5361 at commit [`650ad45`](https://github

[GitHub] spark pull request: WIP: Testing to see whether this fixes the yar...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5441#issuecomment-91355673 [Test build #29964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29964/consoleFull) for PR 5441 at commit [`6bda399`](https://githu

[GitHub] spark pull request: [SPARK-5342][YARN] Allow long running Spark ap...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4688#issuecomment-91354778 [Test build #29963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29963/consoleFull) for PR 4688 at commit [`7f1bc58`](https://githu

[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5424#issuecomment-91354777 [Test build #29962 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29962/consoleFull) for PR 5424 at commit [`2098081`](https://githu

[GitHub] spark pull request: WIP: Testing to see whether this fixes the yar...

2015-04-09 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/5441 WIP: Testing to see whether this fixes the yarn test issue. You can merge this pull request into a Git repository by running: $ git pull https://github.com/vanzin/spark yarn-test-test Alternat

[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...

2015-04-09 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5424#issuecomment-91353888 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/5433#issuecomment-91353665 LGTM cc @marmbrus --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/5433#discussion_r28101521 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala --- @@ -29,16 +31,39 @@ import org.apache.spark.util.collection.

[GitHub] spark pull request: [SQL] [SPARK-6794] Use kryo-based SparkSqlSeri...

2015-04-09 Thread aarondav
Github user aarondav commented on a diff in the pull request: https://github.com/apache/spark/pull/5433#discussion_r28101404 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/HashedRelation.scala --- @@ -46,8 +71,10 @@ private[joins] final class GeneralHashed

[GitHub] spark pull request: French translation

2015-04-09 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5440#issuecomment-91349266 Yes, something is wrong with this branch. You also generally need a JIRA for a significant change. I am not sure a translation is worth it, since it would require maint

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91348818 [Test build #29960 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29960/consoleFull) for PR 5270 at commit [`49600cc`](https://githu

[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91348808 [Test build #29961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29961/consoleFull) for PR 5213 at commit [`ed62ead`](https://githu

[GitHub] spark pull request: [SPARK-6211][Streaming] Add Python Kafka API u...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4961#issuecomment-91348270 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-6211][Streaming] Add Python Kafka API u...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4961#issuecomment-91348250 [Test build #29959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29959/consoleFull) for PR 4961 at commit [`1cda32a`](https://gith

[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...

2015-04-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91347701 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91347621 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-3074] [PySpark] support groupByKey() wi...

2015-04-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/1977#issuecomment-91347431 I spent a bit of time fuzz-testing this code to try to reach 100% coverage of the changes in this patch. While doing so, I think I uncovered a bug: ``` ../

[GitHub] spark pull request: French translation

2015-04-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/5440#issuecomment-91346051 @kevinlacire this seems to pull in commits from branch 1.3 into master. It seems that the actual changes would have been much smaller. --- If your project is set up f

[GitHub] spark pull request: [SPARK-4925] Publish Spark SQL hive-thriftserv...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5429#issuecomment-91343246 [Test build #29957 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29957/consoleFull) for PR 5429 at commit [`9cc36af`](https://gith

[GitHub] spark pull request: [SPARK-4925] Publish Spark SQL hive-thriftserv...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5429#issuecomment-91343259 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91342936 Funny. All YARN tests (not just in this PR) are failing with this: /bin/bash: /bin/java: No such file or directory Wonder what changed in the environme

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91342743 [Test build #29956 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29956/consoleFull) for PR 4622 at commit [`d70b70a`](https://gith

[GitHub] spark pull request: [SPARK-6734] [SQL] Add UDTF.close support in G...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5383#issuecomment-91342733 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-6734] [SQL] Add UDTF.close support in G...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5383#issuecomment-91342725 [Test build #29954 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29954/consoleFull) for PR 5383 at commit [`c45faf0`](https://gith

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91342764 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5298#issuecomment-91341968 [Test build #29958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29958/consoleFull) for PR 5298 at commit [`89efac5`](https://gith

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5298#issuecomment-91341975 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/5208#issuecomment-91339237 Actually, instead of introducing new `Distribution` and `Partitioning`, how about we add the following two concepts to a `SparkPlan`. * `requiredPartitionOrdering:

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread adrian-wang
Github user adrian-wang commented on the pull request: https://github.com/apache/spark/pull/5208#issuecomment-91338697 @yhuai Thanks for the review! Actually I have passed jenkins when I use default value for autoSortMergeJoin as True and then set it to false here. And I agree tha

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/5208#discussion_r28095095 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.scala --- @@ -144,6 +144,7 @@ class StatisticsSuite extends QueryTest with Be

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91337063 [Test build #29955 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29955/consoleFull) for PR 4622 at commit [`6ad4905`](https://gith

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91337081 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-6211][Streaming] Add Python Kafka API u...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4961#issuecomment-91334197 [Test build #29959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29959/consoleFull) for PR 4961 at commit [`1cda32a`](https://githu

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91333456 [Test build #29953 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29953/consoleFull) for PR 5270 at commit [`49600cc`](https://gith

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91333478 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-6211][Streaming] Add Python Kafka API u...

2015-04-09 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/4961#issuecomment-91333216 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5298#issuecomment-91331485 [Test build #29958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29958/consoleFull) for PR 5298 at commit [`89efac5`](https://githu

[GitHub] spark pull request: [SPARK-6620] Speed up toDF() and rdd() functio...

2015-04-09 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5279#issuecomment-91331541 @vlyubin Would you mind to add `[SQL]` to the PR title? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark pull request: French translation

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5440#issuecomment-91331113 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [WIP][SQL][SPARK-6632]: Read schema from each ...

2015-04-09 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/5298#issuecomment-91330554 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: French translation

2015-04-09 Thread kevinlacire
GitHub user kevinlacire opened a pull request: https://github.com/apache/spark/pull/5440 French translation Hi everybody, Does anyone would be interested in a French translation of the entire Spark's documentation (v1.3.0) ? You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-4925] Publish Spark SQL hive-thriftserv...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5429#issuecomment-91328997 [Test build #29957 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29957/consoleFull) for PR 5429 at commit [`9cc36af`](https://githu

[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91328549 [Test build #29952 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29952/consoleFull) for PR 5213 at commit [`ed62ead`](https://gith

[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91328594 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-4925] Publish Spark SQL hive-thriftserv...

2015-04-09 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/5429#issuecomment-91327877 Jenkins, retest this please. LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/5208#discussion_r28090938 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoin.scala --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apach

[GitHub] spark pull request: [SPARK-6661] Python type errors should print t...

2015-04-09 Thread 31z4
Github user 31z4 commented on the pull request: https://github.com/apache/spark/pull/5361#issuecomment-91325645 @davies seems like the failures are in Scala tests. Can anyone look into that? I also had failures in Scala tests on my machine. All Python tests passed without errors thoug

[GitHub] spark pull request: [SPARK-6577] [MLlib] [PySpark] SparseMatrix sh...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5355#issuecomment-91324831 [Test build #29951 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29951/consoleFull) for PR 5355 at commit [`ea2c54b`](https://gith

[GitHub] spark pull request: [SPARK-6577] [MLlib] [PySpark] SparseMatrix sh...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5355#issuecomment-91324845 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/5208#issuecomment-91324619 @adrian-wang This is a really helpful improvement! Besides my comments in the code, I have two general comments. First, for this PR, it is fine to add unnecessary `Exchange

[GitHub] spark pull request: [SPARK-6479][Block Manager]Create off-heap blo...

2015-04-09 Thread zhzhan
Github user zhzhan commented on a diff in the pull request: https://github.com/apache/spark/pull/5430#discussion_r28090361 --- Diff: core/src/main/scala/org/apache/spark/storage/OffHeapBlockManager.scala --- @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [SPARK-6661] Python type errors should print t...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5361#issuecomment-91322920 [Test build #653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/653/consoleFull) for PR 5361 at commit [`650ad45`](https://githu

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/5208#discussion_r28089849 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoin.scala --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91322337 [Test build #29956 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29956/consoleFull) for PR 4622 at commit [`d70b70a`](https://githu

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/5208#discussion_r28089723 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoin.scala --- @@ -0,0 +1,161 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...

2015-04-09 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/5424#issuecomment-91322259 whoops, i missed retriggering this build. :) jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91321346 [Test build #29955 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29955/consoleFull) for PR 4622 at commit [`6ad4905`](https://githu

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91319694 @mengxr The model is now distributed. Edge messages and vertex data are defined as private case classes too. I will try to add Java examples later. --- If your project is

[GitHub] spark pull request: [SPARK-6577] [MLlib] [PySpark] SparseMatrix sh...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5355#issuecomment-91317847 [Test build #29947 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29947/consoleFull) for PR 5355 at commit [`454ef2c`](https://gith

[GitHub] spark pull request: [SPARK-6577] [MLlib] [PySpark] SparseMatrix sh...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5355#issuecomment-91317871 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91317729 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-4705] Handle multiple app attempts even...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5432#issuecomment-91317719 [Test build #29949 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29949/consoleFull) for PR 5432 at commit [`9092af5`](https://gith

[GitHub] spark pull request: [SPARK-6577] [MLlib] [PySpark] SparseMatrix sh...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5355#issuecomment-91317651 [Test build #29948 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29948/consoleFull) for PR 5355 at commit [`61a864a`](https://gith

[GitHub] spark pull request: [SPARK-6577] [MLlib] [PySpark] SparseMatrix sh...

2015-04-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5355#issuecomment-91317669 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-6734] [SQL] Add UDTF.close support in G...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5383#issuecomment-91317211 [Test build #29954 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29954/consoleFull) for PR 5383 at commit [`c45faf0`](https://githu

[GitHub] spark pull request: [SPARK-6440][CORE]Handle IPv6 addresses proper...

2015-04-09 Thread nyaapa
Github user nyaapa commented on the pull request: https://github.com/apache/spark/pull/5424#issuecomment-91317074 Seems like jenkins was killed again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-6734] [SQL] Add UDTF.close support in G...

2015-04-09 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/5383#issuecomment-91316943 @maropu thanks for the comments, I've updated the code. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as w

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-09 Thread harishreedharan
Github user harishreedharan commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28086500 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala --- @@ -114,11 +123,15 @@ class StreamingContext private[streamin

[GitHub] spark pull request: [SPARK-5990] [MLLIB] Model import/export for I...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5270#issuecomment-91312627 [Test build #29953 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29953/consoleFull) for PR 5270 at commit [`49600cc`](https://githu

[GitHub] spark pull request: [SPARK-6264] [MLLIB] Support FPGrowth algorith...

2015-04-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5213#issuecomment-91311173 [Test build #29952 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29952/consoleFull) for PR 5213 at commit [`ed62ead`](https://githu

[GitHub] spark pull request: [WIP] [SPARK-6807] [SparkR] Merge recent Spark...

2015-04-09 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/5436#issuecomment-91310929 @davies could you reopen this PR or try to create it from a fresh branch ? Even though the diff looks fine, this has 250 commits or so and will mess up the commit messag

[GitHub] spark pull request: [SPARK-6752][Streaming] Allow StreamingContext...

2015-04-09 Thread harishreedharan
Github user harishreedharan commented on a diff in the pull request: https://github.com/apache/spark/pull/5428#discussion_r28085485 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala --- @@ -77,7 +77,8 @@ object Checkpoint extends Logging { }

[GitHub] spark pull request: [SPARK-6766][Streaming] Fix issue about Stream...

2015-04-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5414#discussion_r28084843 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/ui/StreamingJobProgressListenerSuite.scala --- @@ -0,0 +1,140 @@ +/* + * Licensed to the A

[GitHub] spark pull request: [SPARK-6766][Streaming] Fix issue about Stream...

2015-04-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5414#discussion_r28084652 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala --- @@ -88,6 +88,58 @@ class StreamingListenerSuite extends TestSuite

[GitHub] spark pull request: [SPARK-2213] [SQL] sort merge join for spark s...

2015-04-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/5208#discussion_r28084180 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/physical/partitioning.scala --- @@ -163,6 +178,40 @@ case class HashPartitioning(expr

[GitHub] spark pull request: [SPARK-5832][Mllib] Add Affinity Propagation c...

2015-04-09 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/4622#issuecomment-91304199 Thanks @vanzin, I think it might be a problem. I decided to move to custom method for median computation. --- If your project is set up for it, you can reply to this emai

  1   2   3   4   >