[GitHub] spark pull request: Update README to include DataFrames and zinc.

2015-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6548 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107323104 [Test build #33875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33875/consoleFull) for PR 6351 at commit [`f8b9314`](https://git

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107323110 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6537#issuecomment-107322383 [Test build #33874 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33874/consoleFull) for PR 6537 at commit [`f83d282`](https://git

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6537#issuecomment-107322393 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SQL] [TEST] [MINOR] Follow-up of PR #6493, us...

2015-05-31 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/6547#discussion_r31402480 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2Suites.scala --- @@ -29,6 +27,8 @@ import scala.concur

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107320528 [Test build #33881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33881/consoleFull) for PR 6430 at commit [`8211be0`](https://gith

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107320335 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107320286 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7966][GraphX] Implementation of Spreadi...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6549#issuecomment-107319654 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-7966][GraphX] Implementation of Spreadi...

2015-05-31 Thread tarekauel
GitHub user tarekauel opened a pull request: https://github.com/apache/spark/pull/6549 [SPARK-7966][GraphX] Implementation of Spreading Activation algorithm I implemented the Spreading Activation algorithm and would love to get your feedback You can merge this pull request into a G

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/6430#discussion_r31402047 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -261,14 +270,19 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/6430#discussion_r31402037 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -261,14 +270,19 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: Update README to include DataFrames and zinc.

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6548#issuecomment-107318873 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: Update README to include DataFrames and zinc.

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6548#issuecomment-107318918 [Test build #33880 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33880/consoleFull) for PR 6548 at commit [`630efc3`](https://gith

[GitHub] spark pull request: Update README to include DataFrames and zinc.

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6548#issuecomment-107318861 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107318741 Hi all, I just updated the code according to your comments, please help to review, thanks a lot. There's two opening questions I didn't address yet: 1. Do we n

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401873 --- Diff: core/src/test/scala/org/apache/spark/serializer/KryoSerializerSuite.scala --- @@ -328,6 +334,52 @@ class KryoSerializerSuite extends SparkFunSuite

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401829 --- Diff: core/src/main/scala/org/apache/spark/util/SerializableBuffer.scala --- @@ -21,12 +21,16 @@ import java.io.{EOFException, IOException, ObjectInput

[GitHub] spark pull request: Update README to include DataFrames and zinc.

2015-05-31 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/6548 Update README to include DataFrames and zinc. Also cut trailing whitespaces. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark readme Alte

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401833 --- Diff: core/src/test/scala/org/apache/spark/serializer/KryoClosureSerializerSuite.scala --- @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401808 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -126,6 +129,21 @@ private[spark] abstract class Task[T](val stageId: Int, var par

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107317880 [Test build #33879 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33879/consoleFull) for PR 6361 at commit [`08c05d1`](https://gith

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107317876 [Test build #33878 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33878/consoleFull) for PR 6430 at commit [`f03c250`](https://gith

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread coolfrood
Github user coolfrood commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401728 --- Diff: core/src/test/scala/org/apache/spark/serializer/KryoClosureSerializerSuite.scala --- @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107317726 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107317717 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6430#issuecomment-107317727 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107317718 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401724 --- Diff: core/src/main/scala/org/apache/spark/scheduler/Task.scala --- @@ -126,6 +129,21 @@ private[spark] abstract class Task[T](val stageId: Int, var par

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6361#discussion_r31401661 --- Diff: core/src/test/scala/org/apache/spark/serializer/KryoClosureSerializerSuite.scala --- @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107315605 [Test build #33877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33877/consoleFull) for PR 6361 at commit [`fbb31a5`](https://git

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107315613 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread coolfrood
Github user coolfrood commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107315504 @JoshRosen I have rebased and updated the PR based on your suggestions and the discussion on SPARK-7708. I switched to Kryo version 2.24.0 by excluding it from `chill`

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107315439 [Test build #33877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33877/consoleFull) for PR 6361 at commit [`fbb31a5`](https://gith

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107315287 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7708] [Core] [WIP] Fixes for Kryo closu...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6361#issuecomment-107315344 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5610] [DOC] update genjavadocSettings t...

2015-05-31 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6506#issuecomment-107312174 Thanks for checking the API docs. I created SPARK-7992 to track this issue. --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: [SQL] [TEST] [MINOR] Follow-up of PR #6493, us...

2015-05-31 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6547#issuecomment-107308592 lgtm merging once tests pass --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SQL] [TEST] [MINOR] Follow-up of PR #6493, us...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6547#issuecomment-107307928 [Test build #33876 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33876/consoleFull) for PR 6547 at commit [`72da795`](https://gith

[GitHub] spark pull request: [SQL] [TEST] [MINOR] Follow-up of PR #6493, us...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6547#issuecomment-107307711 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] [TEST] [MINOR] Follow-up of PR #6493, us...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6547#issuecomment-107307702 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL] [TEST] [MINOR] Follow-up of PR #6493, us...

2015-05-31 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/6547 [SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure Java 6 friendliness This is a follow-up of PR #6493, which has been reverted in branch-1.4 because it uses Java 7 specific APIs

[GitHub] spark pull request: [HOT FIX] [BUILD] Fix maven build failures

2015-05-31 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/6511#issuecomment-107305583 Yes, these were pushed as hot fixes later. Unfortunately maven has stricter requirements than SBT for some reason. --- If your project is set up for it, you can repl

[GitHub] spark pull request: [SPARK-7989][Core][Tests] Fix flaky tests in E...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6546#issuecomment-107305335 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7989][Core][Tests] Fix flaky tests in E...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6546#issuecomment-107305325 [Test build #33872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33872/consoleFull) for PR 6546 at commit [`3b69840`](https://git

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107303509 [Test build #33875 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33875/consoleFull) for PR 6351 at commit [`f8b9314`](https://gith

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107303387 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107303396 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107302558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107302556 **[Test build #33871 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33871/consoleFull)** for PR 6409 at commit [`b76a102`](https://gi

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107301638 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6537#issuecomment-107301231 [Test build #33874 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33874/consoleFull) for PR 6537 at commit [`f83d282`](https://gith

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6505#discussion_r31399925 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -482,30 +482,66 @@ trait HiveTypeCoercion { }

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6505#discussion_r31399932 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -482,30 +482,66 @@ trait HiveTypeCoercion { }

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6537#issuecomment-107301171 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6537#issuecomment-107301185 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6505#discussion_r31399878 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -482,30 +482,66 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [HOT FIX] [BUILD] Fix maven build failures

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6511#issuecomment-107300943 False alarm: I was building off a slightly-out-of-date branch. Just saw the comment on your other commit; I see now that the issue is the fact that Spark Core'

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6505#discussion_r31399860 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -482,30 +482,66 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/6505#discussion_r31399854 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -482,30 +482,66 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6505 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6505#issuecomment-107300564 Merged in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107300585 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7824][SQL]Collapsing operator reorderin...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6351#issuecomment-107300593 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6505#issuecomment-107300581 @marmbrus if you have time would be great to take a look at this too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHu

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/6505#issuecomment-107300521 LGTM, thanks for working on this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [HOT FIX] [BUILD] Fix maven build failures

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6511#issuecomment-107300035 I'm running into Maven build breaks due to missing test-jar dependencies in the `sql`, `mllib` and `flume-sink` projects. Why did you remove the test dependency? I c

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6505#issuecomment-107299909 @yhuai , updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6537#discussion_r31399508 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -127,20 +127,20 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-6126][SQL] enforce UDTs as well in Json...

2015-05-31 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/6193#discussion_r31399451 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/UserDefinedType.scala --- @@ -53,7 +53,12 @@ abstract class UserDefinedType[UserType] extends

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6537#discussion_r31399048 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -127,20 +127,20 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [SQL] Simplifies binary node pattern matching

2015-05-31 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6537#discussion_r31399027 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -127,20 +127,20 @@ trait HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-7989][Core][Tests] Fix flaky tests in E...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6546#issuecomment-107293380 [Test build #33872 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33872/consoleFull) for PR 6546 at commit [`3b69840`](https://gith

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/6430#discussion_r31398962 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -262,15 +267,22 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-7989][Core][Tests] Fix flaky tests in E...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6546#issuecomment-107293150 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7989][Core][Tests] Fix flaky tests in E...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6546#issuecomment-107293189 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7989][Core][Tests] Fix flaky tests in E...

2015-05-31 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/6546 [SPARK-7989][Core][Tests] Fix flaky tests in ExternalShuffleServiceSuite and SparkListenerWithClusterSuite The flaky tests in ExternalShuffleServiceSuite and SparkListenerWithClusterSuite will fail

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/6505#issuecomment-107290024 Can you update the description to explain what is the problem with more information (e.g. a case that we do not handle correctly)? --- If your project is set up for it, y

[GitHub] spark pull request: [SPARK-7978] [SQL] [PYSPARK] DecimalType shoul...

2015-05-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6532 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6297] EventLog permissions are always s...

2015-05-31 Thread huangjs
Github user huangjs commented on the pull request: https://github.com/apache/spark/pull/4989#issuecomment-107289662 Want to reopen this as in YARN mode, Spark app will run under user's account. --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark pull request: [SPARK-7952][SPARK-7984][SQL] equality check b...

2015-05-31 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/6505#issuecomment-107288766 Is it ready to go? cc @rxin @liancheng @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7938][BUILD]Use Google ErrorProne durin...

2015-05-31 Thread yijieshen
Github user yijieshen commented on the pull request: https://github.com/apache/spark/pull/6515#issuecomment-107288251 @JoshRosen, since the profile is tightly coupled with `compile` & `test-compile` goals in maven, is it OK to run `mvn package` in `bin/run-tests`? e.g. in `lint-java`?

[GitHub] spark pull request: [SPARK-7938][BUILD]Use Google ErrorProne durin...

2015-05-31 Thread yijieshen
Github user yijieshen commented on the pull request: https://github.com/apache/spark/pull/6515#issuecomment-107287257 @rxin, in error prone, some checks are `on` by default, and others are experimental and `off` by default. Each of the checks is considered with a `Severity level`, som

[GitHub] spark pull request: [SPARK-7691] [SQL] Refactor CatalystTypeConver...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6222#issuecomment-107285935 [Test build #33868 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33868/consoleFull) for PR 6222 at commit [`740341b`](https://git

[GitHub] spark pull request: [SPARK-7691] [SQL] Refactor CatalystTypeConver...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6222#issuecomment-107285941 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7889] make sure click the "App ID" on H...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6545#issuecomment-107285299 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-7889] make sure click the "App ID" on H...

2015-05-31 Thread XuTingjun
GitHub user XuTingjun opened a pull request: https://github.com/apache/spark/pull/6545 [SPARK-7889] make sure click the "App ID" on HistoryPage, the SparkUI will be refreshed. The bug is that: When clicking the app in incomplete page, the tasks progress is 100/2000. After the app

[GitHub] spark pull request: [SPARK-7221] [Streaming] Expose the current pr...

2015-05-31 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/6495#issuecomment-107285068 Yes, as @srowen said, this implementation is not the intent of the JIRA. According to my knowledge, this problem is not easy to handle with an elegant solution, if you

[GitHub] spark pull request: [SPARK-7699][Core] Lazy start the scheduler fo...

2015-05-31 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/6430#discussion_r31397987 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -150,6 +151,9 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark pull request: [SPARK-7959][DOC] Minor modification to Stream...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6544#issuecomment-107283514 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-7959][DOC] Minor modification to Stream...

2015-05-31 Thread nishkamravi2
GitHub user nishkamravi2 opened a pull request: https://github.com/apache/spark/pull/6544 [SPARK-7959][DOC] Minor modification to Streaming docs with regards to parallel data receiving @pwendell @tdas You can merge this pull request into a Git repository by running: $ git pul

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107282252 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107281357 [Test build #33871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33871/consoleFull) for PR 6409 at commit [`b76a102`](https://gith

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107280891 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107280850 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7938][BUILD]Use Google ErrorProne durin...

2015-05-31 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6515#issuecomment-107280681 Since this is now guarded behind a special Maven profile, we should also make sure to update the Jenkins build to run with this enabled. AFAIK the Jenkins Maven build

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread Sephiroth-Lin
Github user Sephiroth-Lin commented on a diff in the pull request: https://github.com/apache/spark/pull/6409#discussion_r31397611 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -849,6 +852,27 @@ private[spark] class Client( } }

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107280587 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7705][Yarn] Cleanup of .sparkStaging di...

2015-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6409#issuecomment-107280578 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

  1   2   3   4   >