[GitHub] spark pull request: [SPARK-12656] [SQL] Implement Intersect with L...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10630#issuecomment-170220929 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170247768 Yeah I think this is correct. The comment that was here previously suggested this was related to use of `Optional` in the public API, but I think it needs to stay in

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170230870 I'm not sure about that; I believe Guava is supposed to be `provided` here. Does it fix the issue though? @vanzin how is this one supposed to work re: shading now that

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread jaceklaskowski
Github user jaceklaskowski commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170238716 Yes, it does. I'm using the latest revision + the change. It's a serious issue since standalone Master cannot be started as of today. I do not know how

[GitHub] spark pull request: [SPARK-5273] [MLLIB] [DOCS] Improve documentat...

2016-01-09 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/10675 [SPARK-5273] [MLLIB] [DOCS] Improve documentation examples for LinearRegression Use a much smaller step size in LinearRegressionWithSGD MLlib examples to achieve a reasonable RMSE. Our

[GitHub] spark pull request: [SPARK-12436][SQL] Now InferSchema should retu...

2016-01-09 Thread naveenminchu
Github user naveenminchu commented on a diff in the pull request: https://github.com/apache/spark/pull/10474#discussion_r49264010 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/InferSchema.scala --- @@ -169,7 +169,7 @@ private[json] object

[GitHub] spark pull request: [SPARK-5273] [MLLIB] [DOCS] Improve documentat...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10675#issuecomment-170240593 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5273] [MLLIB] [DOCS] Improve documentat...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10675#issuecomment-170240595 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12737]Decrease the redundant activeIds ...

2016-01-09 Thread qbwu
GitHub user qbwu opened a pull request: https://github.com/apache/spark/pull/10676 [SPARK-12737]Decrease the redundant activeIds sent to remote mirrors in "aggregateMessagesWithActiveSet" JIRA Issue: https://issues.apache.org/jira/browse/SPARK-12737 An optimization to the

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread naveenminchu
Github user naveenminchu commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49264644 --- Diff: docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/MySQLIntegrationSuite.scala --- @@ -150,4 +150,91 @@ class

[GitHub] spark pull request: [SPARK-5273] [MLLIB] [DOCS] Improve documentat...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10675#issuecomment-170240020 **[Test build #49046 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49046/consoleFull)** for PR 10675 at commit

[GitHub] spark pull request: [SPARK-12737]Decrease the redundant activeIds ...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10676#issuecomment-170241170 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5273] [MLLIB] [DOCS] Improve documentat...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10675#issuecomment-170240566 **[Test build #49046 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49046/consoleFull)** for PR 10675 at commit

[GitHub] spark pull request: [SPARK-12734][BUILD] Fix Netty exclusion and u...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10672#issuecomment-170224807 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12734][BUILD] Fix Netty exclusion and u...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10672#issuecomment-170224800 **[Test build #49041 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49041/consoleFull)** for PR 10672 at commit

[GitHub] spark pull request: [SPARK-12734][BUILD] Fix Netty exclusion and u...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10672#issuecomment-170224808 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread jaceklaskowski
GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/10674 [SPARK-12736][CORE][DEPLOY] Standalone Master cannot be started due t… …o NoClassDefFoundError: org/spark-project/guava/collect/Maps /cc @srowen @rxin You can merge this pull

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170228387 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12177] [STREAMING] Update KafkaDStreams...

2016-01-09 Thread nikit-os
Github user nikit-os commented on the pull request: https://github.com/apache/spark/pull/10294#issuecomment-170237564 Kafka 0.9 introduce new consumer which eliminates the dependence on Zookeeper. It replaces "high-level" and "low-level" consumers and makes working with Kafka much

[GitHub] spark pull request: [SPARK-12616] [SQL] Making Logical Operator `U...

2016-01-09 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10577#issuecomment-170282770 The latest change contains the fix for multi-child Union ALL in conversion from logical plan to SQL after introducing SQL Generation:

[GitHub] spark pull request: [SPARK-12735] Consolidate & move spark-ec2 to ...

2016-01-09 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/10673#issuecomment-170266531 There was once talk of leaving the `spark-ec2` executable in here and just downloading the script from the AMPLab repo on execution. That way users can continue to

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266410 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/MySQLDialect.scala --- @@ -41,6 +41,26 @@ private case object MySQLDialect extends JdbcDialect

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170267761 Jenkins, this is ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12735] Consolidate & move spark-ec2 to ...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10673#issuecomment-170267628 Given the scope of other deprecations / changes in Spark 2.0, I personally think that it's okay to leave out the wrapper script which forwards to the new repo. Note

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10674#discussion_r49266568 --- Diff: network/common/pom.xml --- @@ -55,6 +55,7 @@ com.google.guava guava + compile --- End diff --

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170269614 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170269616 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12340] Fix overflow in various take fun...

2016-01-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10670 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12616] [SQL] Making Logical Operator `U...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10577#issuecomment-170283685 **[Test build #49048 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49048/consoleFull)** for PR 10577 at commit

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170287921 **[Test build #49049 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49049/consoleFull)** for PR 10677 at commit

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/10677 [SPARK-12706] [SQL] grouping() and grouping_id() Grouping() returns a column is aggregated or not, grouping_id() returns the aggregation levels. grouping()/grouping_id() could be used with

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170287980 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170287977 **[Test build #49049 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49049/consoleFull)** for PR 10677 at commit

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170287981 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/10674#discussion_r49266731 --- Diff: network/common/pom.xml --- @@ -55,6 +55,7 @@ com.google.guava guava + compile --- End diff --

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170269576 **[Test build #49047 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49047/consoleFull)** for PR 10674 at commit

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266392 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/MySQLDialect.scala --- @@ -41,6 +41,26 @@ private case object MySQLDialect extends JdbcDialect

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266387 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/MySQLDialect.scala --- @@ -41,6 +41,26 @@ private case object MySQLDialect extends JdbcDialect

[GitHub] spark pull request: [SPARK-12436][SQL] Now InferSchema should retu...

2016-01-09 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/10474#issuecomment-170268671 Can you add tests and also make changes to the write path (parquet/orc)? Otherwise, when you write a json dataset with null type to parquet, it will fail. --- If your

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170268730 **[Test build #49047 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49047/consoleFull)** for PR 10674 at commit

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread jaceklaskowski
Github user jaceklaskowski commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170268746 I'm using the following commands to do the build: ``` $ ./dev/change-scala-version.sh 2.11 $ ./build/mvn -Pyarn -Phadoop-2.6

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread pjfanning
Github user pjfanning commented on the pull request: https://github.com/apache/spark/pull/10403#issuecomment-170256145 Hi Naveen - your new tests look good to me. I do notice though that you probably need to resync with master due to conflicts (there is a 'This branch has conflicts

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10674#issuecomment-170268121 @jaceklaskowski, to help me understand the scope of this bug could you tell us how you built Spark in your failing example? Did you use the Maven or SBT builds?

[GitHub] spark pull request: [SPARK-12735] Consolidate & move spark-ec2 to ...

2016-01-09 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/10673#issuecomment-170268088 Sounds fine with me and I agree with your position. :+1: I hope this makes it easier for people to contribute to spark-ec2. --- If your project is set up for

[GitHub] spark pull request: [SPARK-12269][Streaming][Kinesis] Update aws-j...

2016-01-09 Thread BrianLondon
Github user BrianLondon commented on the pull request: https://github.com/apache/spark/pull/10256#issuecomment-170270526 Manifest updated. Is there documented somewhere what all the tests Travis runs are? It seems to differ from what's described at

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266372 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/MySQLDialect.scala --- @@ -41,6 +41,26 @@ private case object MySQLDialect extends JdbcDialect

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266355 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/MySQLDialect.scala --- @@ -41,6 +41,26 @@ private case object MySQLDialect extends JdbcDialect

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266438 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JdbcDialects.scala --- @@ -90,6 +90,15 @@ abstract class JdbcDialect extends Serializable {

[GitHub] spark pull request: [SPARK-12437][SQL] Encapsulate the table and c...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10403#discussion_r49266453 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -219,13 +219,21 @@ object JdbcUtils extends

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170298048 **[Test build #49050 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49050/consoleFull)** for PR 10677 at commit

[GitHub] spark pull request: [SPARK-12616] [SQL] Making Logical Operator `U...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10577#issuecomment-170291824 **[Test build #49048 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49048/consoleFull)** for PR 10577 at commit

[GitHub] spark pull request: [SPARK-12616] [SQL] Making Logical Operator `U...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10577#issuecomment-170291891 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12616] [SQL] Making Logical Operator `U...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10577#issuecomment-170291889 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170298109 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170298110 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12706] [SQL] grouping() and grouping_id...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10677#issuecomment-170291988 **[Test build #49050 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49050/consoleFull)** for PR 10677 at commit

[GitHub] spark pull request: [SPARK-12539][follow-up] always sort in partit...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10638#issuecomment-170305993 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12504][SQL] [Backport-1.6] Masking cred...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10669#issuecomment-170308143 **[Test build #2356 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2356/consoleFull)** for PR 10669 at commit

[GitHub] spark pull request: [SPARK-12504][SQL] [Backport-1.6] Masking cred...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10669#issuecomment-170308345 **[Test build #2356 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2356/consoleFull)** for PR 10669 at commit

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10678#discussion_r49271363 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -523,14 +523,37 @@ class Analyzer( def apply(plan:

[GitHub] spark pull request: [SPARK-12539][follow-up] always sort in partit...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10638#issuecomment-170299362 **[Test build #49051 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49051/consoleFull)** for PR 10638 at commit

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/10674#discussion_r49270677 --- Diff: network/common/pom.xml --- @@ -55,6 +55,7 @@ com.google.guava guava + compile --- End diff --

[GitHub] spark pull request: [SPARK-12736][CORE][DEPLOY] Standalone Master ...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/10674#discussion_r49270748 --- Diff: network/common/pom.xml --- @@ -55,6 +55,7 @@ com.google.guava guava + compile --- End diff --

[GitHub] spark pull request: [SPARK-12539][follow-up] always sort in partit...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10638#issuecomment-170305994 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12539][follow-up] always sort in partit...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10638#issuecomment-170305946 **[Test build #49051 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49051/consoleFull)** for PR 10638 at commit

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/10678 [SPARK-12705] [SQL] AnalysisException: Sorting columns are not in Project of Window Function JIRA: https://issues.apache.org/jira/browse/SPARK-12705 Unable to resolve sorting columns

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-170308011 **[Test build #49052 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49052/consoleFull)** for PR 10678 at commit

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10678#discussion_r49271406 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -523,14 +523,37 @@ class Analyzer( def

[GitHub] spark pull request: [SPARK-12504][SQL] [Backport-1.6] Masking cred...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10669#issuecomment-170312652 **[Test build #2357 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2357/consoleFull)** for PR 10669 at commit

[GitHub] spark pull request: Merge pull request #1 from apache/master

2016-01-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10665 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12735] Consolidate & move spark-ec2 to ...

2016-01-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10673#issuecomment-170313629 @shivaram I'm going to merge this one first. Let me know if there is a problem with the move. I can easily revert this. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-12735] Consolidate & move spark-ec2 to ...

2016-01-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10673 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10678#discussion_r49271654 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -523,14 +523,37 @@ class Analyzer( def apply(plan:

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10678#discussion_r49271651 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -523,14 +523,37 @@ class Analyzer( def apply(plan:

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10678#discussion_r49271668 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -523,14 +523,37 @@ class Analyzer( def

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-170315806 **[Test build #49052 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49052/consoleFull)** for PR 10678 at commit

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-170315845 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-170315844 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12504][SQL] [Backport-1.6] Masking cred...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10669#issuecomment-170316548 **[Test build #2357 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2357/consoleFull)** for PR 10669 at commit

[GitHub] spark pull request: [SPARK-12612][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/10679 [SPARK-12612][PROJECT-INFRA] Backport dev/test-dependencies script to branch-1.5 This patch backports the `dev/test-dependencies` script (from #10461) to branch-1.5. You can merge this pull

[GitHub] spark pull request: [SPARK-10359][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/10680 [SPARK-10359][PROJECT-INFRA] Backport dev/test-dependencies script to branch-1.5 This patch backports the `dev/test-dependencies` script (from #10461) to branch-1.6. You can merge this pull

[GitHub] spark pull request: [SPARK-12734][BUILD] Fix Netty exclusion and u...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10672#issuecomment-170320386 I've opened two pull requests to backport the `dev/test-dependencies` infra to branch-1.5 and 1.6, which should allow me to backport this change as well. I

[GitHub] spark pull request: [SPARK-12734][BUILD] Fix Netty exclusion and u...

2016-01-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10672#issuecomment-170320650 Actually, I might choose to handle those separately in a followup next week in order to have more time to think through a few additional cases, including the

[GitHub] spark pull request: [SPARK-12734][BUILD] Fix Netty exclusion and u...

2016-01-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10672#issuecomment-170320786 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-12705] [SQL] AnalysisException: Sorting...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10678#issuecomment-170321338 **[Test build #49054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49054/consoleFull)** for PR 10678 at commit

[GitHub] spark pull request: [SPARK-10359][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10679#issuecomment-170321648 [Test build #49053 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49053/console) for PR 10679 at commit

[GitHub] spark pull request: [SPARK-10359][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10680#issuecomment-170321675 **[Test build #49055 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49055/consoleFull)** for PR 10680 at commit

[GitHub] spark pull request: [SPARK-10359][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10679#issuecomment-170321656 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10359][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10679#issuecomment-170321624 [Test build #49053 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49053/consoleFull) for PR 10679 at commit

[GitHub] spark pull request: [SPARK-10359][PROJECT-INFRA] Backport dev/test...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10679#issuecomment-170321658 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12733][SQL] Refactor duplicate codes in...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10671#issuecomment-170209013 **[Test build #49042 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49042/consoleFull)** for PR 10671 at commit

[GitHub] spark pull request: [SPARK-12656] [SQL] Implement Intersect with L...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10630#issuecomment-170208865 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12656] [SQL] Implement Intersect with L...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10630#issuecomment-170208817 **[Test build #49038 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49038/consoleFull)** for PR 10630 at commit

[GitHub] spark pull request: [SPARK-12656] [SQL] Implement Intersect with L...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10630#issuecomment-170208866 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12340] Fix overflow in various take fun...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10670#issuecomment-170209235 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12340] Fix overflow in various take fun...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10670#issuecomment-170209234 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12733][SQL] Refactor duplicate codes in...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10671#issuecomment-170209144 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12733][SQL] Refactor duplicate codes in...

2016-01-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10671#issuecomment-170209143 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12656] [SQL] Implement Intersect with L...

2016-01-09 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10630#issuecomment-170209280 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12340] Fix overflow in various take fun...

2016-01-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10670#issuecomment-170209126 **[Test build #49040 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/49040/consoleFull)** for PR 10670 at commit

  1   2   >