[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8959#discussion_r41173657 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,11 +1194,22 @@ object Client extends Logging { private def

[GitHub] spark pull request: [SPARK-10669] [Docs] Link to each language's A...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8977#issuecomment-145609285 [Test build #1842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1842/console) for PR 8977 at commit

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-05 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-145609363 @viirya It will be great we can fix it magically. I'm worried that the current approach will introduce some performance regressions. As we always have a way to

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145609327 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8747#issuecomment-145609517 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145611558 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145611452 [Test build #43241 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43241/console) for PR 8971 at commit

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145611560 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145613690 [Test build #43244 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43244/consoleFull) for PR 8920 at commit

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41175012 --- Diff: python/pyspark/__init__.py --- @@ -36,6 +36,31 @@ Finer-grained cache persistence levels. """ +import os +import sys

[GitHub] spark pull request: [SPARK-10648] Proposed bug fix when oracle ret...

2015-10-05 Thread travishegner
Github user travishegner commented on a diff in the pull request: https://github.com/apache/spark/pull/8780#discussion_r41172742 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DecimalType.scala --- @@ -140,7 +140,12 @@ object DecimalType extends AbstractDataType

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145607323 [Test build #43241 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43241/consoleFull) for PR 8971 at commit

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8934#discussion_r41173178 --- Diff: python/pyspark/sql/types.py --- @@ -1189,6 +1189,16 @@ class Row(tuple): >>> Person("Alice", 11)

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145610834 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145610772 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8747#issuecomment-145610401 [Test build #43243 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43243/consoleFull) for PR 8747 at commit

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145606571 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10895][SQL] Push down string filters to...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8956#issuecomment-145606676 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10895][SQL] Push down string filters to...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8956#issuecomment-145606518 [Test build #43238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43238/console) for PR 8956 at commit

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41173642 --- Diff: python/pyspark/__init__.py --- @@ -36,6 +36,31 @@ Finer-grained cache persistence levels. """ +import os +import sys

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145619279 sorry typo, running scalastyle manually and will post updated patch shortly. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145619261 [Test build #43244 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43244/console) for PR 8920 at commit

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145619405 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145619402 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10829][SQL]Filter combine partition key...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8916#discussion_r41177762 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -62,7 +62,30 @@ private[sql] object

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145620685 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145620682 [Test build #43245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43245/console) for PR 8959 at commit

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145621181 [Test build #1843 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1843/consoleFull) for PR 8971 at commit

[GitHub] spark pull request: [SPARK-10900][Streaming]Add output operation e...

2015-10-05 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8958#discussion_r41178108 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/OutputOperationInfo.scala --- @@ -0,0 +1,41 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-8514] LU factorization on BlockMatrix

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8563#issuecomment-145623644 [Test build #43247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43247/consoleFull) for PR 8563 at commit

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145624942 [Test build #43246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43246/consoleFull) for PR 8959 at commit

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread dilipbiswal
GitHub user dilipbiswal opened a pull request: https://github.com/apache/spark/pull/8983 [SPARK-8654][SQL] Fix Analysis exception when using NULL IN (...) In the analysis phase , while processing the rules for IN predicate, we compare the in-list types to the lhs expression type

[GitHub] spark pull request: [SPARK-10709] [SQL] When loading a json datase...

2015-10-05 Thread piggybox
Github user piggybox commented on the pull request: https://github.com/apache/spark/pull/8899#issuecomment-145629205 This is indeed confusing. I once used sqlContext.read.json() to read a path to a folder of JSON files and that worked, so I then tried the parent folder to read

[GitHub] spark pull request: [SPARK-8514] LU factorization on BlockMatrix

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8563#issuecomment-145634505 [Test build #43247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43247/console) for PR 8563 at commit

[GitHub] spark pull request: [SPARK-8514] LU factorization on BlockMatrix

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8563#issuecomment-145634658 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10895][SQL] Push down string filters to...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8956#issuecomment-145606678 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145606547 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8934#discussion_r41172960 --- Diff: python/pyspark/sql/types.py --- @@ -1209,6 +1219,12 @@ def __new__(self, *args, **kwargs): else: raise ValueError("No

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145609903 LGTM pending tests and a minor cleanup. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145619563 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145619542 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145620687 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6284][MESOS] Add mesos role, principal ...

2015-10-05 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/4960#issuecomment-145625978 Hi @AndriiOmelianenko, I have a PR out to fix that here https://github.com/apache/spark/pull/8872 --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145609320 [Test build #43242 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43242/console) for PR 8959 at commit

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8959#discussion_r41173518 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -1183,11 +1194,22 @@ object Client extends Logging { private def

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8747#issuecomment-145609556 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145609329 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10648] Proposed bug fix when oracle ret...

2015-10-05 Thread travishegner
Github user travishegner commented on the pull request: https://github.com/apache/spark/pull/8780#issuecomment-145609065 @cloud-fan @bdolbeare @davies I'm certainly open to doing this in an oracle specific way if that is what is required. I was simply hoping to solve my problem while

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41175819 --- Diff: python/pyspark/pyspark_version.py --- @@ -0,0 +1,17 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +#

[GitHub] spark pull request: [SPARK-1267][PYSPARK] Adds pip installer for p...

2015-10-05 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8318#discussion_r41176383 --- Diff: python/setup.py --- @@ -0,0 +1,18 @@ +#!/usr/bin/env python + +from setuptools import setup +

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145620136 [Test build #43245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43245/consoleFull) for PR 8959 at commit

[GitHub] spark pull request: [SPARK-10900][Streaming]Add output operation e...

2015-10-05 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8958#discussion_r41178301 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala --- @@ -140,6 +140,27 @@ class StreamingListenerSuite extends

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-145630551 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8514] LU factorization on BlockMatrix

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8563#issuecomment-145634657 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8514] LU factorization on BlockMatrix

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8563#issuecomment-145623267 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8514] LU factorization on BlockMatrix

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8563#issuecomment-145623227 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145608874 [Test build #43242 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43242/consoleFull) for PR 8959 at commit

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145623250 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10901] [YARN] spark.yarn.user.classpath...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8959#issuecomment-145623218 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8983#discussion_r41183045 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala --- @@ -135,4 +135,11 @@ class AnalysisSuite extends

[GitHub] spark pull request: [SPARK-10841][SQL] Add pushdown support of UDF...

2015-10-05 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8922#issuecomment-145632836 "daily sql query" is not sufficiently descriptive. Please post actual benchmark results with code when making pull requests that claim to improve performance. It

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8990#discussion_r41225536 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1248,4 +1248,12 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145745724 [Test build #43272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43272/consoleFull) for PR 8988 at commit

[GitHub] spark pull request: [SPARK-10885][Streaming]Display the failed out...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8950#issuecomment-145738954 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8990#discussion_r41225160 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala --- @@ -563,6 +580,77 @@

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8973#issuecomment-145743801 [Test build #43271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43271/consoleFull) for PR 8973 at commit

[GitHub] spark pull request: [SPARK-10885][Streaming]Display the failed out...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8950#issuecomment-145738897 [Test build #43270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43270/console) for PR 8950 at commit

[GitHub] spark pull request: [SPARK-10885][Streaming]Display the failed out...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8950#issuecomment-145738955 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8990#discussion_r41225256 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveQl.scala --- @@ -563,6 +580,77 @@

[GitHub] spark pull request: [SPARK-10938] [SQL] remove typeId in columnar ...

2015-10-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/8989#discussion_r41225242 --- Diff: project/MimaExcludes.scala --- @@ -42,7 +42,9 @@ object MimaExcludes { excludePackage("org.spark-project.jetty"),

[GitHub] spark pull request: [SPARK-10932] [PROJECT INFRA] Port two minor c...

2015-10-05 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/8986#issuecomment-145740694 Ah I see - didn't know it was failing Jenkins as well. Code changes from rxin/spark-utils LGTM. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8973#issuecomment-145743534 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10885][Streaming]Display the failed out...

2015-10-05 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/8950#issuecomment-145743591 This looks cool! Also I like that you used "details" for that. In the case of "Failed", unless the details is opened, there is not indication of failure. So it might be

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8973#issuecomment-145743522 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145745373 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-8848] [SQL] Refactors Parquet write pat...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8988#issuecomment-145745361 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-05 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8990#discussion_r41225405 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1248,4 +1248,12 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8973#issuecomment-145744272 [Test build #43271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43271/console) for PR 8973 at commit

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8973#issuecomment-145744274 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8973#issuecomment-145744273 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10772][Streaming][Scala]: NullPointerEx...

2015-10-05 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/8881#discussion_r41189182 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TransformedDStream.scala --- @@ -38,6 +39,11 @@ class TransformedDStream[U: ClassTag] (

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8971#issuecomment-145662420 [Test build #1843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1843/console) for PR 8971 at commit

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8747#issuecomment-145645748 [Test build #43243 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43243/console) for PR 8747 at commit

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8983#discussion_r41188938 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/HiveTypeCoercion.scala --- @@ -305,12 +305,17 @@ object HiveTypeCoercion {

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8747#issuecomment-145645883 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8747#issuecomment-145645874 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10863][SPARKR] Method coltypes() to get...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8984#issuecomment-145648518 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10772][Streaming][Scala]: NullPointerEx...

2015-10-05 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/8881#issuecomment-145650573 @jhu-chang Could you fix the style issue and one minor issue that I pointed out. Style issues: ``` [error]

[GitHub] spark pull request: [SPARK-10585][SQL] only copy data once when ge...

2015-10-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8747 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-145657747 @sun-rui Thanks! Done the changes, please check it out. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread adrian555
GitHub user adrian555 opened a pull request: https://github.com/apache/spark/pull/8985 [SPARK-10913][SPARKR] attach() function support You can merge this pull request into a Git repository by running: $ git pull https://github.com/adrian555/spark attach_and_with

[GitHub] spark pull request: [SPARK-10913][SPARKR] attach() function suppor...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8985#issuecomment-145661230 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10669] [Docs] Link to each language's A...

2015-10-05 Thread keypointt
GitHub user keypointt opened a pull request: https://github.com/apache/spark/pull/8977 [SPARK-10669] [Docs] Link to each language's API in codetabs in ML docs: spark.mllib In the Markdown docs for the spark.mllib Programming Guide, we have code examples with codetabs for each

[GitHub] spark pull request: [SPARK-10669] [Docs] Link to each language's A...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8977#issuecomment-145446371 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10856][SQL] Mapping TimestampType to DA...

2015-10-05 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/8978 [SPARK-10856][SQL] Mapping TimestampType to DATETIME for SQL Server jdbc dialect JIRA: https://issues.apache.org/jira/browse/SPARK-10856 For Microsoft SQL Server, TimestampType should be

[GitHub] spark pull request: [SPARK-10856][SQL] Mapping TimestampType to DA...

2015-10-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8978#issuecomment-145454237 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/8920#discussion_r41112866 --- Diff: R/pkg/R/DataFrame.R --- @@ -1304,24 +1306,62 @@ setClassUnion("characterOrColumn", c("character", "Column")) #' path <- "path/to/file.json"

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/8920#discussion_r41112848 --- Diff: R/pkg/R/DataFrame.R --- @@ -1304,24 +1306,62 @@ setClassUnion("characterOrColumn", c("character", "Column")) #' path <- "path/to/file.json"

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/8920#discussion_r41112869 --- Diff: R/pkg/R/DataFrame.R --- @@ -1304,24 +1306,62 @@ setClassUnion("characterOrColumn", c("character", "Column")) #' path <- "path/to/file.json"

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-05 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/8920#discussion_r41112888 --- Diff: R/pkg/R/DataFrame.R --- @@ -1304,24 +1306,62 @@ setClassUnion("characterOrColumn", c("character", "Column")) #' path <- "path/to/file.json"

  1   2   3   4   >