[GitHub] spark pull request #14514: document that Mesos cluster mode supports python

2016-08-05 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14514 document that Mesos cluster mode supports python update docs to be consistent with SPARK-14645 https://issues.apache.org/jira/browse/SPARK-14645 You can merge this pull request into a

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14514 **[Test build #63292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63292/consoleFull)** for PR 14514 at commit [`1d0c321`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14500 **[Test build #63283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63283/consoleFull)** for PR 14500 at commit [`e478c3a`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14515: [SPARK-16926] [SQL] Remove partition columns from...

2016-08-05 Thread dafrista
GitHub user dafrista opened a pull request: https://github.com/apache/spark/pull/14515 [SPARK-16926] [SQL] Remove partition columns from partition metadata. ## What changes were proposed in this pull request? This removes partition columns from column metadata of partitions

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14500 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14515: [SPARK-16926] [SQL] Remove partition columns from partit...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14515 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14500 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63283/ Test PASSed. ---

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768836 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner( private[wor

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link application summary pa...

2016-08-05 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14461 I forgot to comment, but I did check this out and it runs well, I still think the link on the app summary is redundant though. --- If your project is set up for it, you can reply to this email an

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768813 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner( private[wor

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768915 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner( private[wor

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73768879 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner( private[wor

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73769000 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -53,9 +53,11 @@ private[deploy] class DriverRunner( @volatile pr

[GitHub] spark issue #14497: [SPARK-16901] Hive settings in hive-site.xml may be over...

2016-08-05 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14497 Thanks for reviewing! I am merging this to master and branch 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73769695 --- Diff: core/src/test/scala/org/apache/spark/deploy/worker/DriverRunnerTest.scala --- @@ -45,6 +52,18 @@ class DriverRunnerTest extends SparkFunSuite {

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14508 **[Test build #63284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63284/consoleFull)** for PR 14508 at commit [`5e9c042`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14514 **[Test build #63292 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63292/consoleFull)** for PR 14514 at commit [`1d0c321`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63292/ Test PASSed. ---

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14514 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63284/ Test PASSed. ---

[GitHub] spark issue #14508: [SPARK-16586][core] Handle JVM errors printed to stdout.

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14508 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14109 **[Test build #63288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63288/consoleFull)** for PR 14109 at commit [`9c2bf47`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14516: [SPARK-15702][DOCS] Changed programming guide to ...

2016-08-05 Thread BryanCutler
GitHub user BryanCutler opened a pull request: https://github.com/apache/spark/pull/14516 [SPARK-15702][DOCS] Changed programming guide to not reference old accumulator API in Scala ## What changes were proposed in this pull request? In the programming guide, the accumulato

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14109 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63288/ Test PASSed. ---

[GitHub] spark issue #14109: [SPARK-16404][ML] LeastSquaresAggregators serializes unn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14109 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14516 ![screenshot](https://cloud.githubusercontent.com/assets/4534389/17452512/8e523b04-5b24-11e6-8972-fc700d3adc8c.png) --- If your project is set up for it, you can reply to this email and have y

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14516 **[Test build #63293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63293/consoleFull)** for PR 14516 at commit [`fcf34ba`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 @davies It should be fine right? Now we don't have recursions. We don't need to force `dictionaryIds` instance outside of `ColumnVector` class to use that method. --- If your project is set up for it,

[GitHub] spark pull request #14497: [SPARK-16901] Hive settings in hive-site.xml may ...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73770529 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner( private[wor

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73770621 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -168,7 +173,24 @@ private[deploy] class DriverRunner( localJar

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/14516 screenshot above. it looks like some lines are cutout, but that was just an artifact of the screenshot, those lines are not modified. --- If your project is set up for it, you can reply to thi

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/11746 Looks sane to me, but needs some style updates. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14509 **[Test build #63285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63285/consoleFull)** for PR 14509 at commit [`8692d1c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14509 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63285/ Test PASSed. ---

[GitHub] spark issue #14509: [SPARK-16924][SQL] - Support option("inferSchema", true)...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14509 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/14513 It's not necessary, but more clear (consistent) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14311: [SPARK-16550] [core] Certain classes fail to deserialize...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14311 **[Test build #3204 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3204/consoleFull)** for PR 14311 at commit [`7543c4a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 @davies Makes sense. I'll update the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73771392 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -53,9 +53,11 @@ private[deploy] class DriverRunner( @volati

[GitHub] spark pull request #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRu...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/11746#discussion_r73771605 --- Diff: core/src/main/scala/org/apache/spark/deploy/worker/DriverRunner.scala --- @@ -78,49 +80,53 @@ private[deploy] class DriverRunner( privat

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14516 **[Test build #63293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63293/consoleFull)** for PR 14516 at commit [`fcf34ba`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14516 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63293/ Test PASSed. ---

[GitHub] spark issue #14516: [SPARK-15702][DOCS] Changed programming guide to not ref...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14516 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/11746 Thanks for the review @vanzin! Style issues have been fixed and renamed 'Launch' to 'Run' where appropriate. --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63294/consoleFull)** for PR 11746 at commit [`6d8f4f6`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #14489: [MINOR][SparkR] R API documentation for "coltypes...

2016-08-05 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/14489#discussion_r73773220 --- Diff: R/pkg/R/DataFrame.R --- @@ -41,7 +41,7 @@ setOldClass("structType") #'\dontrun{ #' sparkR.session() #' df <- createDataFrame(faithfu

[GitHub] spark pull request #14489: [MINOR][SparkR] R API documentation for "coltypes...

2016-08-05 Thread keypointt
Github user keypointt commented on a diff in the pull request: https://github.com/apache/spark/pull/14489#discussion_r73773463 --- Diff: R/pkg/R/DataFrame.R --- @@ -41,7 +41,7 @@ setOldClass("structType") #'\dontrun{ #' sparkR.session() #' df <- createDataFrame(faithf

[GitHub] spark issue #14474: [SPARK-16853][SQL] fixes encoder error in DataSet typed ...

2016-08-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14474 Is this a bug fix? If yes, shouldn't we merge it in 2.0? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14510 **[Test build #63286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63286/consoleFull)** for PR 14510 at commit [`c567a7e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14510 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63286/ Test PASSed. ---

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9207 **[Test build #63295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63295/consoleFull)** for PR 9207 at commit [`00173aa`](https://github.com/apache/spark/commit/001

[GitHub] spark issue #14510: [SPARK-16925] Master should call schedule() after all ex...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14510 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14266 @davies Added some test results with larger number of distinct keys. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73773948 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilterSuite.scala --- @@ -368,73 +378,75 @@ class ParquetFilterSu

[GitHub] spark issue #14176: [SPARK-16525][SQL] Enable Row Based HashMap in HashAggre...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14176 @davies @sameeragarwal I updated more results in the benchmark PR https://github.com/apache/spark/pull/14266 . --- If your project is set up for it, you can reply to this email and have your reply app

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63296/consoleFull)** for PR 14266 at commit [`0875fbc`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14266 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14266 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63296/ Test FAILed. ---

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63296/consoleFull)** for PR 14266 at commit [`0875fbc`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14472: [SPARK-16866][SQL] Infrastructure for file-based ...

2016-08-05 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/14472#discussion_r73774227 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala --- @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] spark issue #14472: [SPARK-16866][SQL] Infrastructure for file-based SQL end...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14472 **[Test build #63297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63297/consoleFull)** for PR 14472 at commit [`2352d6f`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73774422 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -199,6 +209,19 @@ private[sql] case class FileSourceScanExec

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14511 **[Test build #63287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63287/consoleFull)** for PR 14511 at commit [`f42ac25`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14513 @davies Updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if t

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14511 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14511: [SPARK-16927] [SPARK-16923] Override task properties at ...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14511 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63287/ Test FAILed. ---

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63298/consoleFull)** for PR 14513 at commit [`b8f2549`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #63289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63289/consoleFull)** for PR 11105 at commit [`177c6bf`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63289/ Test PASSed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63291/consoleFull)** for PR 14513 at commit [`70e32c6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63291/ Test PASSed. ---

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63299/consoleFull)** for PR 14266 at commit [`e990794`](https://github.com/apache/spark/commit/e

[GitHub] spark pull request #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14500#discussion_r73775993 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -425,6 +430,110 @@ case class AlterTableDropPartitionCommand(

[GitHub] spark issue #13300: [SPARK-15463][SQL] support creating dataframe out of Dat...

2016-08-05 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/13300 @rxin Do you think we can revisit this feature and have it in 2.1? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73776214 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -199,6 +209,19 @@ private[sql] case class FileSourceScanExec

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63300/consoleFull)** for PR 14447 at commit [`eb5f5af`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-05 Thread djk121
Github user djk121 commented on the issue: https://github.com/apache/spark/pull/14118 I'm doing this: val dataframe = sparkSession.read .format("com.databricks.spark.csv") .option("header", "true") .option("nullValue", "null") .schema

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63300/ Test FAILed. ---

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63300 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63300/consoleFull)** for PR 14447 at commit [`eb5f5af`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-08-05 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r73776684 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/ColumnTypeSuite.scala --- @@ -73,8 +73,8 @@ class ColumnTypeSuite extends SparkFunSu

[GitHub] spark issue #14311: [SPARK-16550] [core] Certain classes fail to deserialize...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14311 **[Test build #3204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3204/consoleFull)** for PR 14311 at commit [`7543c4a`](https://github.com/apache/spark/commit

[GitHub] spark pull request #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy a...

2016-08-05 Thread GregBowyer
GitHub user GregBowyer opened a pull request: https://github.com/apache/spark/pull/14517 [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sortBy ## What changes were proposed in this pull request? API access to allow pyspark to use bucketBy and sortBy in datraframes. You can

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-05 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 ping @cloud-fan @hvanhovell Can you look at this if it is making sense for you? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #63301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63301/consoleFull)** for PR 13680 at commit [`7b4e819`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63294/consoleFull)** for PR 11746 at commit [`6d8f4f6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63294/ Test FAILed. ---

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63298/consoleFull)** for PR 14513 at commit [`b8f2549`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63298/ Test FAILed. ---

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14118 BTW, this problem exists in the external CSV data source as well. The root cause of https://github.com/databricks/spark-csv/issues/370 is this issue and also if my understanding is correct, the

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9207 **[Test build #63295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63295/consoleFull)** for PR 9207 at commit [`00173aa`](https://github.com/apache/spark/commit/00

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63295/ Test PASSed. --- I

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63302/consoleFull)** for PR 14461 at commit [`0192b37`](https://github.com/apache/spark/commit/0

<    1   2   3   4   5   >