[GitHub] spark pull request #11796: [SPARK-13579][build][test-maven] Stop building th...

2016-08-05 Thread RussellSpitzer
Github user RussellSpitzer commented on a diff in the pull request: https://github.com/apache/spark/pull/11796#discussion_r73781398 --- Diff: assembly/pom.xml --- @@ -69,6 +68,17 @@ spark-repl_${scala.binary.version} ${project.version} + +

[GitHub] spark pull request #14502: [SPARK-16909][Spark Core] - Streaming for postgre...

2016-08-05 Thread princejwesley
Github user princejwesley commented on a diff in the pull request: https://github.com/apache/spark/pull/14502#discussion_r73781306 --- Diff: core/src/main/scala/org/apache/spark/rdd/JdbcRDD.scala --- @@ -79,12 +79,17 @@ class JdbcRDD[T: ClassTag]( val conn =

[GitHub] spark issue #12913: [SPARK-928][CORE] Add support for Unsafe-based serialize...

2016-08-05 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/12913 @holdenk Updated the PR, ready for review again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63308/ Test PASSed. ---

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63308/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14504: [SPARK-16409] [SQL] regexp_extract with optional groups ...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14504 **[Test build #63310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63310/consoleFull)** for PR 14504 at commit

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13701 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13701 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63307/ Test PASSed. ---

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63305/ Test PASSed. ---

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63307/consoleFull)** for PR 13701 at commit

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63305 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63305/consoleFull)** for PR 11746 at commit

[GitHub] spark issue #14496: [SPARK-16772] [Python] [Docs] Fix API doc references to ...

2016-08-05 Thread nchammas
Github user nchammas commented on the issue: https://github.com/apache/spark/pull/14496 Thanks @srowen. 👍 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #14477: [SPARK-16870][docs]Summary:add "spark.sql.broadca...

2016-08-05 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14477#discussion_r73780468 --- Diff: docs/sql-programming-guide.md --- @@ -790,6 +790,15 @@ Configuration of Parquet can be done using the `setConf` method on `SparkSession

[GitHub] spark pull request #14496: [SPARK-16772] [Python] [Docs] Fix API doc referen...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14496 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14496: [SPARK-16772] [Python] [Docs] Fix API doc references to ...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14496 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14491: [SPARK-16886] [EXAMPLES][SQL] structured streaming netwo...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14491 @ganeshchand see for example structure-streaming-programming-guide.md or structured_network_wordcount.py. These have apparently similar comments -- same story right? Also see all the potential

[GitHub] spark pull request #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14500#discussion_r73780390 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -425,6 +430,110 @@ case class AlterTableDropPartitionCommand(

[GitHub] spark pull request #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14500#discussion_r73780357 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -425,6 +430,110 @@ case class AlterTableDropPartitionCommand(

[GitHub] spark issue #9524: [SPARK-10387][ML] Add code gen for gbt

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9524 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9524: [SPARK-10387][ML] Add code gen for gbt

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9524 **[Test build #63309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63309/consoleFull)** for PR 9524 at commit

[GitHub] spark issue #9524: [SPARK-10387][ML] Add code gen for gbt

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9524 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63309/ Test FAILed. ---

[GitHub] spark pull request #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/14500#discussion_r73780281 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -864,6 +864,55 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #9524: [SPARK-10387][ML] Add code gen for gbt

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9524 **[Test build #63309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63309/consoleFull)** for PR 9524 at commit

[GitHub] spark issue #14514: document that Mesos cluster mode supports python

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14514 OK --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #13868: [SPARK-15899] [SQL] Fix the construction of the file pat...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13868 Any further comments, watchers? maybe worth implementing Marcelo's last comments and then let's merge. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #14484: [SPARK-16796][Web UI] Mask spark.authenticate.sec...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14484 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14450: [SPARK-16847][SQL] Prevent to potentially read co...

2016-08-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14450 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14518: [SPARK-16610][SQL] Do not ignore `orc.compress` when `co...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14518 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14484: [SPARK-16796][Web UI] Mask spark.authenticate.secret on ...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14484 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14518: [SPARK-16610][SQL] Do not ignore `orc.compress` when `co...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63304/ Test PASSed. ---

[GitHub] spark issue #14450: [SPARK-16847][SQL] Prevent to potentially read corrupt s...

2016-08-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14450 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14518: [SPARK-16610][SQL] Do not ignore `orc.compress` when `co...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14518 **[Test build #63304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63304/consoleFull)** for PR 14518 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63308/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14461 Oh yes. Thanks :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14450: [SPARK-16847][SQL] Prevent to potentially read corrupt s...

2016-08-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14450 Oh, I think this should not be backported to 2.0 and 1.x. In current releases, this is all being manually prevented in Spark itself (in

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread ajbozarth
Github user ajbozarth commented on the issue: https://github.com/apache/spark/pull/14461 The excludes are a list, you forgot to add commas between them --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-08-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r73779646 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/UnsafeArraySuite.scala --- @@ -93,6 +102,38 @@ class UnsafeArraySuite extends

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-08-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r73779549 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeArrayData.java --- @@ -341,16 +343,20 @@ public UnsafeArrayData

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63301/ Test FAILed. ---

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13680 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #63301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63301/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #14474: [SPARK-16853][SQL] fixes encoder error in DataSet typed ...

2016-08-05 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14474 it's a bug since the very beginning, should we merge it to 1.6 too? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63306/ Test FAILed. ---

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63306/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63307/consoleFull)** for PR 13701 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63306/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14518: [SPARK-16610][SQL] Do not ignore `orc.compress` when `co...

2016-08-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14518 Hi @yhuai , I open the PR as suggested. Just to triple-check, I want to be sure on the behaviour written in the PR description, 1. Check `compression` and use this if it is set. 2.

[GitHub] spark issue #14518: [SPARK-16610][SQL] Do not ignore `orc.compress` when `co...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14518 **[Test build #63304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63304/consoleFull)** for PR 14518 at commit

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63305/consoleFull)** for PR 11746 at commit

[GitHub] spark pull request #14518: [SPARK-16610][SQL] Do not ignore `orc.compress` w...

2016-08-05 Thread HyukjinKwon
GitHub user HyukjinKwon opened a pull request: https://github.com/apache/spark/pull/14518 [SPARK-16610][SQL] Do not ignore `orc.compress` when `compression` option is unset ## What changes were proposed in this pull request? For ORC source, Spark SQL has a writer option

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/11746 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14266 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63299/ Test PASSed. ---

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14266 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63299/consoleFull)** for PR 14266 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63303/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63303/ Test FAILed. ---

[GitHub] spark issue #14472: [SPARK-16866][SQL] Infrastructure for file-based SQL end...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14472 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63297/ Test PASSed. ---

[GitHub] spark issue #14472: [SPARK-16866][SQL] Infrastructure for file-based SQL end...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14472 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63303/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14461 retest it please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14472: [SPARK-16866][SQL] Infrastructure for file-based SQL end...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14472 **[Test build #63297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63297/consoleFull)** for PR 14472 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread nblintao
Github user nblintao commented on the issue: https://github.com/apache/spark/pull/14461 @ajbozarth Thanks for pointing out that. I have removed the link on the application summary page and reverted related changes. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63302/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63302/ Test FAILed. ---

[GitHub] spark issue #14461: [SPARK-16856] [WEBUI] [CORE] Link the application's exec...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14461 **[Test build #63302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63302/consoleFull)** for PR 14461 at commit

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/9207 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63295/ Test PASSed. ---

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/9207 **[Test build #63295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63295/consoleFull)** for PR 9207 at commit

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14118 BTW, this problem exists in the external CSV data source as well. The root cause of https://github.com/databricks/spark-csv/issues/370 is this issue and also if my understanding is correct, the

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63298/ Test FAILed. ---

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63298/consoleFull)** for PR 14513 at commit

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11746 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63294/ Test FAILed. ---

[GitHub] spark issue #11746: [SPARK-13602][CORE] Add shutdown hook to DriverRunner to...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11746 **[Test build #63294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63294/consoleFull)** for PR 11746 at commit

[GitHub] spark issue #13680: [SPARK-15962][SQL] Introduce implementation with a dense...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13680 **[Test build #63301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63301/consoleFull)** for PR 13680 at commit

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-05 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 ping @cloud-fan @hvanhovell Can you look at this if it is making sense for you? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy a...

2016-08-05 Thread GregBowyer
GitHub user GregBowyer opened a pull request: https://github.com/apache/spark/pull/14517 [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sortBy ## What changes were proposed in this pull request? API access to allow pyspark to use bucketBy and sortBy in datraframes. You can

[GitHub] spark issue #14311: [SPARK-16550] [core] Certain classes fail to deserialize...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14311 **[Test build #3204 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3204/consoleFull)** for PR 14311 at commit

[GitHub] spark pull request #13680: [SPARK-15962][SQL] Introduce implementation with ...

2016-08-05 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13680#discussion_r73776684 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/columnar/ColumnTypeSuite.scala --- @@ -73,8 +73,8 @@ class ColumnTypeSuite extends

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63300 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63300/consoleFull)** for PR 14447 at commit

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14447 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63300/ Test FAILed. ---

[GitHub] spark issue #14118: [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV ca...

2016-08-05 Thread djk121
Github user djk121 commented on the issue: https://github.com/apache/spark/pull/14118 I'm doing this: val dataframe = sparkSession.read .format("com.databricks.spark.csv") .option("header", "true") .option("nullValue", "null")

[GitHub] spark issue #14447: [SPARK-16445][MLlib][SparkR] Multilayer Perceptron Class...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14447 **[Test build #63300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63300/consoleFull)** for PR 14447 at commit

[GitHub] spark pull request #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter ...

2016-08-05 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13701#discussion_r73776214 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -199,6 +209,19 @@ private[sql] case class

[GitHub] spark issue #13300: [SPARK-15463][SQL] support creating dataframe out of Dat...

2016-08-05 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/13300 @rxin Do you think we can revisit this feature and have it in 2.1? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #14500: [SPARK-16905] SQL DDL: MSCK REPAIR TABLE

2016-08-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/14500#discussion_r73775993 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -425,6 +430,110 @@ case class AlterTableDropPartitionCommand(

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63291/ Test PASSed. ---

[GitHub] spark issue #14266: [SPARK-16526][SQL] Benchmarking Performance for Fast Has...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14266 **[Test build #63299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63299/consoleFull)** for PR 14266 at commit

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14513 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14513: [SPARK-16928][SQL] Recursive call of ColumnVector::getIn...

2016-08-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14513 **[Test build #63291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63291/consoleFull)** for PR 14513 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63289/ Test PASSed. ---

  1   2   3   4   5   >