[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13920 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62837/ Test PASSed. ---

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13920 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13920 **[Test build #62837 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62837/consoleFull)** for PR 13920 at commit [`e3194bd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13620 LGTM. Let's run the test again since this is a pretty old PR. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13620 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, o

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62845/consoleFull)** for PR 14241 at commit [`780fec5`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14351: [SQL][DOC] Fix a default name for parquet compres...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14351 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14351 Thanks - merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark pull request #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec t...

2016-07-25 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14241#discussion_r72154191 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -275,62 +271,152 @@ private[sql] case class RowDataSourceScanExec(

[GitHub] spark pull request #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec t...

2016-07-25 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14241#discussion_r72154195 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -275,62 +271,152 @@ private[sql] case class RowDataSourceScanExec(

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14174 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62836/ Test PASSed. ---

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14174 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14174 **[Test build #62836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62836/consoleFull)** for PR 14174 at commit [`5bd4bca`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14351 **[Test build #62844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62844/consoleFull)** for PR 14351 at commit [`4bff124`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14351 @rxin could you check this before the v2.0 release? An actual default seems to be `snappy`: https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/internal/SQLCon

[GitHub] spark pull request #14351: [SQL][DOC] Fix a default name for parquet compres...

2016-07-25 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/14351 [SQL][DOC] Fix a default name for parquet compression ## What changes were proposed in this pull request? This pr is to fix a wrong description for parquet default compression. You can mer

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/11105 Now that 2.0 is mostly ready to go out (with the new accumulator API) - does maybe @squito have some cycles to look at this? I know @rxin is probably pretty busy with the packaging but after 2.0 is

[GitHub] spark issue #14311: [SPARK-16550] [core] Certain classes fail to deserialize...

2016-07-25 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14311 Weird, both `core/test-only *DistributedSuite*` and `repl/test-only *ReplSuite*` pass locally for me (jdk-8). I'll look into it tomorrow when I have access to my desktop. --- If your project is set

[GitHub] spark issue #9524: [SPARK-10387][ML] Add code gen for gbt

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/9524 Now that 2.0 is mostly out - does @dbtsai have some cycles to review it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/9207 Now that 2.0 RC5 has passed - maybe it would be an OK time to revisit this? I think it can also be an ok base for adding more formats if we need to. --- If your project is set up for it, you can rep

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #62843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62843/consoleFull)** for PR 13571 at commit [`06f753e`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72148282 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -247,6 +248,46 @@ private[sql] trait SQLTestUtils }

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72148009 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -269,19 +273,11 @@ class StreamExecution(

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14269 **[Test build #62842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62842/consoleFull)** for PR 14269 at commit [`82feec4`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14284#discussion_r72144974 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WindowExec.scala --- @@ -625,10 +643,12 @@ private[execution] final class OffsetWindowFu

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread dhruve
Github user dhruve commented on the issue: https://github.com/apache/spark/pull/14269 Removed unused import. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14269 one minor issue with import otherwise changes LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62841/consoleFull)** for PR 14275 at commit [`4a0af2e`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make Liste...

2016-07-25 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14269#discussion_r72143443 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -19,6 +19,7 @@ package org.apache.spark.internal import java

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62841/ Test FAILed. ---

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62841 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62841/consoleFull)** for PR 14275 at commit [`4a0af2e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14292 **[Test build #3190 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3190/consoleFull)** for PR 14292 at commit [`26138b2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62840/ Test FAILed. ---

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62840 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62840/consoleFull)** for PR 14275 at commit [`44c50d4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62840/consoleFull)** for PR 14275 at commit [`44c50d4`](https://github.com/apache/spark/commit/4

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r72141303 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,27 @@ private[mesos] object Meso

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14350 **[Test build #62838 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62838/consoleFull)** for PR 14350 at commit [`4c6dfbc`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14349 **[Test build #62839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62839/consoleFull)** for PR 14349 at commit [`33978cb`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14350: [SPARK-16715][Tests]Fix a potential ExprId confli...

2016-07-25 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/14350 [SPARK-16715][Tests]Fix a potential ExprId conflict for SubexpressionEliminationSuite."Semantic equals and hash" ## What changes were proposed in this pull request? SubexpressionEliminatio

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14349 This PR is a cleaner version for 14174: https://github.com/apache/spark/pull/14174. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread ooq
Github user ooq commented on the issue: https://github.com/apache/spark/pull/14174 Closing this now. Open another PR for cleaner commit history: https://github.com/apache/spark/pull/14349 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashM...

2016-07-25 Thread ooq
Github user ooq closed the pull request at: https://github.com/apache/spark/pull/14174 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62832/ Test PASSed. ---

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14132 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashM...

2016-07-25 Thread ooq
GitHub user ooq opened a pull request: https://github.com/apache/spark/pull/14349 [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGenerator ## What changes were proposed in this pull request? This PR is the first step for the following feature: For hash aggregati

[GitHub] spark issue #14132: [SPARK-16475][SQL] Broadcast Hint for SQL Queries

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14132 **[Test build #62832 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62832/consoleFull)** for PR 14132 at commit [`d3df3fb`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14298: [SPARK-16283][SQL] Implement `percentile_approx` ...

2016-07-25 Thread thunterdb
Github user thunterdb commented on a diff in the pull request: https://github.com/apache/spark/pull/14298#discussion_r72137984 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala --- @@ -0,0 +1,456 @@ +/* + * Lic

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72137376 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -269,19 +273,11 @@ class StreamExecution(

[GitHub] spark issue #14348: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14348 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14309: [SPARK-11977][SQL] Support accessing a column contains "...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14309 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62831/ Test PASSed. ---

[GitHub] spark issue #14309: [SPARK-11977][SQL] Support accessing a column contains "...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14309 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14309: [SPARK-11977][SQL] Support accessing a column contains "...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14309 **[Test build #62831 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62831/consoleFull)** for PR 14309 at commit [`0e47cfd`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14348: [SPARK-15271] [MESOS] Allow force pulling executo...

2016-07-25 Thread philipphoffmann
GitHub user philipphoffmann opened a pull request: https://github.com/apache/spark/pull/14348 [SPARK-15271] [MESOS] Allow force pulling executor docker images ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## H

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-25 Thread philipphoffmann
Github user philipphoffmann commented on the issue: https://github.com/apache/spark/pull/13051 fixed the above issue and sent another request here: #14348 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13920 **[Test build #62837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62837/consoleFull)** for PR 13920 at commit [`e3194bd`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13920 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14174 **[Test build #62836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62836/consoleFull)** for PR 14174 at commit [`5bd4bca`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #14270: [SPARK-5847][CORE] Allow for configuring MetricsS...

2016-07-25 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/14270#discussion_r72131840 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -103,4 +103,9 @@ package object config { .stringConf .ch

[GitHub] spark pull request #14297: [SPARK-16660][SQL] CreateViewCommand should not t...

2016-07-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14297#discussion_r72131816 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -44,7 +50,11 @@ import org.apache.spark.sql.catalyst.plans.lo

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13051 Shoot, yeah PR builder tests passed, but that was 7 days ago. Sorry @philipphoffmann can you try this one again after figuring out whatever caused this? --- If your project is set up for it, you ca

[GitHub] spark pull request #14345: [CORE] Added new high-order function to RDD: cart...

2016-07-25 Thread piffall
Github user piffall closed the pull request at: https://github.com/apache/spark/pull/14345 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark issue #14345: [CORE] Added new high-order function to RDD: cartesianFi...

2016-07-25 Thread piffall
Github user piffall commented on the issue: https://github.com/apache/spark/pull/14345 Ok. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14257 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-25 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/13051 This patch just broke the build: ``` [error] /home/jenkins/workspace/spark-master-compile-maven-hadoop-2.2/core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrain

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14257 **[Test build #62829 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62829/consoleFull)** for PR 14257 at commit [`6b3adbf`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14257 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62829/ Test PASSed. ---

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14292 **[Test build #62835 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62835/consoleFull)** for PR 14292 at commit [`26138b2`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14292 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14292 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62835/ Test FAILed. ---

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62834/ Test FAILed. ---

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #62834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62834/consoleFull)** for PR 13571 at commit [`bfa39e8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13886 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62827/ Test PASSed. ---

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13886 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13886: [SPARK-16185] [SQL] Better Error Messages When Creating ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13886 **[Test build #62827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62827/consoleFull)** for PR 13886 at commit [`472896f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14194: [SPARK-16485][DOC][ML] Fixed several inline forma...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14194 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14292 **[Test build #62835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62835/consoleFull)** for PR 14292 at commit [`26138b2`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #14194: [SPARK-16485][DOC][ML] Fixed several inline formatting i...

2016-07-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14194 Merged to master/2.0 to match original change --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #14194: [SPARK-16485][DOC][ML] Fixed several inline formatting i...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14194 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62833/ Test PASSed. ---

[GitHub] spark issue #14194: [SPARK-16485][DOC][ML] Fixed several inline formatting i...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14194 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14194: [SPARK-16485][DOC][ML] Fixed several inline formatting i...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14194 **[Test build #62833 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62833/consoleFull)** for PR 14194 at commit [`23af691`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14309: [SPARK-11977][SQL] Support accessing a column con...

2016-07-25 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/14309#discussion_r72127680 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -896,6 +896,19 @@ class DataFrameSuite extends QueryTest with SharedS

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #62834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62834/consoleFull)** for PR 13571 at commit [`bfa39e8`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72127350 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala --- @@ -91,18 +92,30 @@ class HDFSMetadataLog[T: ClassTag](spa

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72127293 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -269,19 +273,11 @@ class StreamExecution( * bat

[GitHub] spark issue #14333: [SPARK-16696][ML][MLLib] destroy KMeans bcNewCenters whe...

2016-07-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14333 OK sounds good. So maybe we're back to this: for `bcNewCenters`, is it really worth the overhead to track and destroy them? or just settle for unpersisting within the loop? I could go either way, you

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14275 Looks like one more last comment, and needs a rebase after https://github.com/apache/spark/pull/13051 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14307 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62828/ Test PASSed. ---

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14307 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72126474 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -247,6 +248,46 @@ private[sql] trait SQLTestUtils } }

[GitHub] spark pull request #13051: [SPARK-15271] [MESOS] Allow force pulling executo...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13051 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #14307: [SPARK-16672][SQL] SQLBuilder should not raise exception...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14307 **[Test build #62828 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62828/consoleFull)** for PR 14307 at commit [`be2085a`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13051: [SPARK-15271] [MESOS] Allow force pulling executor docke...

2016-07-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/13051 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #14345: [CORE] Added new high-order function to RDD: cartesianFi...

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14345 So I'm tempted to say no to this API addition because once we want to do things like this, we should really rely on an optimizer to push things automatically, which is the point for SQL and the DataFra

[GitHub] spark issue #14257: [SPARK-16621][SQL] Generate stable SQLs in SQLBuilder

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14257 cc @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72125645 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala --- @@ -91,18 +92,30 @@ class HDFSMetadataLog[T: ClassTag](spa

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72125535 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/HDFSMetadataLog.scala --- @@ -91,18 +92,30 @@ class HDFSMetadataLog[T: ClassTag](spa

[GitHub] spark issue #13758: [SPARK-16043][SQL] Prepare GenericArrayData implementati...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13758 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

<    1   2   3   4   5   6   7   >