[GitHub] [spark] SparkQA removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
SparkQA removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545538914 **[Test build #112553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112553/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #26170: [SPARK-29397][core] Extend plugin interface to include the driver.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26170: [SPARK-29397][core] Extend plugin interface to include the driver. URL: https://github.com/apache/spark/pull/26170#issuecomment-545598391 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545599568 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545599579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545599568 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545599579 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] rdblue commented on issue #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider

2019-10-23 Thread GitBox
rdblue commented on issue #25651: [SPARK-28948][SQL] Support passing all Table metadata in TableProvider URL: https://github.com/apache/spark/pull/25651#issuecomment-545600442 > Do you mean we should block this PR until we figure out the behavior of path-based tables? No, and sorry

[GitHub] [spark] SparkQA commented on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener.

2019-10-23 Thread GitBox
SparkQA commented on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener. URL: https://github.com/apache/spark/pull/26218#issuecomment-545604915 **[Test build #112550 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112

[GitHub] [spark] AmplabJenkins commented on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener.

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener. URL: https://github.com/apache/spark/pull/26218#issuecomment-545605654 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] SparkQA removed a comment on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener.

2019-10-23 Thread GitBox
SparkQA removed a comment on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener. URL: https://github.com/apache/spark/pull/26218#issuecomment-545512813 **[Test build #112550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] AmplabJenkins removed a comment on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener. URL: https://github.com/apache/spark/pull/26218#issuecomment-545605644 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener.

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener. URL: https://github.com/apache/spark/pull/26218#issuecomment-545605644 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26218: [SPARK-29562][sql] Speed up and slim down metric aggregation in SQL listener. URL: https://github.com/apache/spark/pull/26218#issuecomment-545605654 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on issue #26173: [SPARK-29503][SQL] Remove conversion CreateNamedStruct to CreateNamedStructUnsafe

2019-10-23 Thread GitBox
HeartSaVioR commented on issue #26173: [SPARK-29503][SQL] Remove conversion CreateNamedStruct to CreateNamedStructUnsafe URL: https://github.com/apache/spark/pull/26173#issuecomment-545606797 Thanks all for reviewing and merging!

[GitHub] [spark] imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive

2019-10-23 Thread GitBox
imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive URL: https://github.com/apache/spark/pull/26214#discussion_r338246731 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/cat

[GitHub] [spark] imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive

2019-10-23 Thread GitBox
imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive URL: https://github.com/apache/spark/pull/26214#discussion_r338248045 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/cat

[GitHub] [spark] imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive

2019-10-23 Thread GitBox
imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive URL: https://github.com/apache/spark/pull/26214#discussion_r338245383 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/cat

[GitHub] [spark] imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive

2019-10-23 Thread GitBox
imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive URL: https://github.com/apache/spark/pull/26214#discussion_r338241306 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/cat

[GitHub] [spark] imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive

2019-10-23 Thread GitBox
imback82 commented on a change in pull request #26214: [SPARK-29558][SQL] ResolveTables and ResolveRelations should be order-insensitive URL: https://github.com/apache/spark/pull/26214#discussion_r338229705 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ana

[GitHub] [spark] 07ARB opened a new pull request #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
07ARB opened a new pull request #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234 ###What changes were proposed in this pull request? This is a follow-up of #24052 to correct assert condition. ###Why

[GitHub] [spark] HeartSaVioR commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2019-10-23 Thread GitBox
HeartSaVioR commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-545628636 Thanks for making changes! My comment about leaving comments about move/refactor still apply - we may want to quickly check wheth

[GitHub] [spark] AmplabJenkins commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545630074 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545630564 Can one of the admins verify this patch? ---

[GitHub] [spark] SparkQA commented on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals

2019-10-23 Thread GitBox
SparkQA commented on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals URL: https://github.com/apache/spark/pull/26177#issuecomment-545630666 **[Test build #112554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112554/testReport)** for PR 2

[GitHub] [spark] AmplabJenkins removed a comment on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545630074 Can one of the admins verify this patch? ---

[GitHub] [spark] SparkQA removed a comment on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals

2019-10-23 Thread GitBox
SparkQA removed a comment on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals URL: https://github.com/apache/spark/pull/26177#issuecomment-545542235 **[Test build #112554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112554/testReport)** f

[GitHub] [spark] AmplabJenkins commented on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals URL: https://github.com/apache/spark/pull/26177#issuecomment-545631600 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] AmplabJenkins commented on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals URL: https://github.com/apache/spark/pull/26177#issuecomment-545631603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins removed a comment on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals URL: https://github.com/apache/spark/pull/26177#issuecomment-545631603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26177: [SPARK-29520][SS] Fix checks of negative intervals URL: https://github.com/apache/spark/pull/26177#issuecomment-545631600 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] 07ARB commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
07ARB commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545632117 @HeartSaVioR , Please check this two statement in AllExecutionsPageSuite.scala Testname : "sorting should be suc

[GitHub] [spark] 07ARB commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
07ARB commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545633152 @HeartSaVioR , if it's ok then please review my PR.

[GitHub] [spark] HeartSaVioR commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
HeartSaVioR commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545632967 Yeah I know what this patch is fixing, so left +1 (non-binding). The change won't make existing test fail,

[GitHub] [spark] vanzin commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver.

2019-10-23 Thread GitBox
vanzin commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver. URL: https://github.com/apache/spark/pull/26170#discussion_r338275388 ## File path: core/src/main/scala/org/apache/spark/internal/plugin/PluginContainer.scala ##

[GitHub] [spark] 07ARB commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
07ARB commented on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545633595 > Yeah I know what this patch is fixing, so left +1 (non-binding). The change won't make existing test fail, rig

[GitHub] [spark] vanzin commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver.

2019-10-23 Thread GitBox
vanzin commented on a change in pull request #26170: [SPARK-29397][core] Extend plugin interface to include the driver. URL: https://github.com/apache/spark/pull/26170#discussion_r338275388 ## File path: core/src/main/scala/org/apache/spark/internal/plugin/PluginContainer.scala ##

[GitHub] [spark] 07ARB removed a comment on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class

2019-10-23 Thread GitBox
07ARB removed a comment on issue #26234: [SPARK-29571][SQL][TESTS][FOLLOWUP]Fix UT in AllExecutionsPageSuite class URL: https://github.com/apache/spark/pull/26234#issuecomment-545633152 @HeartSaVioR , if it's ok then please review my PR.

[GitHub] [spark] Tagar commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type

2019-10-23 Thread GitBox
Tagar commented on issue #25749: [SPARK-29041][PYTHON] Allows createDataFrame to accept bytes as binary type URL: https://github.com/apache/spark/pull/25749#issuecomment-545637887 I have tested this fix with Python 2.7 and Python 3.6 with Spark 2.3. With this run-time "patch" applied

[GitHub] [spark] 07ARB commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
07ARB commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545637852 @dongjoon-hyun, please review the latest changes. This is

[GitHub] [spark] 07ARB edited a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
07ARB edited a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545637852 @dongjoon-hyun,@HeartSaVioR please review the latest changes. --

[GitHub] [spark] dongjoon-hyun opened a new pull request #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
dongjoon-hyun opened a new pull request #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224 ### What changes were proposed in this pull request? This PR updates JDBC Integration Test DBMS Docker Images. | DBMS

[GitHub] [spark] SparkQA commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
SparkQA commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545640259 **[Test build #112556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112556/testReport)

[GitHub] [spark] SparkQA removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
SparkQA removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545558112 **[Test build #112556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112556/test

[GitHub] [spark] AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545640853 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545640843 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545640853 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545640843 Merged build finished. Test PASSed. This i

[GitHub] [spark] SparkQA commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
SparkQA commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224#issuecomment-545641791 **[Test build #112562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112562/testReport)

[GitHub] [spark] SparkQA commented on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling

2019-10-23 Thread GitBox
SparkQA commented on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling URL: https://github.com/apache/spark/pull/26078#issuecomment-545641948 **[Test build #112560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112

[GitHub] [spark] SparkQA removed a comment on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling

2019-10-23 Thread GitBox
SparkQA removed a comment on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling URL: https://github.com/apache/spark/pull/26078#issuecomment-545586648 **[Test build #112560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] AmplabJenkins commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224#issuecomment-545642358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224#issuecomment-545642351 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins removed a comment on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224#issuecomment-545642358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224#issuecomment-545642351 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling URL: https://github.com/apache/spark/pull/26078#issuecomment-545642567 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling URL: https://github.com/apache/spark/pull/26078#issuecomment-545642572 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling URL: https://github.com/apache/spark/pull/26078#issuecomment-545642572 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26078: [SPARK-29151][CORE] Support fractional resources for task resource scheduling URL: https://github.com/apache/spark/pull/26078#issuecomment-545642567 Merged build finished. Test PASSed.

[GitHub] [spark] 07ARB edited a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab.

2019-10-23 Thread GitBox
07ARB edited a comment on issue #26216: [SPARK-29453][WEBUI] Improve tooltips information for SQL tab. URL: https://github.com/apache/spark/pull/26216#issuecomment-545637852 @dongjoon-hyun,@HeartSaVioR and @shahidki31 please review the latest changes. --

[GitHub] [spark] dbtsai opened a new pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dbtsai opened a new pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235 ### What changes were proposed in this pull request? Instead of using ZStd codec directly, we use Spark's Compression

[GitHub] [spark] tgravescs commented on issue #25983: [SPARK-29327][MLLIB]Support specifying features via multiple columns

2019-10-23 Thread GitBox
tgravescs commented on issue #25983: [SPARK-29327][MLLIB]Support specifying features via multiple columns URL: https://github.com/apache/spark/pull/25983#issuecomment-545646668 Yes we have an external XGBoost repo you should be able to see the gpu code @firestarman can you point to it and

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#discussion_r338290596 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.sca

[GitHub] [spark] SparkQA commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
SparkQA commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545646955 **[Test build #112563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545647532 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545647537 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] dbtsai commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dbtsai commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#discussion_r338291945 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ###

[GitHub] [spark] AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545647532 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545647537 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dbtsai commented on issue #26233: [SPARK-29533][SQL][TESTS][FOLLOWUP] Regenerate the result on EC2

2019-10-23 Thread GitBox
dbtsai commented on issue #26233: [SPARK-29533][SQL][TESTS][FOLLOWUP] Regenerate the result on EC2 URL: https://github.com/apache/spark/pull/26233#issuecomment-545648122 LGTM. Merged into master. Thanks! This is an automated

[GitHub] [spark] dongjoon-hyun commented on issue #26233: [SPARK-29533][SQL][TESTS][FOLLOWUP] Regenerate the result on EC2

2019-10-23 Thread GitBox
dongjoon-hyun commented on issue #26233: [SPARK-29533][SQL][TESTS][FOLLOWUP] Regenerate the result on EC2 URL: https://github.com/apache/spark/pull/26233#issuecomment-545648225 Thank you so much for review and approval, @dbtsai ! ---

[GitHub] [spark] dbtsai closed pull request #26233: [SPARK-29533][SQL][TESTS][FOLLOWUP] Regenerate the result on EC2

2019-10-23 Thread GitBox
dbtsai closed pull request #26233: [SPARK-29533][SQL][TESTS][FOLLOWUP] Regenerate the result on EC2 URL: https://github.com/apache/spark/pull/26233 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images

2019-10-23 Thread GitBox
dongjoon-hyun commented on issue #26224: [SPARK-29567][TESTS] Update JDBC Integration Test Docker Images URL: https://github.com/apache/spark/pull/26224#issuecomment-545650349 Thank you for review, @viirya ! This is an automa

[GitHub] [spark] dbtsai commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dbtsai commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545650310 cc @tgravescs @viirya This is an autom

[GitHub] [spark] atronchi commented on a change in pull request #26197: [SPARK-29577] Implement p-value simulation and unit tests for chi2 test

2019-10-23 Thread GitBox
atronchi commented on a change in pull request #26197: [SPARK-29577] Implement p-value simulation and unit tests for chi2 test URL: https://github.com/apache/spark/pull/26197#discussion_r338294775 ## File path: mllib/pom.xml ## @@ -130,6 +130,11 @@ org.apache.spark

[GitHub] [spark] dbtsai commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dbtsai commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#discussion_r338291945 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ###

[GitHub] [spark] holdenk commented on issue #26197: [SPARK-29577] Implement p-value simulation and unit tests for chi2 test

2019-10-23 Thread GitBox
holdenk commented on issue #26197: [SPARK-29577] Implement p-value simulation and unit tests for chi2 test URL: https://github.com/apache/spark/pull/26197#issuecomment-545651884 Thanks for making a JIRA :) This is an automate

[GitHub] [spark] dongjoon-hyun commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dongjoon-hyun commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545652949 Looks good to me. I'm regenerating the result. -

[GitHub] [spark] SparkQA commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
SparkQA commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545654247 **[Test build #112564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545654732 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545654732 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545654740 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545654740 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] atronchi commented on a change in pull request #26197: [SPARK-29577] Implement p-value simulation and unit tests for chi2 test

2019-10-23 Thread GitBox
atronchi commented on a change in pull request #26197: [SPARK-29577] Implement p-value simulation and unit tests for chi2 test URL: https://github.com/apache/spark/pull/26197#discussion_r338300773 ## File path: mllib/src/main/scala/org/apache/spark/mllib/stat/test/ChiSqTest.scala

[GitHub] [spark] viirya commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
viirya commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#discussion_r338302076 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ###

[GitHub] [spark] viirya commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
viirya commented on a change in pull request #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#discussion_r338302695 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ###

[GitHub] [spark] dongjoon-hyun commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
dongjoon-hyun commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545658620 The initial result looks better than before. It's faster (2x+) and there is a size reduction, to

[GitHub] [spark] viirya commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus

2019-10-23 Thread GitBox
viirya commented on issue #26235: [SPARK-29576][Core] Use Spark's CompressionCodec for Ser/Deser of MapOutputStatus URL: https://github.com/apache/spark/pull/26235#issuecomment-545659873 looks good in general, just few questions.

[GitHub] [spark] BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-23 Thread GitBox
BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110#discussion_r338302812 ## File path: docs/sql-pyspark-pandas-with-arrow.md ## @@ -178,6 +178,41 @@ For detail

[GitHub] [spark] BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-23 Thread GitBox
BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110#discussion_r338306029 ## File path: python/pyspark/sql/functions.py ## @@ -3233,6 +3233,58 @@ def pandas_udf

[GitHub] [spark] BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-23 Thread GitBox
BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110#discussion_r338305143 ## File path: python/pyspark/sql/functions.py ## @@ -3233,6 +3233,58 @@ def pandas_udf

[GitHub] [spark] BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-23 Thread GitBox
BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110#discussion_r338302225 ## File path: docs/sql-pyspark-pandas-with-arrow.md ## @@ -178,6 +178,41 @@ For detail

[GitHub] [spark] BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide

2019-10-23 Thread GitBox
BryanCutler commented on a change in pull request #26110: [SPARK-29126][PYSPARK][DOC] Pandas Cogroup udf usage guide URL: https://github.com/apache/spark/pull/26110#discussion_r338301924 ## File path: docs/sql-pyspark-pandas-with-arrow.md ## @@ -178,6 +178,41 @@ For detail

[GitHub] [spark] srowen opened a new pull request #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8

2019-10-23 Thread GitBox
srowen opened a new pull request #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 URL: https://github.com/apache/spark/pull/26236 ### What changes were proposed in this pull request? Recent timez

[GitHub] [spark] SparkQA commented on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8

2019-10-23 Thread GitBox
SparkQA commented on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 URL: https://github.com/apache/spark/pull/26236#issuecomment-545663531 **[Test build #112565 has started](https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 URL: https://github.com/apache/spark/pull/26236#issuecomment-545663847 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8

2019-10-23 Thread GitBox
AmplabJenkins commented on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 URL: https://github.com/apache/spark/pull/26236#issuecomment-545663852 Test PASSed. Refer to this link for build resu

[GitHub] [spark] AmplabJenkins removed a comment on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 URL: https://github.com/apache/spark/pull/26236#issuecomment-545663847 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26236: [SPARK-29578][TESTS] Add "8634" as another skipped day for Kwajalein timzeone due to more recent timezone updates in later JDK 8 URL: https://github.com/apache/spark/pull/26236#issuecomment-545663852 Test PASSed. Refer to this link for bu

[GitHub] [spark] SparkQA commented on issue #26230: [SPARK-21287][SQL] Move the validation of fetch size from JDBCOptions to JdbcDialect

2019-10-23 Thread GitBox
SparkQA commented on issue #26230: [SPARK-21287][SQL] Move the validation of fetch size from JDBCOptions to JdbcDialect URL: https://github.com/apache/spark/pull/26230#issuecomment-545664786 **[Test build #4903 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuil

[GitHub] [spark] AmplabJenkins removed a comment on issue #26230: [SPARK-21287][SQL] Move the validation of fetch size from JDBCOptions to JdbcDialect

2019-10-23 Thread GitBox
AmplabJenkins removed a comment on issue #26230: [SPARK-21287][SQL] Move the validation of fetch size from JDBCOptions to JdbcDialect URL: https://github.com/apache/spark/pull/26230#issuecomment-545486926 Can one of the admins verify this patch?

<    4   5   6   7   8   9   10   11   >